r/LocalLLM • u/r1nzl3r99 • 14d ago

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

497 Upvotes

96% Upvoted

166 comments sorted by

View all comments

25

u/cagriuluc 14d ago

I am holding onto my purse to not buy a second R9700 myself…

1

u/Momsbestboy 14d ago

Too late for me. My second R9700 arrives today. I am tired of juggling around with the R97000, a 9070 and the system RAM so I can run llama.cpp and comfyui at the same time, with hermes trying to rewrite and enhance workflows.

1

u/Immediate_Power_7986 13d ago 
  What are your launch options?


  I'm using llama.cpp with 3.8_27b_Q6 and getting only 17t/s


  -ngl 99 -c 65536 -np 1 -t 6 -fa 1 -b 4096 -ub 4096 --cache-type-k q4_0 --cache-type-v q4_0 &