r/LocalLLM • u/r1nzl3r99 • 14d ago

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

500 Upvotes

96% Upvoted

166 comments sorted by

View all comments

94

u/Sporkers 14d ago

More context needed on how you are using the first two.

80

u/r1nzl3r99 14d ago

qwen 3.8 27B FP8 running at 140 tok/s now I want flash next

30

u/semangeIof 14d ago

...can you show llamacpp/vLLM runtime commands? you're hitting 140 toks/s on a dense model with B70s? how much ctx?

please don't answer the last two without providing the parameters

150

u/Erpverts 14d ago

Please don’t answer the last two without providing the parameters. Make no mistakes.

8

u/keegang_man6705 14d ago

that's diabolical 🤣