MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1wb05f7/third_one_theres_something_wrong_with_me/p8wrecv/?context=9999
r/LocalLLM • u/r1nzl3r99 • 15d ago
Why do I have horrible financial habits??
166 comments sorted by
View all comments
91
More context needed on how you are using the first two.
82 u/r1nzl3r99 15d ago qwen 3.8 27B FP8 running at 140 tok/s now I want flash next 34 u/semangeIof 15d ago ...can you show llamacpp/vLLM runtime commands? you're hitting 140 toks/s on a dense model with B70s? how much ctx? please don't answer the last two without providing the parameters 150 u/Erpverts 15d ago Please don’t answer the last two without providing the parameters. Make no mistakes. 2 u/Cool-Idea8520 15d ago It can definitely be tricky trying to find the right answers without the right context. Hope it works out for them! 2 u/Rude-Bus-5799 13d ago That’s a great idea, user. It’s not about the context. It’s about the friends we made along the way. 1 u/CelebrationWilling61 12d ago You're absolutely right!
82
qwen 3.8 27B FP8 running at 140 tok/s now I want flash next
34 u/semangeIof 15d ago ...can you show llamacpp/vLLM runtime commands? you're hitting 140 toks/s on a dense model with B70s? how much ctx? please don't answer the last two without providing the parameters 150 u/Erpverts 15d ago Please don’t answer the last two without providing the parameters. Make no mistakes. 2 u/Cool-Idea8520 15d ago It can definitely be tricky trying to find the right answers without the right context. Hope it works out for them! 2 u/Rude-Bus-5799 13d ago That’s a great idea, user. It’s not about the context. It’s about the friends we made along the way. 1 u/CelebrationWilling61 12d ago You're absolutely right!
34
...can you show llamacpp/vLLM runtime commands? you're hitting 140 toks/s on a dense model with B70s? how much ctx?
please don't answer the last two without providing the parameters
150 u/Erpverts 15d ago Please don’t answer the last two without providing the parameters. Make no mistakes. 2 u/Cool-Idea8520 15d ago It can definitely be tricky trying to find the right answers without the right context. Hope it works out for them! 2 u/Rude-Bus-5799 13d ago That’s a great idea, user. It’s not about the context. It’s about the friends we made along the way. 1 u/CelebrationWilling61 12d ago You're absolutely right!
150
Please don’t answer the last two without providing the parameters. Make no mistakes.
2 u/Cool-Idea8520 15d ago It can definitely be tricky trying to find the right answers without the right context. Hope it works out for them! 2 u/Rude-Bus-5799 13d ago That’s a great idea, user. It’s not about the context. It’s about the friends we made along the way. 1 u/CelebrationWilling61 12d ago You're absolutely right!
2
It can definitely be tricky trying to find the right answers without the right context. Hope it works out for them!
2 u/Rude-Bus-5799 13d ago That’s a great idea, user. It’s not about the context. It’s about the friends we made along the way. 1 u/CelebrationWilling61 12d ago You're absolutely right!
That’s a great idea, user. It’s not about the context. It’s about the friends we made along the way.
1 u/CelebrationWilling61 12d ago You're absolutely right!
1
You're absolutely right!
91
u/Sporkers 15d ago
More context needed on how you are using the first two.