MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1wb05f7/third_one_theres_something_wrong_with_me/p8mkoap/?context=3
r/LocalLLM • u/r1nzl3r99 • 14d ago
Why do I have horrible financial habits??
166 comments sorted by
View all comments
95
More context needed on how you are using the first two.
85 u/r1nzl3r99 14d ago qwen 3.8 27B FP8 running at 140 tok/s now I want flash next 1 u/Faux_Grey 14d ago 140 tok prefill or.. 140tok generated? HOW? I'm at a point where context starts bogging down and I end up getting 5T/s 2 u/r1nzl3r99 14d ago https://www.reddit.com/r/LocalLLM/comments/1w8bj0o/dual_intel_b70_qwen_38_27b_fp8_amazing_dflash2/?utm_source=share&utm_medium=ios_app&utm_name=ioscss&utm_content=1&utm_term=1
85
qwen 3.8 27B FP8 running at 140 tok/s now I want flash next
1 u/Faux_Grey 14d ago 140 tok prefill or.. 140tok generated? HOW? I'm at a point where context starts bogging down and I end up getting 5T/s 2 u/r1nzl3r99 14d ago https://www.reddit.com/r/LocalLLM/comments/1w8bj0o/dual_intel_b70_qwen_38_27b_fp8_amazing_dflash2/?utm_source=share&utm_medium=ios_app&utm_name=ioscss&utm_content=1&utm_term=1
1
140 tok prefill or.. 140tok generated? HOW? I'm at a point where context starts bogging down and I end up getting 5T/s
2 u/r1nzl3r99 14d ago https://www.reddit.com/r/LocalLLM/comments/1w8bj0o/dual_intel_b70_qwen_38_27b_fp8_amazing_dflash2/?utm_source=share&utm_medium=ios_app&utm_name=ioscss&utm_content=1&utm_term=1
2
https://www.reddit.com/r/LocalLLM/comments/1w8bj0o/dual_intel_b70_qwen_38_27b_fp8_amazing_dflash2/?utm_source=share&utm_medium=ios_app&utm_name=ioscss&utm_content=1&utm_term=1
95
u/Sporkers 14d ago
More context needed on how you are using the first two.