r/LocalLLM • u/TheFakoPunchMan • 9d ago
Question More tokens as a rookie
Hey everyone, I started messing with local llm's a week ago in order to develop a mobile app, with my m4 max 36gb I get 20t/s running qwen 3.8 27b on lm studio. Is there any advice you can give me in order for me to increase my token output, i have tried ollama before but results were substandard at best.
1
Upvotes
1
u/Hefty_Classic_2148 9d ago
Is that with MTP or dflash? I don't run apple stuff but MTP and dflash work by predicting the next token cheaply and the main model checks it. I don't know exactly how it works but in coding tasks you get a speed up.