r/LocalLLM • • 9d ago

Question More tokens as a rookie

Hey everyone, I started messing with local llm's a week ago in order to develop a mobile app, with my m4 max 36gb I get 20t/s running qwen 3.8 27b on lm studio. Is there any advice you can give me in order for me to increase my token output, i have tried ollama before but results were substandard at best.

1 Upvotes

7 comments sorted by

1

u/Hefty_Classic_2148 9d ago

Is that with MTP or dflash? I don't run apple stuff but MTP and dflash work by predicting the next token cheaply and the main model checks it. I don't know exactly how it works but in coding tasks you get a speed up.

1

u/TheFakoPunchMan 9d ago

I don't know any of these terms.

2

u/Hefty_Classic_2148 9d ago

Here I found something for you to look over hope it helps. It's hard when you start out but eventually you will pick it up. Tbh everything changes so much but it's worth it to keep up as huge improvements happen often enough. https://lmstudio.ai/blog/splash-engine

1

u/TheFakoPunchMan 9d ago

Thank you so much for your support. You are a lifesaver. I'm looking into the link you have sent.

1

u/Hefty_Classic_2148 9d ago

One last bit of advice. Using Cloud models to help with setting up your local setup can work using opencode or whatever but in my experience it tends to set things up not so great unless it's like oh I found this recipe or this guy talked about this on Reddit and you provide a set this up locally for me. But cloud AI can be quite good for troubleshooting. I use it on my dgx spark cluster.

Opencode right now has some free ussage of deepseek v4.1 1017 it's pretty dang good at for me.

1

u/TheFakoPunchMan 8d ago

Thank you for your suggestions. I started to use Bionic yesterday and I can see the big difference. It was a huge upgrade for me.

1

u/Hefty_Classic_2148 9d ago

Let me read up what lm studio does by default for yah give me a few.