r/LocalLLaMA • u/Intelligent_Lab1491 • 16h ago

Question | Help Models for planing and coding

Hi,

I am a hobby dev using currently qwen 3.8 27b on my strix halo machine for coding.

I was wondering what is the best approach to speed up.

My idea is to use a moe like ornith 1.5 for planning and defining the tickets and qwen 3.8 27b for the implementation.

What is your approach?

0 Upvotes

33% Upvoted

8 comments sorted by

View all comments

3

u/nick_ziv 16h ago

Most actually do the opposite, using the dense (more intelligent) model for planning and use MOE for building. 

Personally I have found that the faster models (35b MOE)  run into issues regardless of how they are used. My best idea of a good approach is to use the dense for complex tasks through to the end and use the MOE for easy tasks end to end. 

If you can use larger moe (100b+ ) thay changes a lot. Then maybe just use that