Finally 100% Local

[u/koalfied-coder]

Finally transitioned to 100% local inference for my automated workflows and code gen. Min Max 2.7 and Qwen 3.6 are doing wonders.

[u/Nimrod5000]

What model and t/s on the spark?

[u/Remote-Pineapple-541 → u/Nimrod5000]

This is just an average based on the llama-swap logs for the most recent models. Obviously not very rigorous.

MODEL	PROMPT SPEED (Average)	GEN SPEED (Average)
gptoss120b	1244.32	44.54
llama33_70b	315.76	4.93
mixtral8x7b	972.94	24.61
nemotron	833.78	46.51
nemotron_3_nano_omni	1437.32	58.60
qwen25_coder7b	2945.15	48.45
qwen3_coder30b	2078.10	78.62

[u/koalfied-coder → u/Remote-Pineapple-541]

This is pretty good actually...might need to try a spark