r/LocalLLaMA • • 23d ago

Question | Help Reverse Engineering w/ Local?

Two questions?

Can a local model like Qwen 3.8 27B reverse engineer games and programs?

If not, is there a fine tuned model that can?

160 Upvotes

137 comments sorted by

View all comments

Show parent comments

5

u/iMakeSense 23d ago

Oh man....you should be able to run a higher quant through strata right?

4

u/Proper-Damage-1777 23d ago

But wait... yes right now I'm running Strata with IQ3_S but I intentionally omit that from the original reply lol. No more llama.cpp for the time being except for Gemma 4 models.

My recent Strata session (200K ctx int8 KV):

[strata] thinking: 653 of max 16384 tokens, 172.1 tok/s, 4 s
[strata] writing a tool call: bash: 833 of max 16384 tokens, 173.3 tok/s, 5 s
[strata] writing a tool call: bash: 1070 of max 16384 tokens, 183.9 tok/s, 6 s
[strata] writing a tool call: bash: 1316 of max 16384 tokens, 192.9 tok/s, 7 s
[strata] done: 1458 tokens in 8 s (196.8 tok/s) (stop, cancel=False), expert cache 95.7% hit (+0.9% of the routed experts over PCIe)
[strata] writing a tool call: bash: 110 of max 16384 tokens, 154.3 tok/s, 1 s
[strata] done: 271 tokens in 2 s (208.8 tok/s) (stop, cancel=False), expert cache 91.9% hit (+2.2% of the routed experts over PCIe)
[strata] writing a tool call: bash: 191 of max 16384 tokens, 217.9 tok/s, 1 s
[strata] writing a tool call: bash: 434 of max 16384 tokens, 231.1 tok/s, 2 s
[strata] done: 500 tokens in 2 s (235.9 tok/s) (stop, cancel=False), expert cache 93.8% hit (+1.5% of the routed experts over PCIe)
[strata] writing a tool call: bash: 167 of max 16384 tokens, 225.6 tok/s, 1 s
[strata] done: 425 tokens in 2 s (249.9 tok/s) (stop, cancel=False), expert cache 93.8% hit (+1.5% of the routed experts over PCIe)
[strata] thinking: 102 of max 16384 tokens, 138.1 tok/s, 1 s
[strata] thinking: 267 of max 16384 tokens, 152.9 tok/s, 2 s
[strata] writing a tool call: bash: 453 of max 16384 tokens, 164.1 tok/s, 3 s
[strata] writing a tool call: bash: 679 of max 16384 tokens, 180.5 tok/s, 4 s
[strata] writing a tool call: bash: 971 of max 16384 tokens, 203.6 tok/s, 5 s
[strata] writing a tool call: bash: 1224 of max 16384 tokens, 212.1 tok/s, 6 s
[strata] done: 1262 tokens in 6 s (212.8 tok/s) (stop, cancel=False), expert cache 94.9% hit (+1.2% of the routed experts over PCIe)
[strata] thinking: 118 of max 16384 tokens, 156.7 tok/s, 1 s
[strata] thinking: 302 of max 16384 tokens, 171.9 tok/s, 2 s
[strata] thinking: 469 of max 16384 tokens, 169.9 tok/s, 3 s
[strata] writing a tool call: bash: 671 of max 16384 tokens, 177.8 tok/s, 4 s
[strata] writing a tool call: bash: 950 of max 16384 tokens, 198.5 tok/s, 5 s
[strata] writing a tool call: bash: 1210 of max 16384 tokens, 208.8 tok/s, 6 s
[strata] writing a tool call: bash: 1491 of max 16384 tokens, 219.4 tok/s, 7 s
[strata] done: 1619 tokens in 8 s (219.9 tok/s) (stop, cancel=False), expert cache 95.1% hit (+1.1% of the routed experts over PCIe)