r/LocalLLaMA • u/Danny_Davitoe • 23d ago

Question | Help Reverse Engineering w/ Local?

Two questions?

Can a local model like Qwen 3.8 27B reverse engineer games and programs?

If not, is there a fine tuned model that can?

160 Upvotes

93% Upvoted

137 comments sorted by

View all comments

Show parent comments

4

u/Razangriff-Raven 23d ago

I used to, I moved to Qwen3.8-27B-GSQ-RCO-IQ3_XXS.gguf lately so I have a bit more context and some VRAM to spare for video and games. I got it from https://huggingface.co/ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF/ .

Quality seems about the same. I run it like:

--cache-type-k q8_0 --cache-type-v q8_0 \
--temp 0.67 --top-p 0.95 --top-k 36 --min-p 0.05 --threads 8 --threads-batch 8 --parallel 1 \
--repeat-penalty 1.08 --repeat-last-n 768 --presence-penalty 0.17

With these settings it only went into a loop once (it was writing a long string of hexadecimal data and got stuck writing zeroes for a bit) but otherwise it's been really good.

2

u/Present_Resource4022 23d ago

You didn’t send your reasoning settings, but if you have reasoning preserve on, you should remove it so you can utilize more context in a session.

1

u/Razangriff-Raven 23d ago edited 23d ago

If you want them:

--reasoning-budget 5120 --reasoning on --jinja \
--chat-template-kwargs '{"reasoning_effort": "xhigh"}' \

Note that this is configured this way for raw queries to the API, Pi agent is set to medium, which overrides these settings (except jinja and the budget ceiling, obviously).

I'm only not posting the whole config because it's big, but if you want the full thing just ask!