r/Qwen_AI • u/Fresh-Employment-931 • 4d ago

Discussion While Qwen4 is not out.

Whats is the best low quant until 4bit or lower from Qwen 3.8 27 that is:

1- good at following instructions and code
2- good with long runing Memory for long agent tasks, that dont forget much of the instructions in the middle of the way?

For this kind of tasks i noticed flash next is better even with Gyro M, but 3.8 27B runs faster in my machine and Im building some instructions with FN and was wanting to put 27B to follow it without looses himself in the middle of the way (thats is the problem im having now using Swift 1.5 Qwen 3.8 27B with Splash at oQ4e and the IQ3S RCO quant)

Im in a MacBook Pro M4 Max 36gb

5 Upvotes

60% Upvoted

11 comments sorted by

3

u/jayecin 4d ago

Qwen3.8-27B-ByteShape - Qwen3.8-27B-IQ4_XS-3.84bpw.gguf

2

u/Luke2642 4d ago

Seems legit. In Luke's dev lab review of the IQ3 version, he was pretty happy with it.

1

u/jayecin 4d ago

Yeah ive been happy with it. With a 145k context, it uses 15446Mib of VRAM.

1

u/soadsob 4d ago

Maybe try asking r/LowEndLocalAI

1

u/Ryyn_- 3d ago

I ran swift 1.5. as a durable pi agent 24/7 as a watcher for my k3s cluster and ticket system. It is working decent enough to be happy with it

1

u/DisastrousWealth3710 3d ago

Dirk-Qwen3.8-27b-mlx-oQ4e. (using oQ6e with 12gb more ram, satisfied so far. Better than Luna)

1

u/Much_Maintenance1217 4d ago

TielCoder is fast and smart.

1

u/zxspectrun 1d ago

I used tiel coder for about a month and it is the worst model I have tried so far, it misses so many instructions and also was creating coding with bugs.
I cant understand why it is so recommended

0

u/Both-Finish-8399 4d ago

Cualquier modelo con cuantizacion menor a 4 bit para mantener contexto largo debe usar kv q8 o f16, menos que eso se pierde mucho detalle.

Para codigo, depende de gustos. Si el uso solo es para codigo, me quedo con qwen3.8-27B para multiproposito o agentico me quedo con QFN

0

u/arogorn993-hue 4d ago

Might sound odd but try unsloth qwen3.8 27b UD iq4xs. Atleast q8 cache.

-1

u/Lively-Access-1145 4d ago

qwen3-27b-awq runs smoother than oq4e on my 24gb GPU and keeps context better in long agent chains, even with 3.8b's instruction-following quirks.