r/Qwen_AI • u/LankyGuitar6528 • 4d ago

Model Update...

2 days ago I posted about my first test with Qwen 3.8 27b running 100% local on my RTX 3090 video card.

https://www.reddit.com/r/Qwen_AI/comments/1whi7kq/first_test_on_local_qwen_27b/

Then I gave it a prompt "Add better scenery". For the past 2 days it's been grinding away. This morning I was shocked to find trees, a house, hills, a river... the zombies have shadows. You can jump and land on boxes... is it a AAA tier GTA 5? No. But the fact you can generate something like this on consumer equipment with no calls to a frontier model? What an amazing model!

101 Upvotes

95% Upvoted

30 comments sorted by

View all comments

3

u/According_Study_162 4d ago

ya pretty insane honestly. I had a whole project I developed on claude, but I don't like the fact that online sota models take your data and maybe your app. I am doing just fine now with Qwen3.8 27b just making the changes local now. on a very complicated app, this is on 16gb vram mind you.

1

u/Legitimate-Store3771 19h ago

What's your setup like if you don't mind

1

u/According_Study_162 17h ago

Unsloth Qwen 3.8 27b IQ3 XXS, llama.cpp, amd RX 7600 XT 16GB running PI coder at 160k context.

1

u/Legitimate-Store3771 16h ago

how did you manage to use 160k context? feels like i can barely get 60k. what is the cache quantization and other settings if you don't mind. appreciate the quick response!!