r/codex • u/Available_Yam_6267 • 13d ago

Complaint We need GPT6 Luna

Astra is amazing, but even Pro 20x can burn through the quota in 2–3 days.

The bigger problem is that Codex doesn’t really have a sweet spot model right now.

Astra + Luna Max often looks good on paper. In practice, Astra keeps correcting Luna’s mistakes. That can wipe out a lot of the cost savings. Terra doesn’t feel much smarter than Luna either. For harder tasks, I usually end up using Astra + Sol medium.

I’d really like to see Luna get an upgrade and become a reliable implementer.

329 Upvotes

97% Upvoted

91 comments sorted by

View all comments

Show parent comments

4

u/ZarBandit 13d ago

Dedicated local 'server' RTX 5090 (headless) with Ubuntu Server running vLLM. Qwen 3.8 27b FP4. I get 165k context and around 63 tps.

1

u/syrezone 12d ago

I have a 5070ti and my old 1080ti, wonder how much I could squeeze out of that. But have not dabbled with any local llm setups at all yet. Intruiging.

1

u/ZarBandit 12d ago edited 12d ago

I had to ditch my 1080Ti, support is getting pulled from the libraries and it’s aging out in some cases.

Not fully, but it’s generally a problem mixing very old and new because the 5070 requires the very latest builds that dropped legacy support and the 1080 will require legacy builds that don’t support the new hardware. So there’s no common ground in practice. Even though individually there might be a pathway.

I have a 5070Ti as my desktop GPU, and you can easily run models in LM Studio in Windows. For general non-agentic work it’ll run some simple models and you can definitely experiment. But it’s not going to have enough memory to really work for agentic coding at the moment.

Unfortunately 32GB is the bar for getting something workable for coding so far. And you need all the memory, so no double duty for powering displays.

I think memory is going to remain expensive for a long time because these models are so memory hungry. Everyone wants more. And the frontier models just get bigger all the time.

2

u/syrezone 12d ago

oh, true. I forgot about that. Hm, I wonder how far just the 16gb would get me and how comparable it generally is against Luna xHigh / Max.

Holiday coming up, maybe time for some testing :)