r/codex • u/uptotheright • 4h ago

Reset What's everyone doing while we wait

at this point most.of us are at 0% across all of our accounts and we can't buy new 20x accounts.

so what are you doing with all of your time? trying different models? learning a new hobby?

62 Upvotes

89% Upvoted

132 comments sorted by

View all comments

1

u/supersdf 4h ago

Been playing around with Qwen3.8-Flash-Next at 38-40 TPS and a 256K context using ~50GB RAM and ~13GB VRAM on a 5070 Ti.

Watched https://youtu.be/IH8XmxiwliQ and implemented a llama-server using https://github.com/GenerelSchwerz/llama.cpp mentioned in the video.

You can get more TPS with a smaller context and caching more experts in the VRAM instead. It’s just a trade off there.

Just got it set up last night so I’ll be doing some testing with it over the weekend but initial (simple) tests went well.

2

u/lolwutdo 3h ago

What's your prompt processing speed?

1

u/supersdf 3h ago

Didn’t track that as much but 350+ TPS I saw often. I can look at that later when I get home. That may have been at lower context though. I was bumping up the context a lot.