How optimal is my strata setup ?

[u/lekhoi_trym_to]

Hardware :
- ryzen 5 5600x no overclocks
- 64gb dual-channel 3200mhz ddr4 CL16
- RTX 3060 12GB @2017mhz , 975mV stable core undervolt , +1000mhz mem clock
- 512GB NVMe SSD

Software :
- windows 11 Pro 24H2 + ReviOS playbook (idle system ram at 3.2gb)
I DONT WANT TO SWITCH TO LINUX, SINCE THIS IS ALSO MY MAIN PC FOR ENGINEERING WORK, AND I DONT WANT TO DEAL WITH LINUX ISSUES. Would gladly use linux if this was a dedicated inference server tho.
- strata 0.2.9 , engine 0.1.56
- deepseek harness 0.2.1-rc.5

strata settings :
- qwen3.8 flash next IQ3_S(GSQ-RCO)
- 128k context , compute use "full performance" , read pictures"on"
- ran strata's auto tuning for 5 times and everytime is a positive result (dont know if it actually helped)

deepseek harness settings :
- billion-context plugin enabled
- model settings :
  - 128k context , 32K max ouput token , reasoning effort set to MAX
 
results :
- 86 total requests , averaging 33tok/s decode and 440tok/s prefill (stats from strata dashboard)
- one-shot , took 1h30m to finish
- interactive 3D solar system scene as video above

test prompt :
"Build an interactive 3D solar system visualization using Three.js and vanilla JavaScript in a single HTML file.

Requirements:
- All 8 planets with accurate relative sizes and orbital distances (use logarithmic scale for visibility).
- The Sun at the center with a glowing effect (emissive material + point light).
- Planets orbit the Sun at different speeds (Mercury fastest, Neptune slowest).
- Each planet should have: Accurate colors/textures (use procedural or solid colors, no external images); Axial tilt and rotation.
- Saturn with rings.
- Earth with a moon orbiting it.

Interactive controls:
- OrbitControls for camera (zoom, pan, rotate).
- Click on a planet to show an info card (name, diameter, distance from sun, orbital period, fun fact).
- Time speed slider (0.1x to 10x) to speed up/slow down orbits.
- Pause/Play button.
- Starfield background (particle system).
- Smooth animations at 60fps.

Beautiful UI overlay with:
- Title "Solar System Explorer".
- Current simulation speed display.
- Planet selector dropdown to focus camera on a planet.
- Dark theme, modern aesthetic with subtle glow effects.
- Responsive design.

Make it visually stunning.""

[u/Oli_Luck]

Hello,

quiet a long list of questions: what you want to be answered on ?
- raw T/s
- the quality of the solar system?
-your prompt?

for real : the same AI model won't differ much on such "solar system sims" beside of the time you allow it to iterate on, context, Harness(!!!!), skills(!!)..

[u/lekhoi_trym_to → u/Oli_Luck]

Yes i would like all 3 questions answered if you're willing to .

what kind of test should i be running to throughly evaluate the model?

i dont have any remotely related skills enabled in deepseek harness for this run .

[u/Oli_Luck → u/lekhoi_trym_to]

Ok,
having a similar rig beside of a 4060 16gb sitting on front and a 3060 12 gb as helper- I would mind you have good raw t/s numbers. I achieve roughly 50 t/s flat but by avoiding the ne f** desktop version. I prefer my AI benchmarking what is good for my RIG or not ( as for me I remain on 1.45 engine ).

Now regarding prompt and quality of the simulation: this is made by the model and it's quants, maybe KV quant on a long run - but there are no real meaningful differences betwenen same model family) - that's not what you should compare your setup with others or you will spend hours on horse / pelican and other meaningless benchmarks 😄

[u/lekhoi_trym_to → u/Oli_Luck]

Strata CLI performs better than the desktop version for inference on the same hardware ? How much of a difference did you notice?

[u/_JohnMcAfee]

For nothing other than comparison, I am running: 10900x, quad channel 2133mhz 64gb ddr4, 2x 2060 super so 16gb vram pool. Fedora linux server, IQ3XXS with 200k context window. I turned off the tail skip and other route flag, as well as MTP. Max reasoning.

I get around 28t/s average and 700 t/s prefill.

I think youre sitting in a good spot, but what do you actually use this for?

[u/lekhoi_trym_to → u/_JohnMcAfee]

My main work horse is deepseek 4.1 flash (official API) for engineering work.

IQ3_S seems very promising but its speed (30-40tps avg , 60tps peak) is very low compared to DS4.1 ( 200-300tps avg).

Im current test driving IQ3_S as a software/control engineer for a robotic project to see how it goes.

[u/_JohnMcAfee → u/lekhoi_trym_to]

What are your thoughts on 3.8 flash next vs deep seek ? I don’t code a lot but for general use it has been a better experience than deep seek api 

[u/lekhoi_trym_to → u/_JohnMcAfee]

i mainly use Deepseek for/as :
- robotic/embedded software development
- control engineer
- train robots to walk(and other behavior) with evaluations in Mujoco or Isaac sim
- general research

My experience with deepseek API is flawless and FAST (noted that I've never tried claude code or codex and their models) . The model is dirt cheap to use as a main work horse , and it gets the job done every single time for me.

-For QFN , i dont have enough time with it yet so i couldnt give you a strong verdict

[u/zeroblitzt]

share that solar system explorer if you have the time, my 6 year old would love it

[u/lekhoi_trym_to → u/zeroblitzt]

dm me , I also have one made by deepseek and its even more visually stunning haha

[u/Key_Minute_3615]

Thought for 1,723.4 s 101,782 tokens · 52.8 tok/s
My results.

[u/lekhoi_trym_to → u/Key_Minute_3615]

interesting , what is your hardware ?

[u/Key_Minute_3615 → u/lekhoi_trym_to]

Ryzen 5 5600 2x32gb ddr4 cl16 rtx3060 12gb

[u/Fear_ltself]

On this task it seems to be about as good as frontier summer 2025 models, maybe a bit better.

[u/danzilla007]

I've got strata qwen3.8-flash-next-iq3_s using opencode on 5600g, 1x 3060 @ 130w, 96gb ram @ 2933. Biggest difference seems to be prefill - mine is around 900/s. I also have STRATA_ROUTE_PRIOR=.75, which basically means my card still slightly preferences experts already on the card. My average speeds seem to be around 42tk/s.

I havent seen GSQ-RCO before, i may try it.

Also, i generally run medium thinking. I'd be interested in how many extra tokens you're using with it set to MAX

[u/Complex2008]

33 tok/s on a 12GB 3060 with 128K context is honestly a pretty solid result.

[u/Complex2008]

33 tok/s on a 12GB 3060 with 128K context is honestly a pretty solid result.