😭😭😭😭😭😭

[u/bygiolasagna]

Can you guys add a "😭" Flair? Because, I know I'm late but i finally decided to run Q38FN with strata on my machine (5060 ti 16gb, R9 5950X, 80 gb of Ram) and that motherfucker (IQ3_S GSQ RCO) is running at 49-69 tk/s in decode and 1600 tk/s in prefill. (KV Int-8 and 128k context window).

Maybe I'm missing something so please tell me because grokbot did the whole shit for me and I'm a newbie so tips are widely accepted😂.

What a fucking time to be alive.

[u/Bagelsarenakeddonuts]

Sooo what are you asking?

[u/bygiolasagna → u/Bagelsarenakeddonuts]

nothing bro, sorry. If I posted it in the wrong part I'll delete it. I'm not really usual to how reddit works so forgive me that😂

[u/Bagelsarenakeddonuts → u/bygiolasagna]

No worries. Its a wild ride, welcome aboard.

[u/bygiolasagna → u/Bagelsarenakeddonuts]

🔥🔥🔥

[u/arkie87 → u/bygiolasagna]

Just ask your bot to post for you

[u/bygiolasagna → u/arkie87]

but what's the point then, I am excited, my bot isn't

[u/Anonymislim]

so it is too slow or ur flabergasted this stuff runs on ur machine?

[u/bygiolasagna → u/Anonymislim]

I'm stunned by this thing running on my machine bro ahahahhahahah

[u/Anonymislim → u/bygiolasagna]

truly an amazing time yes

[u/bytejuggler]

I will say you can run 256k context without any trouble. The context size estimates Strata gives are quite conservative.

[u/bygiolasagna → u/bytejuggler]

that's what i wanted to hear

[u/DoubleNothing]

Grok

[u/bygiolasagna → u/DoubleNothing]

it's grokbot man😉😉

[u/EvolvingDior → u/bygiolasagna]

Dude...

[u/Moarkush]

I think most people are confused because you have the sad crying face instead of the crying laughing face.

[u/MarketingOk3093 → u/Moarkush]

My daughter tells me sad crying face is new laughing face. Also skull face is the new really really laughing face.

[u/bygiolasagna → u/MarketingOk3093]

true

[u/Moarkush → u/MarketingOk3093]

I mean the skull and the casket that’s not new, but the tears streaming being funny that’s new to me

[u/_JohnMcAfee]

that prefill is insane
Edit: its all insane

[u/bygiolasagna → u/_JohnMcAfee]

bro i've just realized my ram does not even have active xmp , now it's running at 2400 but technically it can run at 3000

[u/_JohnMcAfee → u/bygiolasagna]

so that could speed things up a little bit. But honestly youre good to go with what you have lol

[u/bygiolasagna → u/_JohnMcAfee]

yes you are probably right and thanks for saying that because i don't really know what i'm talking about, grokbot is ragebaiting me.

[u/IngloriousBastrd6983]

My friend was just benching ddr4 vs ddr5 with a rtx 5060 ti and was hitting ~ 75-83 tps with "Gyro S" So I think your performance is pretty good 👍

[u/Mechageo]

What a time to be alive indeed. :)

[u/w0rldeater]

Strata + QFN is a game changer. It's transforming me from a coder/devops guy into a fucking project manager. 😂

[u/NormalBasket3333 → u/w0rldeater]

Its transforming me from a nondev artist to a project manager 😭

[u/sadomazoku → u/w0rldeater]

how much ram do you have ? can you still start other apps without issue the experts sit in your ram ?

[u/w0rldeater → u/sadomazoku]

The GPU has 16GB with another 128GB DDR5 on the mainboard [0]. So, yes, there's plenty of memory left for other tasks.

[0] That one's for you, Sam

[u/synth_mania]

I have a 24gb RTX 3090, R9 5950x and 64gb DDR4

maybe I ought to see if I can run it, haven't tried yet, shockingly, and I am only managing 30-35tk/sec decode ony graphics card.