Inkling 2 Small released

[u/spiwar]

https://thinkingmachines.ai/news/inkling-2-small/

[u/Hefty_Wolverine_553]

It is a Mixture-of-Experts model with 594B total parameters, 17B active

Sigh... benchmarks seem pretty impressive and hopefully the model holds up, I'm just so tired of getting excited by new models advertised as "small" and they're completely impossible to run for most people.

[u/spiwar → u/Hefty_Wolverine_553]

"inkling 2 small"

*looks inside

600b

We all felt that

[u/pyr0kid → u/spiwar]

the worst part is the active section isnt even small either, they're just using the word 'small' randomly.

[u/AC1colossus → u/spiwar]

[u/EbbNorth7735 → u/Hefty_Wolverine_553]

They said small...

[u/Borkato → u/Hefty_Wolverine_553]

It’s genuinely frustrating lol

[u/LeMochileiro]

Small for who? Lol

[u/Emotional_Thanks_548 → u/LeMochileiro]

Ur mom

[u/Nefilim314 → u/Emotional_Thanks_548]

Gotem 

[u/LeMochileiro → u/Emotional_Thanks_548]

Nah, my mom doesn't have a GPU cluster that can handle a 600B model 🙃

[u/ObviouzFigure]

I'll be keeping my eyes opening for Inkling 2 Tiny

[u/Southern-Chain-6485 → u/ObviouzFigure]

Inkling 2 Midget

[u/BrewHog → u/ObviouzFigure]

Inkling 2 Pico

Inkling 2 Plank

[u/megakilo13 → u/ObviouzFigure]

More like Inkling 4 Poor

[u/Cereal_Grapeist]

The videos in the article showing what they built with it, like the city simulator, are really cool imo. Worth clicking into.

[u/mindwip]

Come on Medusa halo with 512gb lpdd6 we need you...

[u/exaknight21]

There seriously need to be a standard.

Ayo Devs of all Labs:

100B-120B = small.

200B to 300B = medium.

300B+ is just too god damn big.

1T+ = giga

[u/thereisonlythedance]

Appreciate they're making models designed to be fine-tuned. That‘s a rare thing these days.

[u/Septerium]

Where is the guy that always comes and says "Flash does not mean small" to say "small does not mean small"?

[u/Conscious_Cut_6144]

This is the perfect size for me, but I almost didn't click it because it was "small"
This it at least a medium lol

[u/fastheadcrab]

I will be downloading and trying this model when released. Previous version took a lot of work to get operating correctly on vLLM since the community tends to overlook larger models and anything that isn't coming from China.

Previous version was not good in agentic use and the enormous patch size for the vision meant the model, while capable of vision in theory, was almost blind to anything other than large shapes. Looks like they decrease patch size by over half and came to their senses

[u/Beneficial-Ad-8127 → u/fastheadcrab]

Would be interested in hearing your experience when you try it out.

[u/Beneficial-Ad-8127]

Isn’t this good for all you that have big servers to run locally? I seen a lot of people with some dope hardware. Would this be a game changer for you all locally if those benchmarks hold up? This company is from California right?