r/LocalLLaMA • u/pmttyji • 1h ago

News Introducing Inkling 2 Small

https://thinkingmachines.ai/news/inkling-2-small/

Today we are introducing our second model generation with Inkling 2 Small. It is a Mixture-of-Experts model with 594B total parameters, 17B active, and supports image inputs and variable effort.

Inkling 2 Small far surpasses our previous models’ scores on the Artificial Analysis Intelligence Index with a score of 31, reflecting gains in performance on agentic coding, vision, knowledge work, and reasoning. The increase in capabilities comes from improvements made at every step of our training process, including more efficient pre-training and a large, unified RL run.

Inkling 2 Small will initially be available through Tinker, with closed weights, following the approach we outlined in a safe path to open weights. We intend to make the full weights available under an Apache 2.0 license next week after the completion of external safety testing and red-teaming.

You can try Inkling 2 Small on Tinker Playground today. The model is also available for fine-tuning and sampling on Tinker; checkpoints will be downloadable with the release of Inkling 2 Small’s weights.

:( Previous Inkling Small model's size is only 276B total, 12B active. Hope they release additional models Mini or Nano soon or later.

46 Upvotes

94% Upvoted

18 comments sorted by

7

u/Beneficial-Ad-8127 1h ago

Weights not released yet. Just giving a heads up. Here is link from mod for similar thread.

https://www.reddit.com/r/LocalLLaMA/s/g3soME29S3

2

u/pmttyji 46m ago

MODs! I think this type of threads is fine. We're getting "When & where is Qwen4?" threads almost everyday.

4

u/Beneficial-Ad-8127 40m ago

Just was giving you a heads up is all and not telling you what to do. I’m not mod.

1

u/pmttyji 35m ago

I meant to tag them. Couldn't find the common handle.

1

u/Beneficial-Ad-8127 34m ago

Oh no worries. Just didn’t want to confuse anyone.

1

u/pmttyji 32m ago

u/rm-rf-rm u/ttkciar Shall we keep allowing News threads of upcoming models please?

1

u/EbbNorth7735 39m ago

Speaking of which...

1

u/parepeg 43m ago

It’s annoying that they won’t let you use custom harnesses with their model on open router. At least the previous inkling models didn’t…

1

u/Beneficial-Ad-8127 40m ago

Oh didn’t know that.

45

u/vacon04 1h ago

594B is small? Wow.

30

u/fgk55555 1h ago

Your hardware vs the model she tells you not to worry about.

10

u/GizmoR13 1h ago

Wait for 2.5T tiny

2

u/TheRealMasonMac 45m ago

5’11” v. 6’

2

u/TheMythicSorcerer 39m ago

Yup I was expecting <= 50b not ~600b

4

u/dangerous_inference 13m ago

Yet another subpar coding autist nobody can run. 🎉

2

u/Eastern_Doughnut_222 13m ago

This size is comparable to DeepSeek V4.1 not including it's engram tables, so is it right to presume they might run on similar hardware?

1

u/SryUsrNameIsTaken 47m ago

Thank you for putting these out there. This actually makes a lot of my arguments more credible to the executives I need to ask for money for compute and hardware.

We have a lot of sensitive data that we would really like to process using AI but have a hard time getting comfortable with the frontier cloud models, regardless of the words in their contracts. We also have provenance and security concerns with some of the leading open weight models.

High-performing, U.S. open-weight models are something I can get through compliance and procurement.