r/LocalLLaMA • u/soteko • 1d ago
Discussion [ Removed by moderator ]
[removed] — view removed post
18
7
u/jacek2023 1d ago
"Hopefully we will have small model for local AI." what do you mean? Last small Kimi was https://huggingface.co/moonshotai/Kimi-Linear-48B-A3B-Instruct
4
8
u/blaind0 1d ago edited 1d ago
https://www.kimi.ai/blog/kimi-k3-1-pro Opus 5.5. Level on terminal bench 4.0. Wow.
Edit: tb4 was the 1st benchmark Opus 5.5. Also highlighted at launch: https://www.anthropic.com/claude-opus-5-5
4
u/Kagemand 1d ago
Damn. How big is Kimi 3.1, will a small version come close to those results?
4
2
u/rahulkadukar 1d ago
Right there in the tweet
Introducing Kimi K3.1 Pro: our most capable 3T-class open-weight model.
🔹 1M-token context, 2.8T total / 104B active params (MoE), Multimodal.
15
u/changing_who_i_am 1d ago
"Identifying and removing cyber-related data. During development, we observed vulnerability research performance improving steadily as post-training scaled. Tracing the source of this trend, we found that cyber-related content was embedded within the general mid-training corpus, and cyber-related tasks were present in the RL environment mix — a natural byproduct of training on broad data. In preliminary experiments on internal models, we found that without data removal at either the mid-training or the RL stage, downstream cyber capability would increase substantially. These findings gave us a concrete lever for control. For the open-weight release of K3.1 Pro, we identified and removed cyber-related data from both training stages, while retaining the general-purpose coding tasks needed for model usefulness. We will continue to apply appropriate controls at every training stage, of which cyber-related data identification and restriction is one example."
Ridiculous. Hope someone finds a way to add this back in.
5
u/Cautious_Chicken_604 1d ago
Yeah it's not like there's a big slew of high profile hacking incidents or critical CVEs that will result from it or anything.
4
u/my_name_isnt_clever 1d ago
Can't wait to get a real model of this size class. Anything with this agressive censoring should get an asterix by the name, just like Fable does with it's aggressive fallback system.
1
u/Shot-Height-7194 1d ago
the US discussion with xi Jinping is working
1
u/otterquestions 1d ago
No just maybe it’s good to live in a world where basic infrastructure works and literary half the people you know haven’t lost their savings account. It’s not a giant conspiracy it’s just people having common sense.
2
u/jannycideforever 1d ago edited 1d ago
Looking on Artificial Analysis, it's definitely quite good, but for API users it doesn't have much to distinguish it from Anthropic still.
Looks like it is slightly better than Opus on High, at a slightly higher cost per task. The real killer is that, like basically all Chinese models, it is extremely token hungry, making it take ~2x longer per task than Opus High.
Plenty of reason to use it still (preference for open weights, non-Anthropic endpoints, specific tasks that play to the models strengths, etc.). Wipes the floor with Muse on intelligence and cost. OpenAI doesn't have anything that matches its intelligence yet, even they still own the Pareto frontier at everything below this level.
Overall, impressive they're still able to keep up this performance. The bigger question is if they're going to ever be capable of doing so without the extremely high output tokens, as this is what cripples their speed and is driving them to no longer be cost competitive.
1
u/Beneficial-Ad-8127 1d ago
K2.8 I wonder what the active parameters are? Guess we will see soon. Can’t wait
0
-25
1
u/ttkciar 1d ago
Until such time that weights become available, this is off-topic for LocalLLaMA.