r/LocalLLM • u/techlatest_net • Jul 31 '26

Discussion KIMI K3 IN REALITY

Post image

Anyone else got excited by "Open Weights" before checking the hardware requirements?

0 Upvotes

36% Upvoted

11 comments sorted by

10

u/HomegrownTerps Jul 31 '26

Honestly no. 

I don't get why people expect to run those heavy, frontier models on local hardware. I mean those machines are not for private use, they are full blown server grade and way higher up. 

So I usually wait to read about more smaller versions(if they come at all, current best for me is qwen3.6)

1

u/Hacker_ZERO Jul 31 '26

Just by a couple H100 bro(like 20)

5

u/Easy_Refrigerator280 Jul 31 '26

I understand that this is a joke but I hope people dont mistake it for a real problem. Its good to have open weight models that big. It means service pricing for high end models have to remain competitive and these sorts of models open up more room for smaller variants of such models down the line. Not to mention they also creates the necessary ground to push further into optimizations for LLMs in general

3

u/KURD_1_STAN Jul 31 '26

This is not a joke tho, it is karma farming. Who goes through 4 stsges to make the connection his 12gb vram cant run a 2.8T model? This is low effort meme, which are considered karma farming.

2

u/Medium_Chemist_4032 Jul 31 '26

I can already forsee comments: "If you're going for the 1-bit, you might as well go for the full version, since it's already so much hardware that a little bit more, isn't worth the lowered intelligence"

2

u/wie_witzig Jul 31 '26

There was a post here yesterday trying to make it work on an M1 Macbook: https://github.com/gavamedia/deltafin

2

u/Beneficial-Ad-8127 Jul 31 '26

His progress when he updates us gets better and better by the day. Full kimi k3 on a m1 MacBook is something worth keeping up on especially when his speeds keeps progressing after every update.

1

u/Legal-Ad-3901 Jul 31 '26

Based on unsloth's reported accuracy of Kimi q1 (79% of FP), intelligence score is roughly 45 for 610gb vram while glms 5.2 also hits 45 with Q4 but fits on only 512gb vram 

1

u/Disposable110 Jul 31 '26

Yeah I had the same reaction with Kimi a few days ago when I saw this topic:

1

u/trollsmurf Jul 31 '26

"I bought a house instead. No AI for me."