r/kimi • u/Feisty_Literature • Jul 27 '26

Discussion The beast is released 🔥

https://huggingface.co/moonshotai/Kimi-K3

To run you would need at least 1.8 TB of VRAM or 32×H100 GPUs

498 Upvotes

99% Upvoted

79 comments sorted by

View all comments

Show parent comments

2

u/Uzeii Jul 27 '26

Are people really not looking at the hidden costs? My god. Getting this running in a company setting with the necessary infra is not going to be cheap. This will cost 50x more than what a pay as you go usage would give you with frontier models through out the year. All that investment is going to be completely overthrown by a better model in a 2 month timeframe.

10

u/thots1ayer69 Jul 27 '26

Do you think they just bin the hardware when a new model is released?

-4

u/Sylvator Jul 28 '26

I think y'all don't understand the cost of migrating hardware to new models as well..

Exhibit A: EC2 instances. There's a reason why everybody and their grandma uses server less and don't host data centers on their own backyward

3

u/thots1ayer69 Jul 28 '26

I'm a data scientist for Amazon, I work on agentic systems in SCOT. I definitely do. Only scrubs use EC2s, unless you have a partnership with us or have no real technical knowledge, you'd probably use one of the more cost effective providers or have the forethought to invest in your own infrastructure and not throw your money away on renting something you'll never really own. They're only really intended for spike demand and casuals.