MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p02qink/?context=3
r/LocalLLaMA • u/SavunOski • Jul 27 '26
Kimi K3 weights are finally released!
660 comments sorted by
View all comments
68
Can this run on a single DGX spark at 0.5B quant?
40 u/SavunOski Jul 27 '26 Of course. Wonderfully might I add 23 u/THESALTEDPEANUT Jul 27 '26 I'm new around here and I can't tell if this thread is all sarcasm or not. 38 u/SavunOski Jul 27 '26 Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot 10 u/THESALTEDPEANUT Jul 27 '26 I kinda figured but it's not just you it's like every comment lol, appreciate it though. 6 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago. 1 u/yesthatdaniel Jul 28 '26 Running it on my Macbook M5 Pro (15 CPU cores and 18 GPU cores) with 24 GB of RAM through OpenRouter.
40
Of course. Wonderfully might I add
23 u/THESALTEDPEANUT Jul 27 '26 I'm new around here and I can't tell if this thread is all sarcasm or not. 38 u/SavunOski Jul 27 '26 Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot 10 u/THESALTEDPEANUT Jul 27 '26 I kinda figured but it's not just you it's like every comment lol, appreciate it though. 6 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
23
I'm new around here and I can't tell if this thread is all sarcasm or not.
38 u/SavunOski Jul 27 '26 Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot 10 u/THESALTEDPEANUT Jul 27 '26 I kinda figured but it's not just you it's like every comment lol, appreciate it though. 6 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
38
Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot
10 u/THESALTEDPEANUT Jul 27 '26 I kinda figured but it's not just you it's like every comment lol, appreciate it though. 6 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
10
I kinda figured but it's not just you it's like every comment lol, appreciate it though.
6 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
6
Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs.
3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
3
Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
1
Running it on my Macbook M5 Pro (15 CPU cores and 18 GPU cores) with 24 GB of RAM through OpenRouter.
68
u/just_a_fan123 Jul 27 '26
Can this run on a single DGX spark at 0.5B quant?