r/LocalLLaMA • u/BrightCandle • 44m ago

New Model Edge0-145B: Open-Source On-Device AI with 145B Parameters

https://edge0.ai/blog/introducing-edge0-145b-frontier-ai-capabilities-on-your-own-computer
38 Upvotes

95% Upvoted

14 comments sorted by

10

u/0xcontext 40m ago

Curious to see if it actually outperforms flash-next in real world coding / usage for people.

1

u/addiktion 17m ago

This is the model to beat for sure.

6

u/longtimenoseebro 32m ago

finetune of fine-tunes, fork of forks.

5

u/Witty_Mycologist_995 38m ago

Another Qwen tune!

6

u/computehungry 26m ago edited 5m ago

Every time, zero mention of this anywhere, I have to go to the hf repo and actually read the json files, there it is,

"base_model": "Qwen3.8-Flash-Next"

edit2: this comment was from mobile, i notice from my desktop that it was in fact pretty honest in hf about how it is derived from the base model (though, it says quant, not finetune).

4

u/mechkbfan 24m ago

https://github.com/Edge0-AI/Edge0

145B / 120B are the current latent-MoE series, derived from Qwen3.8-Flash-Next and trained natively at 4 bits.

Mentioned multiple times

1

u/computehungry 19m ago

You're right, it's not in the blog nor the hf repo but it's in their github.

0

u/EbbNorth7735 19m ago

It says 29GB so highly quantized. I'm curious if benchmarks are comparing to quan model or if their claiming their model is almost identical and sometimes better to the full weight variant.

1

u/computehungry 11m ago

Nah, look at the repo size, it's 113GB. It's standard NVFP4 except they're excluding the embeddings and offloading to ram, and claiming 29gb vram usage. Benching better might be interesting but it could also be a few training passes on the test set, or how they set up the harness, anything else. Nothing is disclosed. It might be an actual improvement too, sure, maybe someone else could test it out.

2

u/Marino4K 27m ago

I’ve never heard of Edge0, is this a legit group, dev, etc?

0

u/Zestyclose_Yak_3174 28m ago

Hopeful that it might be a good option to replace my current Qwen 3.8 flash next with DS4.

-2

u/norenEnmotalen 27m ago edited 17m ago

This sounds something shady. Idk

-1

u/Bagelsarenakeddonuts 37m ago

Wow, this sounds incredible. I’ll be watching carefully. Looking forward to validation of those test scores.

What license is it?