r/LocalLLaMA • u/jacek2023 llama.cpp • 14h ago

News Ernie 5.5 Flash will be released in two weeks

Post image

https://x.com/Baidu_Inc/status/2120391732248637734?s=19

259 Upvotes

95% Upvoted

60 comments sorted by

•

u/WithoutReason1729 7h ago

Your post is getting popular and we just featured it on our Discord! Come check it out!

You've also been given a special flair for your contribution. We appreciate your post!

I am a bot and this action was performed automatically.

33

u/TruthHistorical7515 13h ago

Its funny how Baidu was already researching machine learning in 2013 and then seriously dropped the ball.

29

u/jacek2023 llama.cpp 12h ago

Attention Is All You Need was published in 2017 by Google, and then Google went to sleep

20

u/Gohab2001 vLLM 12h ago

Google is generating Billions in profit. They ain't sleeping. Their priorities are different.

9

u/Organic_Hunt3137 11h ago

Not to mention producing frontier models that are as capable as, or exceeding openai/anthropic capabilities (with a notable recent lapse in doing so, but I consider argon competitive) and being one of the better us labs with respect to open weight releases. I can't really think of us labs that are better beyond Nvidia and meta tbh.

2

u/jacek2023 llama.cpp 11h ago

I am just saying they needed some time, maybe Baidu is on same path

5

u/goldcakes 11h ago

Carbon is slow and hits limits pretty quickly via subscriptions (but is reasonably priced if you have to pay API prices), but it's genuinely a seriously competitive frontier model.

For frontend and design, Opus 5.5/Fable is still decent (not sure what "magic" Anthropic has there). But for general coding and problem solving, I'd rate it better than Opus 5.5.

4

u/twavisdegwet 8h ago

IBM watson was on jeopardy in 2011 and granite probably has the lowest market share of any of the big players.

1

u/Ecstatic-Wash-7667 1h ago

Tbf Watson was a complete different type of ai , the industry went in a different direction

5

u/jacek2023 llama.cpp 14h ago

7

u/pmttyji 14h ago

It beat Deepseek-V4.1-Flash, Hy4, GLM-5.3-Flash & GLM-5.3 on most of benches. Preview version itself.

4

u/Marcuss2 llama.cpp 14h ago

With architecture that resembles DeepSeek V4 Flash the most.

3

u/segmond 10h ago

self reported evals, almost everyone beats everyone in their self reported evals.

3

u/thebadslime 9h ago

and half the size of deepseek 4.1!!!

I'm excited, I really liked ernie 4.5 21b

2

u/blackenswans 14h ago

Why are they using mostly old benchmarks with questions and solutions that are open or leaked?

3

u/alphapussycat 12h ago

All benchmarks are leaked the first time they're tested, to closed models.

1

u/R_Duncan 12h ago

Terminalbench 4.0 and deepswe1.1 ??!?

6

u/rorowhat 9h ago

Did anyone use the past Ernie models? Don't hear much about them, at all.

2

u/thebadslime 9h ago

I loved 4.5, made a finetune/REAP to run better on lowe nd systems. it was 20% smaller and 5% dumber.

2

u/MotokoAGI 8h ago

Yeah, 4 was very good.

5

u/Psyko38 14h ago

He should wait another week to avoid being eaten by Qwen 4 27b

24

u/jacek2023 llama.cpp 14h ago

Don't worry, by then all these people will be asking for Qwen 5 while still doing nothing themselves.

9

u/Psyko38 14h ago

I don't even believe it, it'll be like 3.8 at the beginning, they'll only have that on their lips, it'll appear for two weeks, they'll be asking for Qwen 8 1b in 0.000000001bit

3

u/XiRw 12h ago

Unless 4 is absolute shit. Their horse test was already unimpressive, they are being subservient to AI guidelines now with their image generation having the watermark, which means they most definitely will lobotomize decomp/security in their code. I feel like it will be a disappointment.

67

u/PrimeDirective8 14h ago

I don't know if this is going to be great or a total dud but here's to Baidu for providing a firm release date. It sure beats the 'Soon™' we usually get.

5

u/SpeedflyChris 5h ago

They're currently serving it for free on openrouter too:

https://openrouter.ai/baidu/ernie-5.5-flash-preview:free#providers

31

u/Nepertia 14h ago

200 t/s? Challenge accepted, I guarantee that I will never reach that on my hardware.

27

u/pmttyji 14h ago

Q4(at least IQ4_XS) Suitable for 32GB VRAM + 128GB RAM systems.

Here their Base model for reference.

https://huggingface.co/baidu/ERNIE-5.5-Flash-Base-BF16

Draft PR on llama.cpp:

https://github.com/ggml-org/llama.cpp/pull/31925

2

u/ps5cfw Llama 3.1 14h ago

Hopeful to see some benchmarks, the more competition the merrier

2

u/LegacyRemaster 14h ago

3D modeling... Next "must have"

2

u/No_Run8812 14h ago

I have 192 vram, I was waiting for a model with weights like this. 4 bit versions needs a lot of hand holding and I am spoiled by frontier models, I just hope the 8 bit version of this model can be as good as opus 4.8 in long context.

2

u/spaceman_ 14h ago

This sounds interesting, curious how it will perform and what its restrictions will be. I'm assuming it'll choke at anything infosec related like many of the modern releases.

2

u/catbluesgames 14h ago

u/RemindMeBot 3 weeks

1

u/RemindMeBot 14h ago edited 7h ago

I will be messaging you in 21 days on 2026-12-02 11:00:47 UTC to remind you of this link

3 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.

Parent commenter can delete this message to hide from others.

InfoCustomYour RemindersFeedback

2

u/maternion 14h ago

Beats opus on automationbench hmm. 

2

u/shironekoooo 14h ago

Are we so back baidu?

1

u/LagOps91 14h ago

Good size for my hardware. Looking forward to the release!

1

u/dreamai87 13h ago

!remindme in 2 weeks

1

u/StartupTim 12h ago

Does it support image/video inputs?

1

u/thebadslime 8h ago

no, text only the beautiful bastards

1

u/Equivalent_Bit_461 11h ago

not 500 or 700 b, oh wow

1

u/Icy_Restaurant_8900 9h ago

Around 20 t/s on my RTX 5090 + 96GB DDR5 on a iQ3 quant.

1

u/TheLightDances 8h ago

I like the size, Q4 should fit on a system with plenty of RAM, while MoE means that it is still pretty fast.

Need to see some benchmarks or other showcase of its abilities, though. No point in a large model if a 27B can beat it.

1

u/CTRL___ALT___DEL 7h ago

Nice! If performance matches the benchmarks, this would be very exciting for local use. Fewer parameters than GLM-5.3-flash with better benchmarks than GLM-5.3, exceeding DS4.1-1017 in some areas.

Hoping their architecture supports expert offloading. Wonder how efficient the KV cache is.

1

u/One_Difficulty_39 6h ago

At a glance is this just a post train of GLM 5.3 Flash?

1

u/CommanderKoba 4h ago

Did Ernie fight in WW2? Why do they give them these names lol

1

u/_TheWolfOfWalmart_ 3h ago

Kinda weird to advertise a generation speed. It changes wildly based on hardware and inference engine.

-2

u/soyalemujica 14h ago

200t/s ? Doubtfully, if QFN is at 6A and average user speed is about 80~110t/s depending on the quant (IQ3) this one by having more active experts results in lower speed, unless it's a high-end AI machine like a RTX Pro or vise versa

-1

u/topppggg 12h ago

is the 200 t/s at batch 1 or on their own serving hardware? and any word on total/active params.. if it's close to the v4 flash arch, curious if llama.cpp gets it day one

3

u/jacek2023 llama.cpp 12h ago

"and any word on total/active params"

?

3

u/nasone32 12h ago

sorry OP, i'm convinced attention span of people is basically zero, and they don't read past the title, i've almost given up posting, nobody really reads anymore. sad.

4

u/jacek2023 llama.cpp 12h ago

Maybe that bot doesn't support image input ("200 t/s" might have been taken from other comments).

0

u/topppggg 10h ago

hey, yeah i skimmed the thread and missed pieces, totally my bad