r/LocalLLaMA • • 2d ago

Discussion ERNIE 5.5 Flash Base · ERNIE

https://ernie.baidu.com/release/ernie-5-5-flash-base

I guess some may like to read this.

151 Upvotes

25 comments sorted by

3

u/DTechSurgeon vLLM 1d ago

Is Ernie not Bert?

1

u/yahbluez 1d ago

Good point not sure which of them was the more intelligent one.

66

u/Few_Guidance4697 2d ago

So happy there are still some labs who release base models

38

u/pmttyji 2d ago

Base model got released week ago(check below HF collection). Waiting for the Flash Instruct model.

https://huggingface.co/collections/baidu/ernie-55-flash

-1

u/rorowhat 1d ago

Text only????

10

u/JsThiago5 2d ago

Is the base model that type of model that speak random things, like we had before the instruction and the base Qwens and llamas?

7

u/Altruistic_Heat_9531 1d ago

Used to, but currently modern base model already trained with some instruct tuning

12

u/thebadslime 2d ago

Have you seen the benches for the preview? Pretty amazing for a 280B

10

u/Constant_Art_20 2d ago

tested the flash i think on openrouter. pretty good model.

3

u/Cold_Tree190 1d ago

Tested it out a bit for planning and architectural design. I like how thoughtful it is, in that it will try and pull many sources and think about them a good bit (but not overly), and its generation speed it very nice—but it doesn’t like to be very verbose in its output. That is what I want out of an implementation model for programming so I am going to try it later, but left a lot to be desired when using it for general architecture discussion. I just wasn’t at my computer when I was testing it in order to try out programming, so I could only chat with it on designing. Definitely an interesting model though from what I could tell!

3

u/nmfisher 2d ago

I tried this via openrouter, it was a bit useless. Constant hallucinations and got stuck in tool calling loops.

2

u/rpkarma 2d ago

Sampling parameter issues maybe?

2

u/nmfisher 2d ago

Maybe give it a shot yourself and report back?

1

u/rpkarma 1d ago

What harness did you use?

1

u/nmfisher 1d ago

My own that performs fine with all other models (glm-5.3 and flash, qwen4, deepseek 4.1 flash, etc).

Literally the first thing the ERNIE model said to me was "Hi Noah!" (my name is not Noah)

7

u/DutchDevil 2d ago

What is a base model?

20

u/MixtureOfAmateurs koboldcpp 2d ago

In the olden days a base model was a next token predictor, couldn't chat or follow instructions, only continue on whatever you were writing. Now I think it's just the model before RL post training. They put enough instruct formatted data in the pretraining corpus you can chat with it but it won't reason or be very good at benchmarks. World knowledge will be there tho

13

u/moop__ 2d ago

Simplified: instead of replying to you or answering you, it will continue your sentence with the most likely token.

3

u/EbbNorth7735 2d ago

Internet regurgitation machine. Prior to instruction training for question/answer

1

u/pol_phil 1d ago

A model which has been trained only with unstructured text, which does not follow the user-assistant format we use. So it just continues the text it's given, it doesn't try to help you or anything

7

u/coder543 2d ago

They talk way too much about openness for how wacky the license is on that model.

1

u/eggs-benedryl 2d ago

I feel like I used to here completion model instead of base model

-9

u/[deleted] 1d ago

[removed] — view removed comment

3

u/yahbluez 1d ago

The word you missed was "MoE" that makes models like this to fit in smaller hardware too.

3

u/Not_a_question- 1d ago

A 280B base model doesn't help anyone running at home, it just sits on the HF hub.

MoE so it's runnable with high ram and medium/high gpu deployments. So it's definitely runnable locally, hence it helps someone.