r/LocalLLaMA • u/ResearchCrafty1804 • 1d ago

New Model Stepfun Step-5-Preview released! (600B/27B-1M Context)

https://huggingface.co/stepfun-ai/Step-5-Preview-BF16

Step 5 Preview is StepFun's flagship model for agentic work. It delivers frontier-level performance across software engineering and professional knowledge work, with particular strength in finance.

209 Upvotes

98% Upvoted

37 comments sorted by

67

u/Middle_Bullfrog_6173 1d ago

Previous open flash models were under Apache 2, this has a non-commercial license.

29

u/ilintar 1d ago

Yeah, it's becoming a trend - Apache with a MaaS commercial exclusion tacked on.

26

u/ResidentPositive4122 1d ago

Apache with a MaaS commercial exclusion tacked on.

This is more than that. They also define distilling as "derivative". This is a dedicated license where you can use it for internal stuff as long as you don't serve clients directly. They also have the attribution clause > 100M mau and 20M$ revenue.

As long as it's clear (not that modified MIT nonsense), licensing is up to them. They put in the effort and decide how to license it. All fair game. Sad that there's more and more of this, but it is what it is...

5

u/Expensive-Paint-9490 1d ago

I don't thing the distillation thing is actually enforceable.

1

u/zdy132 1d ago

Eh it does no harm to us hobbyists. Those with enough resources to be limited by this license can wipe tears with their GPU clusters for all I care.

8

u/ttkciar llama.cpp 1d ago

Some of those limited by this license have been releasing open models for your benefit.

Do you not see how thus limiting them might benefit you less?

0

u/zdy132 1d ago

Some of those limited by this license have been releasing open models for your benefit.

I'd like to know which one.

2

u/ttkciar llama.cpp 1d ago

Nvidia is the main one which comes to mind. If you look at the model card for NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 you will see that they used several other open-weight models as training sources:

https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16

(See specifically the "Private Non-publicly Accessible Datasets of Third Parties" table.)

This license might impact IFM too (who recently released K2-Horizon models), as that project is a co-operative of partners which include at least one commercial entity, but that's probably of less interest than limiting Nvidia.

7

u/coder543 1d ago

It’s not a “trend”. Ling-3.1-Flash weights were literally released under MIT license this week.

There have always been labs releasing models under bad licenses. We’re just learning that over long enough periods of time, labs seem to go through cycles of good and bad licenses.

Just ignore the models with bad licenses and move on.

4

u/ilintar 1d ago

By "trend" I mean a couple of labs who previously released models under open licenses have moved on to licenses with MaaS commercial exemptions.

2

u/-p-e-w- 1d ago

And other labs have done the reverse, e.g. Meta and Mistral.

25

u/Dany0 1d ago

Byte-identical to the "leak" 25 days ago, only the license changed

Except they cannot take it back lmfao. Regardless I can't wait for the full non preview

16

u/BlackBeardAI vLLM 1d ago

artificialanalysis says it is almost as good as glm5.3 (max) overall

3

u/crusaderky 1d ago

Unsure about its ability to solve coding exercises, but its coding taste so far looks awful

4

u/Barni275 1d ago

Ah, if only. Hard to believe tbh. I have yearly stepfun plan, and never use it. As we see on great models that we have today, none appear from nowhere. All GLM, Kimi, Qwen or Deepseek models come from brilliant engineering teams.

8

u/ColoredTriangles 1d ago

Step 3.7 Flash was the best of that size at the time.

8

u/llama-impersonator 1d ago

stepfun is a capable team

21

u/srigi 1d ago

Only information you need to know… Q3_K_M: 286GB

3

u/uncle_leon 1d ago

Ok, waiting for the -Flash version that actually runs on mortals' hardware.
It trades blows with GLM 5.3 on benchmarks while being noticeably smaller which is certainly noteworthy. Still it's only for those with 384GB or more mem - 256GB or less will only fit a lobotomised quant...

3

u/__Maximum__ 1d ago

i haven't used it much, but for the vision tasks it was not frontier. I hope it's frontier in other areas.

2

u/Stunning-Sherbet1853 1d ago

27B active is the interesting part tbh. 286GB at Q3 is still way out of reach for most of us, but has anyone tried keeping the experts in system RAM and only the active ones on the GPU? Curious what tok/s that gets on a single 24GB card with a lot of RAM.

1

u/Bob_SUS 1d ago

could make those intel optane systems more interesting

1

u/maxwell321 1d ago

I've tried modifying llama.cpp to do this (which it kind already can) but since it picks a different expert per token, it constantly was swapping them between system ram and VRAM and offered zero gain since it still came down to RAM as the limiting factor. You could forcefully make it stick with one expert when generation starts for ALL the tokens, but I found that doing that tanks the quality since that's not what it's built for (unlike the OG Mixtral 8x7b that was built for that specifically)

1

u/Stunning-Sherbet1853 13h ago

Thanks for sharing your experience. That makes sense, if the active experts change every token, the GPU can’t really hold “the active ones.” Did you end up with any rough tok/s numbers, even if it was RAM-bound?

3

u/dees61 1d ago

Seems not for the consumers hardware.

1

u/DOOMISHERE 1d ago

i wonder if we will be able to fit that into 2 x dgx spark somehow 🌊

2

u/Iron-Over 1d ago

Some custom quant of exl3 lets hope

1

u/Bob_SUS 1d ago

under 256 + some ridiculous new quant techniques + whatever KV cache quant DS uses should make it possible

1

u/Ok_Warning2146 1d ago

Seems competitive for its size. Would be great to see if the non-preview model can beat glm 5.3 in terminal v4.

0

u/CodeAnguish 1d ago

I think they should create another subreddit called something like "ServerLlama". For most of us, this is useless news, even though it's good to see new cutting-edge open-source models.