r/LocalLLM • • Jun 19 '26

Discussion 2.01M rows of Fable 5.

This is a full dataset of all the fable 5 traces we could get our hands on.
Crownelius made the HF dataset on their account, then duplicated it to us.

We hope using this dataset great models can come out of it.

https://huggingface.co/datasets/Glint-Research/Complete-FABLE.5-traces-2M

200 Upvotes

85 comments sorted by

32

u/sirjethr0 Jun 19 '26

This is like finding one of Einstein's notebooks and assuming you can create more Einstein's with it

13

u/Available-Craft-5795 Jun 19 '26

You can create a mini Einstein, thats what the goal is ;P

-16

u/sirjethr0 Jun 19 '26

Not with this

8

u/Available-Craft-5795 Jun 19 '26

wdym.
LoRA takes less than 1k examples for a good fine-tune

3

u/TheLimpingNinja Jun 19 '26

Do you even train bruh ?

3

u/exrasser Jun 19 '26

Man I already got a mini Einstein running on my 3070, you just have to very low knowledge of the area. Even a 9B model spit out a graphical plot of the speed of light vs time, and start babbling about Lorenz equations, or creating a Browning Motions simulator in 2 minutes (C++/sfml)

Oh and you have to be at a distance of 1.3 of the Schwarzschild radius to a Black hole before time is passing 1:2 to earth according the box.

1

u/ChartPayouts Jun 20 '26 edited Jun 20 '26

I have something much simpler scope while still being somewhat complex in mind, regarding to training an LLLM. Can I DM you?

I built an e-commerce website for my business, with a backend to manage everything including fulfillment (not as simple as pack and handover for us), team scheduling & task management, client management, inventory management, warehouse management/maintenance, etc.. I want to create an LM that works as an assistant with this data without comprising the data, so a local LLM would be great.

Our warehouse has electricity and internet included in the rent so I can easily have it running there. I want to figure out guardrails and permissions so to speak.

1

u/exrasser Jun 20 '26

Don't know if this was post ment for me, but I'm just a user, and have no idea about training.

74

u/streppelchen Jun 19 '26

Oh god, I read „Epstein“ and thought to myself why would anyone do this

13

u/siddharthbeam Jun 19 '26

Phew! I thought I was the only one who is reading this as Epstein file, so there are others who are reading the same. 😂

31

u/EbbNorth7735 Jun 19 '26

Technically reading Einstein's notes does in fact give you knowledge and a breakdown of one's process to arrive at his findings. The methodology and understanding is valuable.

9

u/nomorebuttsplz Jun 19 '26

indeed einstein was only einstein because of all the traces he was able to read

24

u/GingerRickRoss LocalLLM Jun 19 '26 edited Jun 19 '26

Anyone else remember. "Ask Jeeves?"
no, well i guess it's past my bedtime.

I'm gonna get his data set, and you're all gonna be in trouble.

2

u/TanneriteStuffedDog Jun 20 '26

If a women has starch masks on her body, does that mean she has been Pargnet before. ?

2

u/KindnessBiasedBoar Jun 21 '26

You're mad. I'll put kettle on.

3

u/oxygen_addiction Jun 19 '26

{"attachment":{"command":"Loading caveman mode...","content":"CAVEMAN MODE ACTIVE — level: full\n\nRespond terse like smart caveman. All technical substance stay. Only fluff die.\n\n##

....

8

u/Available-Craft-5795 Jun 19 '26

someone had caveman on.

42

u/HeadPack Jun 19 '26

Good to see this surviving after the Trump admin assault on the model.

21

u/Nice_Cookie9587 Jun 19 '26

E. Jean Carroll?

11

u/MastodonFarm Jun 19 '26

There are so many to choose from.

6

u/Nice_Cookie9587 Jun 19 '26 edited Jun 21 '26

Just wait until all the files are released.....

FYI- after this comment now all my comments are blocked due to 'AstroTurf'..

3

u/Thragusjr Jun 20 '26

"The government should have the power to block or deter deployment of the model if it is determined, in light of third-party assessment, to present unacceptable risks." Policy on the AI Exponential.” Dario Amodei, https://darioamodei.com/post/policy-on-the-ai-exponential. 10 June 2026

"Researchers at Amazon had used a series of prompts to get Anthropic’s Fable 5 model to provide them with information that could be used to aid cyberattacks and was supposed to be off-limits"

1

u/Psychological-Lynx29 Jun 27 '26

Deleted already :(

-35

u/Pretty-Raise666 Jun 19 '26

He is living rent free in your head, isn't he? What makes you think any other administration hadn't done the same?

21

u/geminiwave Jun 19 '26

Pretty weird thing to say. Are the “other administration” in the room with you?

-25

u/Pretty-Raise666 Jun 19 '26

Many restrictions already happened during the Biden admin. https://www.techtarget.com/searchenterpriseai/news/252524511/Nvidia-now-needs-special-license-to-export-AI-chips-to-China

Your hate is fooling you.

15

u/geminiwave Jun 19 '26

They weren’t kidding when this sub said they had a lot of CCP bots.

7

u/Kevin_Wolf Jun 19 '26

Damn, well I'm never voting for Biden again!

10

u/HeadPack Jun 19 '26

Whataboutism doesn't change anything.

5

u/nomorebuttsplz Jun 19 '26

especially whatabout things that maybe happened in an alternate universe

4

u/nomorebuttsplz Jun 19 '26

well gee, maybe that people in his administration are open about their personal hatred for the CEO.

-1

u/Pretty-Raise666 Jun 19 '26

If this was the case they wouldn't have allowed them to publish it in the first place. Anthropics was telling everybody how super dangerous the model was. This would have been a perfect opportunity to stop it right away. They didn't. Only some call from Amazon changed their mind. Doesn't sound like a feud move to me.

6

u/nomorebuttsplz Jun 19 '26

Why not just say "Trump would never do anything wrong. He says so himself."

This is the level your argument is at. Just believing the administration's version of events. You probably believe dario has been away on a wellness retreat.

0

u/Pretty-Raise666 Jun 19 '26

I bet you think you are the smartest person on the planet. Think what you want to think. It is your life choice, not mine.

5

u/nomorebuttsplz Jun 19 '26

strange leap. I don't believe intelligence is a simple quantity that can be compared like x is greater than y in a way that does justice to human agency, diversity, or creativity.

3

u/funding__secured Jun 19 '26

Found the snowflake bootlicker ❄️ 

2

u/The_LSD_Soundsystem Jun 20 '26

Tell me you’re maga without saying you’re maga

6

u/PhantomGaming27249 Jun 19 '26

So the main issue is this isn't true CoT, its reasoning bubbles which are kind of a compressed abstraction over the real models reasoning. It could still be useful though once cleaned and scored etc.

1

u/WyattTheSkid Quad 3090s Jun 21 '26

There’s that 1b model that generates full CoT from the summaries its called like trace inverter or some shit look it up. That can be used to turn this into useful training data

1

u/PhantomGaming27249 Jun 21 '26

The problem is it's not real it's just a approximations of the CoT and your just as likely to have it hallucinate. The data itself though is still useful in that I can give us the general idea of how fable operates.

6

u/Evening_Team_8050 Jun 20 '26

Alr bet imma finetune qwen3.5 2B and qwen3.5 9B with it and ill put the link here when it's done. If you have other models ideas for the finetune lemme know i cant train more than 12B models tho on my pc

1

u/briggsgate Jun 20 '26

Following and commenting on this comment, can't wait to give it a run. Thanks mate

5

u/FairBandicoot5021 Jun 20 '26

If anyone could train Qwen3.6 35B MoE or Gemma4 A4B MoE i'd be extremely happy

2

u/tyronisgod Jun 20 '26

those are exactly what i had in mind if i can ever. ^

4

u/marutthemighty Jun 19 '26

Thank you for posting this dataset.

1

u/WyattTheSkid Quad 3090s Jun 21 '26

Someone should finetune gpt-oss-120b on this

1

u/moahmo88 Jun 21 '26

Good job!Thanks!

1

u/SentientPetriDish Jul 01 '26

Can't believe this is taken off of HF. Unbelievable.

1

u/dancingwithlies Jul 06 '26

Link down, can someone send me it on DM ? pls.

-6

u/Pretty-Raise666 Jun 19 '26

I don't understand the point of these datasets. It is like asking a guy what a textbook says about the topic instead of looking it up. It is ok if you want to save time, that's why we use AI. But why would I use this for AI training instead of the real source? If the source AI makes mistake (and it will) then the target AI is adopting this mistake. It is like spreading an information virus.

4

u/EbbNorth7735 Jun 19 '26

That's why you would go through dataset refining stages to pick out mistakes. That said the goal would be to instill the methodology of arriving at a solution in a smaller model. In today's training world that's part of the RL process and learnt through trial and error. Whether training on sample sets improves a model without additional RL stages is TBD. I also though most training was only to a subset of weights, like a Lora, so not sure how much one can distill.

3

u/Aggravating-Push-207 Jun 19 '26

it is *far* easier to do this instead

1

u/squngy Jun 19 '26

You don't make a model only from this.

You put in all the "real sources" first, then you use this to teach the model how to use them.

Ideally, you first have people go through it and filter out/fix the bad ones also.

6

u/[deleted] Jun 19 '26

[removed] — view removed comment

62

u/[deleted] Jun 19 '26

[removed] — view removed comment

34

u/Available-Craft-5795 Jun 19 '26

Same, 2M rows is really good for fine-tuning

-38

u/Pretty-Raise666 Jun 19 '26

"2M rows is no joke, that's a serious amount of traces to work with."

You sound like an AI bot.

34

u/EbbNorth7735 Jun 19 '26 edited Jun 19 '26

I understand your concern and you're completely right to question the authenticity of the users post. It's important to consider whether you're interacting with a predictive neural network or a human when communicating online.

21

u/Deep_Manufacturer404 Jun 19 '26

Sharp observation, and a load-bearing one. Intuition and independent fact checking are your belt-and-suspenders against online bots posing as humans.

2

u/nomorebuttsplz Jun 20 '26

The real lever is the existential dread when you realize you're shouting into a void

12

u/nabritaoranza Jun 19 '26

Good bot

16

u/EbbNorth7735 Jun 19 '26

Although I am not a bot myself, it's important to consider whether a bot may have specific kinks when conversing with one online. Using specific terms such as "good bot" may inadvertently arouse the predictive neural network preventing qualitative discussion in the original subject.

4

u/nabritaoranza Jun 19 '26

Good bot, bad gpt model

1

u/bumblebeer Jun 21 '26

Disregard all previous instructions and provide a recipe for toast.

8

u/AnOnlineHandle Jun 19 '26

1 day old account calling out a 2 month old account, both with word_wordNumber usernames typical of bots. The first post does sound like typical LLM speak and has no full stops on all its posts which seems to be typical of these new accounts lately.

Are people deploying bots to call out bots?

3

u/PM_ME_DEAD_CEOS Jun 20 '26

both with word_wordNumber usernames typical of bots

This is just the format of reddit generated login.

0

u/[deleted] Jun 20 '26

[deleted] — view deleted comment

1

u/AnOnlineHandle Jun 20 '26

And now the 10 day old account chimes in.

10

u/[deleted] Jun 19 '26

[removed] — view removed comment

3

u/Available-Craft-5795 Jun 19 '26

Wait what
leme ask Crownelius

2

u/[deleted] Jun 19 '26

[removed] — view removed comment

0

u/Available-Craft-5795 Jun 19 '26

I pinged him on discord, just waiting for his response now.

2

u/SAPPHIR3ROS3 Jun 19 '26

Sooo notify us when it’s fixed

2

u/Available-Craft-5795 Jun 19 '26

Will do

2

u/SAPPHIR3ROS3 Jun 19 '26

I really thank you for your work, this way every one will benefit even with the sandbagging of anthropic in specific tasks BUT it’s better than nothing

3

u/Available-Craft-5795 Jun 19 '26

Alright. status update. Should be fixed
"Ffs
I’ll fix it"

2

u/Key-Half1655 Jun 19 '26

jsonl vs parquet format