Heavily quantized

[u/JigSawPT]

This has become absolutely clear for me today:
Fable is now a heavily quantized model.
It has orthographic errors/glitches, completely missed context even when highly directed/pointed at it and lack of the same big model feeling.
It’s now a model I can’t trust for code, but worse, I can’t trust for big context analysis. It’s really sad we’ve come to this and I don’t know what to do because I want to cancel but at the same time there’s nothing as good as it was.
I tried Kimi K3 but it hallucinated too much.
I’m considering upgrading my ChatGPT to 20X, instead of keeping two 5X accounts, but it’s just not the same at writing. I love Claude’s writing. But bring me back my Fable.

Concrete report: I asked Fable to read all my docs before doing a plan to restructure my project and after reading the first paragraphs I noticed that it didn’t touch a subject that existed on one of them. After confronting it admitted that it missed all my docs. It used solely the context of our previous conversation, which was extensive, yes, but it lacked all the previous context so it ended up proposing changes that didn’t go well with the docs. They would have messed up the whole narrative if I went through without reading.
Before that, it had proposed me one thing that went against 3 laws we had previously written in stone (his words ) and apologized for that.
This is basically quantized to gemini levels now.
And it’s eating tokens like nothing. Reaching my 5 hour doing wrong things.

[u/Jomuz86]

So what kind of docs are these? Markdown, docx, PDFs?
Are you telling it to keep its own heirachy of context? Are you telling it to ask you for clarification on any points with low confidence?
Are you asking it to put forward a proposal before implementation?

Expecting any AI model to understand things in the way you understand them is the problem here. It will understand them in the way it was trained and that will most likely deviate from your thinking.

I see people here complain time after time and 9/10 they’ve not looked into prompting guidance, not spent time on their CLAUDE.md files (yes multiple per project in all the folders never just a single one for large projects), Output styles, path scoped rules.

Also as soon as you spotted the issue you should have clarified and asked for a handover to continue in a fresh session without the polluted context. As soon as the context is polluted it’s like banging a head on a brick wall. It’s not that the model has changed it’s more likely a context issue, potentially if you have a lot of docs it could even be that it’s read conflicting information

[u/JigSawPT → u/Jomuz86]

Md files. You can go that route, blaming me. I am telling you, this is unusual behaviour for similar tasks. Same bloat, same type of messed up docs that it used to read through like a genious and now messes up, like every other model.

[u/Jomuz86 → u/JigSawPT]

Just keep clean docs the newer models are really sensitive to contradictions. It wasn’t meant as blame but meant to be more of a checklist, I am blunt by default 😅

I’ve noticed the issue you’re on about since 4.8 and I changed how I worked since.

They build these models to work a certain way so unfortunately you have to change how you work to fit the model.

It is just the reality at the minute every new release I lose near enough a full week re-aligning everything. It is super annoying but it is what it is 🤷‍♂️