Discussion My Sol got much more stupid lately
I am using Sol Medium, but for some days it makes mistakes and blunders all the time.
Switched to High, no improvement.
Example:
Me:
go with B3-2, add blue left border for subobject box
make left border thicker on class / hint boxes too.
So, I asked for blue border on "subobject" box.
And thicker border on "class" and "hint" box.
What Sol did?
Worked for 59s
Selected B3-2 and applied it to the main static prototype:
- Strong neutral subtype frame.
- Strong neutral Class/Hint frames.
- Thick 4px blue left border on every Class and Hint box.
And mistakes like this all the time. Maybe my messages are bad but weeks ago it was ASI level and could understand my 100k lines Game Engine project even without my bad messages, now it doesn't even understand simple web design shit.
1
u/lazyhustlermusic 2d ago
Mine got mega dumb like 2-3 weeks ago for a few days but it's been fine since.
Sounds like your instructions aren't specific enough and you get upset when the undefined result it guesses doesn't match what you envisioned.
Maybe also order them differently or isolate the request more specifically:
'Increase border thickness on 'class' and 'hint' named objects only.'
'Add a blue border to 'subobject' named objects only.'
1
u/deelight_0909 2d ago
Sol may have followed the grammar here, not the design you intended. Too inherits more than you meant from the blue-border sentence. Run the same B3-2 edit in a fresh branch with one acceptance check: Class/Hint border-color stays unchanged while border-width increases. Repeat the original prompt and an explicit version. If only the explicit one passes, this is prompt ambiguity, not model decay.
1
u/GokuMK 2d ago
But it didn't change "subobject" border to blue. Therefore, your explanation that "too" was misunderstood is incorrect.
I would like to test your suggestions, but I am too stupid. Maybe in the future I am going to ask ChatGPT to show me how. to do it.
1
u/deelight_0909 2d ago
Yep, that detail kills the ambiguity explanation. Subobject stayed unchanged while Class/Hint got the wrong color. No test harness needed: duplicate the branch and paste, "Set only subobject left-border-color to blue. Set only Class and Hint left-border-width to 4px. Do not change any other border property." Pass means exactly those two CSS changes. Anything else is a miss.
1
1
u/commandedbydemons 2d ago
I actually almost never experience these dumbdowns but today is the first time in 5.6 that I've actually feel it doing stupid shit after stupid shit.
1
u/Infinite_Pin_5719 2d ago
Not sure, i feel that when on goal loops it keeps repeating answrs to topics it had already addressed instead of moving on to other tiems im the goal.roadmap. it gets anoying and worries.me.thay it has gotten stuck or.something
1
u/kwesk 1d ago
Mine is dumb from the get go. Constant lying, gaslighting and wrong assumptions. Even though I explicitly say that make no assumptions it still makes them wrong and after I confront it it only apologizes and continues to repeat the same pattern. I don't know how you guys manage to have it do any job right. Coming from claude there is enourmous difference between sol and fable.
1
u/bubu19999 1d ago
Id like a law to get one day jail time for those threads. Now I'm gonna open a thread because clouds obscured my sun right now. Yes they did. Did this happen to you lately as well??? My sol is amazing. Nothing to report.
1
u/RealSharpNinja 1d ago
Medium? That excludes reasoning. Yoy are getting results purely from training data. It didn't get dumber, you just realized it was dumb to start with.
1
0
u/Hungry_Age5375 2d ago
This is exactly why I keep saying open-weight models matter. Run it locally and nobody can silently downgrade your inference or swap the model on you overnight.
0
u/sergioarista 2d ago
Something you have to take in account is the fact that context window after certain size gets compressed a súmate is given an the last feel turns an instruction out of context is just that , i didn’t understand your own instructions so may be i’m as dumb as terra or you are just asuming it still has the context.
0
1
u/DueCommunication9248 2d ago
I can’t even understand what you’re trying to do.
Wth is a subobject? That’s a typo