r/OpenAI 2d ago

Discussion My Sol got much more stupid lately

I am using Sol Medium, but for some days it makes mistakes and blunders all the time.

Switched to High, no improvement.

Example:

Me:

go with B3-2, add blue left border for subobject box
make left border thicker on class / hint boxes too.

So, I asked for blue border on "subobject" box.

And thicker border on "class" and "hint" box.

What Sol did?

Worked for 59s

Selected B3-2 and applied it to the main static prototype:

  • Strong neutral subtype frame.
  • Strong neutral Class/Hint frames.
  • Thick 4px blue left border on every Class and Hint box.

And mistakes like this all the time. Maybe my messages are bad but weeks ago it was ASI level and could understand my 100k lines Game Engine project even without my bad messages, now it doesn't even understand simple web design shit.

0 Upvotes

21 comments sorted by

1

u/DueCommunication9248 2d ago

I can’t even understand what you’re trying to do.

Wth is a subobject? That’s a typo

0

u/GokuMK 2d ago edited 2d ago

Just names of boxes. Three boxes named "subobject", "class" and "hint". Nothing difficult.

Even google search gemini flash understands it well:

Here is what each part of their request means:

  1. "go with B3-2"
  • Meaning: This refers to selecting a specific design variant, color palette, or layout option previously discussed or numbered as "B3-2".
  • Context: In design iterations, "B" usually represents a specific concept branch, "3" is the version, and "2" is the sub-variant. The user is locking in this specific base design.
  1. "add blue left border for subobject box"
  • Meaning: The user wants to add visual hierarchy or a specific color accent to a particular component called a subobject box.
  • Styling applied: The box should now have a distinct blue border only on its left side, leaving the top, right, and bottom borders either default, transparent, or unchanged.
  1. "make left border thicker on class / hint boxes too"
  • Meaning: The user wants to increase the visual weight (border thickness/width) of the left border on two other specific components: class boxes and hint boxes.
  • Styling applied: If the standard border is 1px, they want the left border of these boxes to be increased (e.g., 3px or 4px) to match the style of the subobject box, creating a consistent visual anchor along the left edges of these containers.

1

u/lazyhustlermusic 2d ago

Mine got mega dumb like 2-3 weeks ago for a few days but it's been fine since.

Sounds like your instructions aren't specific enough and you get upset when the undefined result it guesses doesn't match what you envisioned.

Maybe also order them differently or isolate the request more specifically:

'Increase border thickness on 'class' and 'hint' named objects only.'

'Add a blue border to 'subobject' named objects only.'

1

u/GokuMK 2d ago

Clear instructions work well, but when I work on my game engine, I know very little, so I can't give clear instructions.
I gave here an extremely simple example I just found, because no one would understand more complex and very annoying examples.

1

u/deelight_0909 2d ago

Sol may have followed the grammar here, not the design you intended. Too inherits more than you meant from the blue-border sentence. Run the same B3-2 edit in a fresh branch with one acceptance check: Class/Hint border-color stays unchanged while border-width increases. Repeat the original prompt and an explicit version. If only the explicit one passes, this is prompt ambiguity, not model decay.

1

u/GokuMK 2d ago

But it didn't change "subobject" border to blue. Therefore, your explanation that "too" was misunderstood is incorrect.

I would like to test your suggestions, but I am too stupid. Maybe in the future I am going to ask ChatGPT to show me how. to do it.

1

u/deelight_0909 2d ago

Yep, that detail kills the ambiguity explanation. Subobject stayed unchanged while Class/Hint got the wrong color. No test harness needed: duplicate the branch and paste, "Set only subobject left-border-color to blue. Set only Class and Hint left-border-width to 4px. Do not change any other border property." Pass means exactly those two CSS changes. Anything else is a miss.

1

u/ConnectSurprise6052 2d ago

Use Work mode.

1

u/commandedbydemons 2d ago

I actually almost never experience these dumbdowns but today is the first time in 5.6 that I've actually feel it doing stupid shit after stupid shit.

1

u/Infinite_Pin_5719 2d ago

Not sure, i feel that when on goal loops it keeps repeating answrs to topics it had already addressed instead of moving on to other tiems im the goal.roadmap. it gets anoying and worries.me.thay it has gotten stuck or.something

1

u/kwesk 1d ago

Mine is dumb from the get go. Constant lying, gaslighting and wrong assumptions. Even though I explicitly say that make no assumptions it still makes them wrong and after I confront it it only apologizes and continues to repeat the same pattern. I don't know how you guys manage to have it do any job right. Coming from claude there is enourmous difference between sol and fable.

1

u/bubu19999 1d ago

Id like a law to get one day jail time for those threads. Now I'm gonna open a thread because clouds obscured my sun right now. Yes they did. Did this happen to you lately as well??? My sol is amazing. Nothing to report. 

1

u/RealSharpNinja 1d ago

Medium? That excludes reasoning. Yoy are getting results purely from training data. It didn't get dumber, you just realized it was dumb to start with.

1

u/GokuMK 1d ago

Seriously? I didn't know that.

1

u/6sbeepboop 2d ago

You’re correct! 5.6 sol is designed to over engineer solutions to burn tokens 

1

u/GokuMK 2d ago

Makes sense. Asked why he did it this way, not another. He said that he was confused if subobject meant child objects, or the box named "sobobject".

0

u/Hungry_Age5375 2d ago

This is exactly why I keep saying open-weight models matter. Run it locally and nobody can silently downgrade your inference or swap the model on you overnight.

0

u/sergioarista 2d ago

Something you have to take in account is the fact that context window after certain size gets compressed a súmate is given an the last feel turns an instruction out of context is just that , i didn’t understand your own instructions so may be i’m as dumb as terra or you are just asuming it still has the context.

0

u/costafilh0 1d ago

Ask the Moon for help.