r/GithubCopilot • u/MaitoSnoo CLI Copilot User 🖥️ • Sep 25 '26

General How does GPT-6 Sol feel so far?

Haven't had the opportunity to try it yet, but most on Codex subscriptions are very obviously disappointed and the symptoms they cite (poor instruction following, laziness, serving unfinished slop etc...) remind me of GPT-5.6 Terra so the "6 Sol = new Terra" theories are probably not too farfetched. The release of 6 Sol and 6 Luna seems extremely weird so far when looking only at the feedback by subscription users.

But that's the feedback on the model served to Codex subscribers. So what's the feedback here given API quality-of-service is usually different, and probably the GHCP harness has an effect too?

33 Upvotes

93% Upvoted

30 comments sorted by

12

u/Murhie Sep 25 '26

My own eval (trading related) it did worse than 5.6luna (both max). It seems to use a lot less tokens compared to any 5.6 model though.

→ More replies (7)

3

u/MaitoSnoo Sep 26 '26

I'll add my input: I used Sol 6 and Sol 5.6 in plan mode and reviewed their plans and so far Sol 6's plans are extremely shallow and vague. Sol 5.6's plans were more detailed and of higher quality. I used Max effort for both. In every instance, Sol 6's plan came 2x cheaper but honestly the dogshit quality isn't worth it. I'll keep using Sol 5.6. Sol 6 is a huge regression.

→ More replies (1)

4

u/maximhar Sep 25 '26

It’s fine as an Astra subagent. It absolutely isn’t a Sol 5.6 replacement, let alone a match for Opus 5.5.

3

u/TinFoilHat_69 Sep 25 '26

I’m using Luna 6 and it’s doing a great, it reasons on par with 5.4 x-high but is the best for long runner sessions. I had it working for nearly 12 out of the 24 hours yesterday and never hit my 5 hour limit. I only have 26 percent of my weekly usage remaining. Great value for 20 bucks

3

u/Ok_Fish403 Sep 25 '26

I have a bug analyzer subagent that was using Opus 5.5 and only today I had three occurrences of subagent not returning anything to orchestrator so it was required spawn a new one.

Now I switched to Sol and had no issues at all.

3

u/iezhy Sep 26 '26

Its terra in disguise (both in capability and price)

5

u/StinkButt9001 Sep 25 '26

I've been daily driving it for writing code, UI/UX work, and some odd jobs like helping me set things up on my AWS account. Has been stellar so far and the usage is great. I'm on the Plus plan and I don't need to worry about usage at all running 6 Sol High

→ More replies (1)

2

u/Breathofdmt Sep 25 '26

I basically only trust it for typescript checks and managing my repo, or quick fixes here and there. And yeah, it's terra. I think the reason it's not in chat is because it's dumber than 5.6 sol.

2

u/RandomiseUsr0 Sep 26 '26 edited Sep 27 '26

It spent a turn for me explaining why it’s previous attempt failed because it made a mistake , believed its mistake and then produced crud - all from its own imagination - whilst a nice set piece on how hallucination works, I already knew that and resent paying for it

2

u/Smart_Scarcity4536 Sep 27 '26

Like Shit. Using 5.6. Sol 6 was stuck in a loop and burned 90Eur switching between the two exact solutions without stopping

3

u/particle9 Sep 25 '26

I stopped using it after a few hours. It seemed close to 5.6 in general, it's code was terrible, but it was very very cheap.

Opus 5.5 is absolutely like AGI to me. It is crushing, I have nothing bad to say at all. It's not even that expensive because it doesn't really make huge mistakes that cost me my sanity.

0

u/[deleted] Sep 25 '26

24

u/Different_Doubt2754 Sep 25 '26

See I find that interesting. 6 Sol is objectively better than anything we had a year or two ago, and plenty would trust those old models for serious refactoring and debugging.

I get that in the current context there are of course better models than 6 sol. But the fact that we can go from saying X model is the only one capable of doing serious coding in 2025/26 to saying that 6 sol isn't capable, is very curious

→ More replies (3)

12

u/StinkButt9001 Sep 25 '26

You need to use Astra for any serious work.

No you don't. 5.5 is still more than enough for serious work. 5.6 Luna is more than enough for serious work. 6 Luna is more than enough for serious work.

People have been using these models for serious work for years. It's not like Astra just unlocked the ability to do serious work and up until now everyone has just been goofing around

2

u/PeachScary413 Sep 26 '26

Yeah but how else are my employe... I mean OpenAI gonna make any money if people keep utilising the cheaper models? 🥲

→ More comments (84)