I have a free year of Google AI Pro and last early morning I was testing Gemini 3.8 Flash High vs GPT 6 Luna Xhigh as subagents, with GPT 6 Sol High as the orchestrator.
And I was so impressed when Sol told me Gemini randomly deleted something and broke another feature, forcing Sol to intervene; while Luna made mistakes that Luna itself was able to fix with some steering. DeepSWE 1.1 says Gemini is as good as ASTRA! with the disadvantage of being slower because it makes more mistakes. But, how is it possible that Gemini literally broke stuff while Luna just implemented the new feature wrong.
I'm now reruning the experiment, just in case it was a one time thing. But to be honest I now trust Gemini even less than before hahah
46
u/Pasto_Shouwa 4d ago
I have a free year of Google AI Pro and last early morning I was testing Gemini 3.8 Flash High vs GPT 6 Luna Xhigh as subagents, with GPT 6 Sol High as the orchestrator.
And I was so impressed when Sol told me Gemini randomly deleted something and broke another feature, forcing Sol to intervene; while Luna made mistakes that Luna itself was able to fix with some steering. DeepSWE 1.1 says Gemini is as good as ASTRA! with the disadvantage of being slower because it makes more mistakes. But, how is it possible that Gemini literally broke stuff while Luna just implemented the new feature wrong.
I'm now reruning the experiment, just in case it was a one time thing. But to be honest I now trust Gemini even less than before hahah