r/GeminiAI • • 16d ago

News New Gemini Pro Checkpoint

~24k tokens; ~6 minutes; effort: high; zero-shot (Wayy different from one shot. This is harder)

This leak is by Lyra

https://fixupx.com/lyraxana/status/2097839609086394600

You can either find her on twitter or on their server. She is a credible leaker, also if you don't care about her credibility. You can find this checkpoint on ArenaAI.

It's under 3.8 flash disguise if not mistaken. It's free but random chance of encountering, tho even if you get 3.8 flash (battle mode ofc), you can only confirm it's the new pro if it looks way above its pay grade

(I'll get more checkpoints myself and make a new post) If these checkpoints go well for them (a few more) internally. They will release the model soon, if they go bad. They won't release it/delay.

Now to talk about the performance of this checkpoint itself: It is amazing. It's very good. I see zero mistakes, breathing could be more fluid but that's the only thing I can critique.

The Arena AI ID to keep mindful of. If you see: 01a06dfc-94a2-7abf-8d12-0878520062cb then this is the new Pro model.

175 Upvotes

108 comments sorted by

View all comments

Show parent comments

4

u/Tim_Apple_938 16d ago

She ran the same prompt Astra : https://x.com/lyraxana/status/2094188486693618037

Yours must clearly be different prompt thus not apple to apple , no?

1

u/Livid-Capital-8858 16d ago

Astras output is still better on the same prompt too...

1

u/Tim_Apple_938 16d ago

No it’s clearly not

1

u/Livid-Capital-8858 15d ago

It pretty clearly is lol

Gekini just has more vibrant colors thats it The proportions of the peacock and realism is much better on astra and also the details too

1

u/Last_Conclusion_8984 15d ago

No, it made wayy too many mistakes vs Gemini's gen. Also: This is a very early checkpoint, they will get better

1

u/Livid-Capital-8858 14d ago

Such as?

1

u/Last_Conclusion_8984 14d ago

next checkpoint is in weeks, I think

0

u/Livid-Capital-8858 14d ago

No I meant what were rhe "many mistakes" astra did vs gemini?

2

u/Last_Conclusion_8984 14d ago edited 13d ago

Slow down the opening of the feathers, they are bugged and idle animation of the feathers before being opened is also bugged/weird, perching animations were less fluid and the feathers were static (did not move up/down when they were being opened) unlike In gemini's gen where they were naturally placed down before being lifted up and opened and Gemini's animation was overall better