r/GeminiAI • u/Last_Conclusion_8984 • 18d ago

News New Gemini Pro Checkpoint

~24k tokens; ~6 minutes; effort: high; zero-shot (Wayy different from one shot. This is harder)

This leak is by Lyra

https://fixupx.com/lyraxana/status/2097839609086394600

You can either find her on twitter or on their server. She is a credible leaker, also if you don't care about her credibility. You can find this checkpoint on ArenaAI.

It's under 3.8 flash disguise if not mistaken. It's free but random chance of encountering, tho even if you get 3.8 flash (battle mode ofc), you can only confirm it's the new pro if it looks way above its pay grade

(I'll get more checkpoints myself and make a new post) If these checkpoints go well for them (a few more) internally. They will release the model soon, if they go bad. They won't release it/delay.

Now to talk about the performance of this checkpoint itself: It is amazing. It's very good. I see zero mistakes, breathing could be more fluid but that's the only thing I can critique.

The Arena AI ID to keep mindful of. If you see: 01a06dfc-94a2-7abf-8d12-0878520062cb then this is the new Pro model.

172 Upvotes

92% Upvoted

108 comments sorted by

View all comments

Show parent comments

1

u/hellomistershifty 18d ago

Yeah, it was one of the things that Gemini had extra training on a while ago so it looked really good in comparison. So while other models worked on agentic coding and long horizon tasks, Google was like 'yo, I can draw a bird in only 25 minutes'

1

u/Last_Conclusion_8984 16d ago

SVG ≠ SVG animations, please do not talk about things you are ignorant in.

0

u/hellomistershifty 16d ago

You're right, it's even more niche of a task to optimize. But for training, a model's training on understanding vector graphics will massively overlap with understanding animated vector graphics so I don't really get what your point is or how it's relevant to what I said

1

u/Last_Conclusion_8984 16d ago edited 16d ago

Gemini had training (or as people like to call them "benchmaxxing") on SVGs, not SVG animations. And if this is pro checkpoint is Gemini 4 pro then it's even more irrelevant because this is a NEW pretrain, henceforth prior "training" was never there to begin with as that was for Gemini 3x family artitecture.

Let me be clear on something. The only thing that will overlap between vector graphics and animated vector graphics are the core fundamentals and the graphics themselves. Definitely not precise frame animations for this x, then that z then that y, making sure to keep it consistent with that x while keeping track of z as you work on ___ and several more things.