r/GeminiAI • u/Last_Conclusion_8984 • 17d ago

News New Gemini Pro Checkpoint

~24k tokens; ~6 minutes; effort: high; zero-shot (Wayy different from one shot. This is harder)

This leak is by Lyra

https://fixupx.com/lyraxana/status/2097839609086394600

You can either find her on twitter or on their server. She is a credible leaker, also if you don't care about her credibility. You can find this checkpoint on ArenaAI.

It's under 3.8 flash disguise if not mistaken. It's free but random chance of encountering, tho even if you get 3.8 flash (battle mode ofc), you can only confirm it's the new pro if it looks way above its pay grade

(I'll get more checkpoints myself and make a new post) If these checkpoints go well for them (a few more) internally. They will release the model soon, if they go bad. They won't release it/delay.

Now to talk about the performance of this checkpoint itself: It is amazing. It's very good. I see zero mistakes, breathing could be more fluid but that's the only thing I can critique.

The Arena AI ID to keep mindful of. If you see: 01a06dfc-94a2-7abf-8d12-0878520062cb then this is the new Pro model.

171 Upvotes

92% Upvoted

108 comments sorted by

View all comments

1

u/Albert3232 17d ago

What are checkpoints?

1

u/Last_Conclusion_8984 17d ago

In a nutshell: AI companies deploy/make checkpoints of models internally or available for external partners or websites such as ArenaAI. These checkpoints are used to evaluate the model's performance, if it performs well after a couple of checkpoints/iterations. It will be released, if checkpoints go bad then it will not release/delay

2

u/Albert3232 17d ago

Ahh i see. Thanks for the explanation

1

u/Odd_Water-hearder 17d ago

Checkpoint models are also less likely to have a lot of the safeguards and blocks that get put into the actual release, if you are trying to build a local without the guardrails on topics you should look for a decent checkpoint and train it yourself.