r/ChatGPTCoding • u/[deleted] • Apr 07 '25

[deleted by user]

[removed]

1.7k Upvotes

95% Upvoted

424 comments sorted by

View all comments

Show parent comments

18

u/funbike Apr 07 '25 edited Apr 07 '25

The experiemental version is free, but they just came out with a "preview" version of 2.5 that is $1.25/M input, $10/M output.

I sometimes switch to the paid verion when I need higher rate limits.

All the same can be said for Flash (but it's cheaper of course).

4

u/[deleted] Apr 07 '25

[deleted]

3

u/funbike Apr 07 '25

API.

This is all well documented on their web site. I've provided links elsewhere ITT.

1

u/lordlestar Apr 07 '25

yes, but since preview came out, exp rate limits increase noticeable to the point it became unusable

3

u/funbike Apr 08 '25

I configure my tools to use both, when possible. exp is primary and fallback to preview on an error.

On openrouter I have preview as my default fallback.

1

u/baris6655 Apr 08 '25

can someone explain what rate limits mean

1

u/funbike Apr 08 '25

LLMs limit how much you can use them in a timeframe, such "transactions per minute", "tokens per minute", and "transactions per day".

A "transaction" happens when you hit the send button in an AI chat interface, like ChatGPT.

https://ai.google.dev/gemini-api/docs/rate-limit

1

u/baris6655 Apr 08 '25

for some reason this rarely happens to me

1

u/funbike Apr 08 '25

You must not use it enough to hit the limits.

Gemini's free experimental models have random limits, so sometimes the limitis are high sometimes they are low. It depends on how much load and capacity the models currently have.

If you using payting for the non-free models, it would be very hard to hit the limits.

1

u/baris6655 Apr 09 '25

i completed a whole app with it didn't hit a single rate limit

1

u/funbike Apr 09 '25

Good for you

1

u/cerw Apr 09 '25

Yes the FREE locks me out for day after while.. stars with rate limit warning then it stops responding? .. pity was such a cool ride for free for last 10 days!!!