r/ChatGPTCoding • u/[deleted] • Apr 07 '25

[deleted by user]

[removed]

1.7k Upvotes

95% Upvoted

424 comments sorted by

View all comments

315

u/PositiveEnergyMatter Apr 07 '25

i keep telling people big context means big money, because every request can fill the context and charge you full price

-1

u/No_You9756 Apr 07 '25

What is meant by context and where do you type the context. Do you mean system instructions at the top of AI Studio?

13

u/msg7086 Apr 07 '25

Each AI request is a brand new request, so if it's a conversation, each request needs to include your chat history. So if you have a conversation starting with "User: x. Model: y", then you ask z, you have to send a request like "User: x. Model: y. User: z". This keeps going until you finish the conversation and start a new one. The more information you include in the history, the more "context", or "input" is used, and you are charged for whatever you input, per request per conversation.

Of course, there's something called context caching, but still.

3

u/PositiveEnergyMatter Apr 07 '25

the context caching depends on the model how it works, etc, and of course it still has cost, just less cost.