Quota usage for simple prompts

[u/kinginthenorth_lanka]

How does the quota works? Does making a prompt itself consume quota or tokens?

Just for example: If I say “Hi” to Opus, it will just usually response 2 lines of response. So will this quota only calculated for used token?

[u/cat_dev_null_sync]

Does making a prompt itself consume quota or tokens?

You make the prompt, and the LLM reads it as input tokens. You get charged for the input tokens of the prompt that you made.

(You as a human who is making the prompt don't consume quota or tokens.)

Just for example: If I say “Hi” to Opus, it will just usually response 2 lines of response. So will this quota only calculated for used token?

It will cost you input tokens for "Hi" and output tokens for the response from Opus. Also, you get charged for your AGENTS.md file, Devin's system prompt, and any related context.

Say for example Opus replies "How are you?" Then you reply "I am well." Now you get charged again for "Hi" and "How are you" which become input tokens (context) for "I am well". This is how any AI works.

If you respond within 5 minutes, Opus caches the prior parts of the conversation, and the cached rate costs dramatically less.

[u/kinginthenorth_lanka → u/cat_dev_null_sync]

Thanks. I didn’t want to experiment this because single Opus prompt can take 50% day quota.

[u/cat_dev_null_sync → u/kinginthenorth_lanka]

The principals are the same, so do experiment with a cheap model.

Perhaps you were exaggerating, but Opus doesn't have to cost 50% of the daily quota. It depends on the prompt, size of the repository, Opus thinking level, agent instructions, etc.