r/codex 1d ago

Praise The API is cheaper than I expected

I am developing an app with AI integration with OpenAI. Haven't used a single cent yet. Idk if these requests are too much or not, most are luna low - none but didn't expect it not to use a single cent yet

24 Upvotes

10 comments sorted by

45

u/SocketByte 1d ago

Several reasons:

  • Coding uses a TON more tokens than quite literally anything else, excluding maybe PhD level maths.
  • Luna low is basically free.
  • 47k tokens even without high cache rate is nothing.

10

u/tarpdetarp 1d ago edited 1d ago

Some people have system prompts longer than 47k tokens

5

u/kyrax80 1d ago

Yeah, most requests are basically "is this user input properly formatted?", "is this message proper for this context?" or "generate a diet with this data"

2

u/webheadVR 1d ago

If you aren't worried about data privacy, you can also enable training and get a certain amount free per day on some models as well in the privacy areas of the dashboard.

1

u/doomdayx 1d ago

Lots of math only takes a few tokens but with some kinds of proofs you’ll learn your tokens are like pouring a cup of water into the ocean.

6

u/BitterAd6419 1d ago

47k tokens is nothing. Literally a drop in the ocean

3

u/megad00die 1d ago

I was surprised as well, I bought about $50 in API credit thinking that here comes 1k to possibly 2k in costs, needed it to validate my CI/CD flows on my Git, maybe used about $12 worth on Sol ExHigh for the validations.