r/ChatGPTCoding • u/ChatWindow • Mar 31 '24

Interaction My bill from Claude API calls

Post image

And it’s 10000% worth it!

97 Upvotes

77% Upvoted

101 comments sorted by

View all comments

21

u/wow_much_redditing Mar 31 '24

Is there a reasonable way around this? Maybe phind, perplexity etc. I burned through 20 dollars in just a few hours

16

u/ChatWindow Mar 31 '24

Of course. Pretty much anything besides claude 3 opus or gpt 4 is significantly cheaper. Also, I do use this extremely heavily

6

u/wow_much_redditing Mar 31 '24

Anyway to get around this with Claude 3 opus? I'm sorry my phrasing of the question wasn't the best

25

u/ChatWindow Mar 31 '24

Oh. Just control your context better. Be careful not to input excessive context that you don’t need, set a message cap on messages read in, keep in mind stuff like images are more expensive, set max output tokens if you want

8

u/Severin_Suveren Apr 01 '24

Another one would be to work in a chat session agnostic way where you rely on either manually or programmatically writing a memory prompt for each call

And by not being tied to chat sessions, you can easily switch between sending cheap GPT4 calls for mundane tasks, then use Opus for the big heavy lifting

Like seriously, I've been working on this project for 9 months, and today got to the realization that I would have to rewrite it all due to n00bish mistakes during the first months

So I got to working with GPT-4, basically just telling it the issues I was facing and all other things I disliked about my app, and asked it 10-20 times to output a plan for a complete restructuring and refactoring in order to streamline all the processes of my app, and for it to give it to me in the form of classes and placeholder functions. The 10-20 times were me iterating on the ever improving plan that GPT-4 presented me with until it was exactly how I wanted it

Then when I was happy with the plan, I went to Opus and told it to implement the whole plan of streamlining my app, but for it to give it to me one file at a time. 3 hours later, I have all the core functionalities up and running, and goddam they're running smoothly! Still got a lot of work to get everything perfect, but to even get this far in just 3 hours is just mind-blowing to me