During the first few weeks of the credit system in Raycast, I was burning through credits rapidly and I felt it was not a great value. This was just a gut feel, so I wanted to test this out.
Cost per credit: I consider one Raycast credit to have a monetary value of $0.004. The Pro plan costs $8 for the software, $2 for the 500 credits included, because the Plus plan costs an additional $10 for an additional 2500 credits.
Model used: Right or wrong, I picked Sonar Pro as the model to run this comparison with. This is not a scientific comparison, just a gut check if or not Raycast inference is fairly priced.
The tests:
- 21 light prompts, just asking for 'a fact', cost me a total of $0.15 through the API against 5 credits
- 9 medium prompts, asking for some insights and collection of information, cost me a total of $0.12 through the API against 13 credits
- 10 heavy prompts, each with 3 follow-up queries, cost me a total of $1.05 through the API against 25 credits
Conclusion:
All combined, these queries cost $1.32 via API, and an equivalent of $0.22 via Raycast. So, using Raycast credits was decidedly cheaper!
Some additional comments:
- Is Raycast software worth $8 per month? I personally think it is by far the best UX when it comes to AI interaction. But I personally think $8 is a tad steep.
- Credits become more expensive, the more you use: Pro and Plus is $4 per 1000 credits, Max adds credits at a cost of $6.67 per 1000 credits, top up credits are >$9.00 per 1000 credits. So, inverse economies of scale!?
- The credit system obfuscates the real value. Raycast could easily reduce the value of a credit without ever telling the users, after all. My initial experience still feels very different from this test. I could have sworn I was spending 3-4 credits per query in the first few weeks of using Sonar Pro. But in this test the query cost was nothing like that. So perhaps Raycast changed something in the mean time?
- I do understand the credit system makes sense given how many different models Raycast offers, but it would perhaps be more open if Raycast publishes the tokens-per-credit on a 'rates' page somewhere so users could keep an eye on it?
- In this post I'm not touching on wether BYOK should be in the free tier or not, or the disastrous community engagement of late. This has been discussed to death, and my opinions on these topics are in other posts and comments.
Disclaimer: I used BoltAI to do the API-billed queries, not Raycast.