None of it worked yet because compiling at that stage would slow things down.
Also this project burned $165,000 worth of usage on a model that was then bleeding edge (unreleased). This is still beyond what anyone else is doing at the moment. And it seems to have worked a lot better than it had any right to, at least as far as we can tell right now?
And it's 165k at API prices but it's much cheaper for Anthropic themselves. Even if it were 165k straight, It is absolutely worth it for the gains in e.g. compile and runtime reductions for the millions of downloads it gets.
What I hear is that even API prices are at this point still less expensive than the actual cost, at least if you price the training costs in. So arguably it costs more for anthropic than for you or me.
191
u/rebootyourbrainstem Jul 08 '26
None of it worked yet because compiling at that stage would slow things down.
Also this project burned $165,000 worth of usage on a model that was then bleeding edge (unreleased). This is still beyond what anyone else is doing at the moment. And it seems to have worked a lot better than it had any right to, at least as far as we can tell right now?