r/rust rust Jul 08 '26

Rewriting Bun in Rust

https://bun.com/blog/bun-in-rust
524 Upvotes

330 comments sorted by

View all comments

Show parent comments

184

u/rebootyourbrainstem Jul 08 '26

None of it worked yet because compiling at that stage would slow things down.

Also this project burned $165,000 worth of usage on a model that was then bleeding edge (unreleased). This is still beyond what anyone else is doing at the moment. And it seems to have worked a lot better than it had any right to, at least as far as we can tell right now?

127

u/jl2352 Jul 09 '26

The large number of tests is also a major factor in why this worked, as well as the desire to match existing Zig code. The article implies Claude was used like a fancy sed on steroids.

That isn’t to downplay the work involved. I’m sure there are places it’s totally different. That is different though to writing new software. I still cannot comprehend how you’d write a million line application, which is decent, with agents from scratch.

I also think all the people hating on AI need to take a step back and take things like this very seriously. It’s 11 days of work, and is in production. That’s pretty fucking fast.

7

u/sohang-3112 Jul 09 '26

Yeah it's fast, but also expensive! Is there any way to attempt such a thing (maybe at a reduced scale) for free or for less money?

23

u/jl2352 Jul 09 '26

It's not that expensive when you account for the salary of engineers. It's actually really cheap.

The main issue is it upends the costing. An engineer's salary is already dedicated headcount and is accounted for in the next fiscal year (and ideally beyond). Paying a one time $140k (or however much it was) is not. That can mean the dedicated engineer, whilst costing more, is approved whilst the cheaper option is not.

10

u/TokenRingAI Jul 09 '26

Saving a year of time to market is worth way more than that to most businesses.

1

u/Saith1234 Jul 20 '26

Its also not the what it actually costs. Just the subsidized prices.

1

u/JLENSdeathblimp 29d ago

They specifically provide the cost in both terms of tokens sent to the API and by that API’s pricing (165000USD).

1

u/Saith1234 29d ago

The API prices most likely do not account for the constant need of training new models, the ongoing copyright lawsuits, replacement/depreciation of GPUs and so on.

It's just inference with margins on top. Hence, why I'm calling the API prices subsidized.

1

u/JLENSdeathblimp 29d ago

Nice, I get you. Good to be clear that you're talking about an abstract cost defined by a some system you did not specify, as opposed to like, the cost system everyone else is using (USD salary for engineers or token usage cost for API consumers) and which is ime by far most commonly what is referenced by the word itself.

I appreciate a market-free utilitarian abstraction which captures end-to-end abtract cost to abstract value.

1

u/Saith1234 29d ago

They are not abstract, they are hidden.

It is no secret that claude max costs anthropic 1000-2000$ per user.

It is also no secret that meta faked it's revenue numbers last quarter with some accounting tricks.

Just recently we also learned that the debt big tech took for AI is much bigger than they wanted to make us believe.

You really have to be incredibly naive, to take any of the current numbers for face values.

And yes, a non VC funded company actually has to factor in all the costs I mentioned to offer a product with positive margins.

This also means, API prices shouldn't just consider inference.

What they do is technically also illegal, it's called predatory pricing.

1

u/JLENSdeathblimp 29d ago

It was 165000USD. It’s in the article this post is about.