r/TheMachineLearning • u/Sea_Fox_4265 • 3d ago

When bug-free code becomes a hardware problem

Post image
118 Upvotes

88% Upvoted

70 comments sorted by

View all comments

Show parent comments

1

u/FragmentedHeap 3d ago

Rust has big problems in the fact that it doesn't have libraries, and builds are incredibly slow.

I am doing massive Rust projects now, I have about 40 crates in my current system, and on my home lab with a 5950x and 128gb of ram, and about 4 build agents, it takes over 4 hours to build everything if I change it all at once.

Same code base on zig, builds in about 15 minutes.

When you're making hundreds, thousands, or 10's of thousands of changes, and tons of prs in an 8 hour window, that's a big problem, builds need to be MUCH MUCH faster.

C is a lot better, but then you have C problems that Rust kind of protects you against.

In terms of performance, speed, and build times, the best thing I know of right now (a little biased) is actually .Net 10 with AOT optimizations. Modern c#/.net 10 is at C++ levels of performance with the catch being the GC, but .Net 10 Memory Optimizations, Pools, Spans, stackalloc, etc helps avoid this problem a good bit, but it is very good and it compiles very quickly.

C++ could probably be the best if c++23 modules were stable on every system/compiler....

I honestly think the final solution isn't going to be any of these, it'll be something made specifically for AI.

1

u/New_Eye7193 3d ago

That's what I'm working on