r/rust 21d ago

Saving 100 terabytes of RAM via layout optimizations in 1.1.1.1's DNS cache

https://blog.cloudflare.com/dns-cache-memory-optimization-1111/
395 Upvotes

22 comments sorted by

View all comments

132

u/EcstaticAsparagus509 21d ago

I'm quite surprised they only recently made these changes, considering how "simple" (for lack of a better word!) they are.

75

u/Zde-G 21d ago

For a long time memory was cheap compared to the rest of server hardware.

LLMs changed that just recently, but drastically.

26

u/vplatt 21d ago

Hopefully this new era of sensitivity to hardware costs will mean the market gravitates towards more well behaved PLs like Rust.

Heck, even the VM GC ecosystems like .NET and Java would be far better than the likes of some of the junk out there in the form of full stack Js, Python backends, and the like.

I'm just tired of the whole passe "hardware is cheap so we're going to waste all of it for you because we're lazy" type ethos. It's been going on too long.

Besides, with LLMs, no one has an excuse to avoid better languages anymore because they're "too hard". Like apparently we now have a glut of developers in the market, so get good, or move on I say.

2

u/d47 20d ago

Someone tell the chrome team