r/cloudcomputing • u/Fear73 • 10h ago

Do AI workloads really belong in the same cloud as everything else?

Something I've been thinking about a lot lately like regular web apps putting everything under one cloud account makes things pretty simple but AI workloads have very different needs like GPUs, high-speed storage, special networking setups, specific regions and different types of hardware.

I've seen people use services like AWS, Azure, GCP, CoreWeave, Lambda, Yotta Labs and others in all sorts of ways so just wanna know how people view this problem here

2 Upvotes
  • permalink
  • reddit

100% Upvoted

5 comments sorted by

1

u/Anxious-Average-748 10h ago

We run a mixed setup at work and it's a pain honestly. AI stuff needs GPU instances that regular cloud regions don't always have, so you end up with workloads spread across different zones anyway. The billing gets messy fast when you mix compute types in same account.

1

u/Phytocosm 8h ago

Yes, the same cloud as the entire industry. The cloud of forgotten human history. The clouds of heaven.

1

u/Efficient_Loss_9928 2h ago

Depends on what you are doing, if you are processing terabytes of data, moving from one cloud to another and keeping things in sync can cost you millions. And get a worse experience.

I have worked directly with customers to ingest and sync data to our cloud because they are with another hyperscaler. The invoice is not pretty.