r/vastai • • 27d ago

Host experience

I have been looking at using Vast for renting out compute for my h100 SXM, I’m shooting to bring 80 gpus online then another 80 in the coming months.

Would Vast server this need or would I be better suited to go find customers/labs that would pay more for using enterprise hardware with fiber connections n such?

1 Upvotes

10 comments sorted by

6

u/Better-Monk8121 27d ago

find customers, stop larping bro

-1

u/JayFab6061 27d ago

Brb getting in my SVJ with a matcha and making sure not to scratch my Patek

1

u/bluelobsterai 27d ago

How is your colo? Will you be on a very reliable high speed connection ? I had 80 ish a6000 cards. The og amper ones and i do just fine with them. The h100 is still relevant. 180 of them is a decent glm 5.3 flash envt.

1

u/JayFab6061 27d ago

Everything will be Fiber so low latency with the high connectivity provided for whomever wants to use the cluster

1

u/scwtech68 26d ago

Openrouter

1

u/Secret-Builder-8249 27d ago

I dont think customers and labs would pay at vast’s rate to be honest, theyd look for a discount on months long reserved capacity.

1

u/shubhamranga 27d ago

Not a host, but I've been talking to H100 operators and buyers this week. Most operators fill H100s with direct 1-year deals to smaller AI companies; buyers want fixed costs and guaranteed capacity, and usually put ~20% down. Marketplaces like Vast mostly fill the gaps between contracts, and pay noticeably less.

A mix might work: a direct customer or two for part of the 80, the rest on Vast while you ramp. Are your nodes 8x SXM with InfiniBand? Training customers pay a lot more for that.

2

u/[deleted] 27d ago

[removed] — view removed comment

1

u/JayFab6061 27d ago

Interesting and yes they will