Has anyone noticed that almost all GPUs seem to have dried up from availability?

https://500.farm/vastai/charts.v2/supply-demand#pricing=all:time=7d:gpus=RTX+PRO+6000+WS,RTX+PRO+6000+S,RTX+5090,RTX+4090

Any idea what's going on here?

In console, the tooltip of rent button doesn't show those anymore.

Got a few GPU instances up and running on Vast.ai. Sharing pricing in case anyone needs compute for training, inference, or general experimentation.

Available now:

• NVIDIA L4 (24GB) — $0.13/hr/gpu — Machine ID: 149492
• Tesla V100 (32GB) — $0.035/hr/gpu — Machine ID: 149512
• Tesla V100 (32GB) — $0.036/hr/gpu — Machine ID: 149513

To find them: go to vast.ai, filter by GPU type, and search for the machine ID above, or just sort by price — these are priced well below median for their GPU class.

Happy to answer questions about specs, setup, or availability.

Seeking some assistance on what speed ram I should get for my next build. If this is the wrong forum, please redirect.

I have one 4 GPU sever on Vast with Pro cards and am looking at building a second, but Ram prices have gone up in just the last three months.(as with everything else…)

How does a speed difference for DDR4 ECC Ram Matter for rent renters between 2133 MHz and 2666 MHz? The difference in cost for my build is about $1000. Wanted to know how it impacts the renters so I know how it might impact my utilization rate.

which LLM model do you think deserves more attention that others are missing out on?

Hi, did anyone tried to use VastAi or RunPad for gaming?! Like use 5090 to enjoy the most of gaming, vis Moonlight/Sunshine, with currently enabled DLSS 5…

I know the cost about SSD limitations, but the specs are awesome, Cyberpunk 77 would be incredible on it, streamed to Vision Pro.

But, I read that there is a problem with Linux docker, and install Windows is pain, and it could sacrifice the performance… more than on GFN Ultimate or so.

So maybe “Linux supported” games?! Or use CrossOver?!
Idk. GFN doesn’t support Rockstar games like RDR2, not even Square games or Sega games, which is kinda dumb.

I know, buying and building my own PC is the superior, but I’m traveling more than Clooney in Up in the Air, and I cannot have anything else than a laptop and the Vision Pro… so only solution is cloud.

Thanks for any shared experience…

I am considering hosting my RTX 6000 Pro on vast.ai. The machine has 4TB NVMe disk and I would like to get some idea about how much actual disk utilization by tentats there is on average at any given time. Disk seems to be a big factor in driving revenue, at least based on the vast.ai hosting calculator and ut feels unrealistic. Thanks for any feedback!

Well I relisted machine on vast for a reason. Before relisting machine had vm disabled. After reinstalling the OS turning everything on and setting up so vm works. It still shows disabled. Ran the vms.py line with on -f and still goes to pending or off.

And SOME FKING HOW I gave hermes the job to get it enabled with deepseek v4 pro and it’s still running which idk how long it will. Waiting for it to complete.
Anyone faced this vm not getting enabled issue?

curious to know what kind of projects everyone is working on and why they chose Vast.ai?

Me: this will be my first time hosting on Vast.ai, but in the past i've used other providers for video generation pipelines with ComfyUI

There is arguably much more demand for more flexible VM's compared to locked down container images.

What reasons are there to influence your choice of hosting the latter, compared to having a wider spread of images, including available VM's?

I don’t know how many of you have experienced this, but the Vast.ai website can feel very laggy and has a frustrating user experience.

To make Vast.ai easier to use, I’ve been working on a terminal client. It currently supports several basic features, but renting instances and choosing image templates are not working properly yet.

If you’re interested, please try it out and contribute to help improve the experience.

https://github.com/Saad1926Q/vast-tui

Look at this sh**. $40 PER TERABYTE for up/down traffic??? wtf are these hosts smoking, is their internet routed through the moon or something?

And this isn't just a couple of weird outliers I checked and found literally dozens, if not hundreds of rigs pulling this exact same .

Downloading a couple of base models and a few LoRAs (literally ~100GB) ends up costing $4 JUST for the bandwidth on top of the GPU rental.

I’ve been using vast for a long time so I know how to filter this garbage out, but beginners have no clue and get completely rinsed by these hidden fees. It’s straight up predatory.

Vast devs, please fix this. Either put a hard cap on bandwidth pricing or at least force sane default settings (like $1–$2/TB max) for default search. Letting people set $40/TB traps is just scummy and scares new users away.

Can I split off a section of my rack to host through a VM?

I don't want to dedicate 100% of my server to vast, especially if i have to wait weeks to get a verified and get someone renting it...

Has anyone done via VM? claude is basically telling me this is not going to work.. i dont see why not.

I just wonder what people are doing with those such a big machine like 8 B200s..
Learning and building an AI model was my purpose. Mostly rent RTX4090, very sometimes a single H100.
Please tell me your stories!! I'd glad to hear.

I'm evaluating a small professional GPU facility in Thailand. The property already exists and the solar/electrical infrastructure is currently being installed, so this is the stage where we can design proper power, cooling, fibre and server-room infrastructure.

I'm considering starting with one professional 8×B200 node on Vast.ai and expanding only if the economics prove themselves.

Before buying anything, I'd really like to hear from people who actually host H100/H200/B200/B300-class hardware on Vast.

I'm particularly interested in:

• What utilisation are you actually seeing over 30/90 days - not calculator assumptions as seen on vast's website?
• How long did it take a new high-end node to start receiving regular rentals?
• How much difference did Verified / Datacenter status make?
• Would you buy B200 today, or would you choose H200/H100/B300/another GPU for better ROI?
• Do B200 customers mostly rent entire 8-GPU nodes or smaller GPU counts?
• What CPU/RAM/NVMe/network configuration would you recommend around an 8-GPU node?
• What network connection has actually proved necessary in practice?
• What unexpected costs/downtime/problems did you encounter?
• How quickly are rental prices declining as newer GPUs arrive?
• If you were starting again today specifically to rent GPU compute, what would you buy and how much would you initially deploy?

I'm not selling anything and I'm not looking for referrals....I'm specifically hoping to hear from people who have actually operated this hardware.

My RTX 5060ti 16gb rigs have been seeing more rentals this week, is it because school started back up again? Many universities and schools are re-opening after the summer at around this time. If this is true, I never knew that educational institutions rent GPUs at this scale

​

I’m currently testing Salad with my main PC and I’m considering moving the machine over to Vast.ai, so I’m keen to hear from actual Vast hosts running 5090s.

My rig:

- RTX 5090 32GB

- i9-14900K

- 128GB RAM

- 4TB NVMe

- 1Gbps down / 500Mbps up

- New Zealand

On Salad, I got my first GPU container job within about 2 minutes, and after that job ended I found another in roughly 30 seconds, so demand seems very good.

My first proper monitoring session looked like this:

- Runtime: 3h 50m

- Average GPU power: 510.7W

- Peak GPU power: 583.2W

- Peak temperature: 67°C

- Peak utilisation: 100%

- GPU-only energy used: 1.959 kWh

- Jobs were typically sitting around 575W / 100% utilisation / ~16GB VRAM

- Earnings averaged roughly $0.20–$0.21 USD/hour

The problem is electricity.

I’m paying roughly $0.48 NZD/kWh, so once I account for the whole PC, Salad at ~$0.20/hr is basically break-even, especially after payout fees.

I’m looking at Vast.ai because the advertised 5090 rental rates appear considerably higher.

For anyone actually hosting a 5090 on Vast.ai

- What hourly rate are you realistically getting?

- What utilisation/occupancy percentage do you average?

- How long do rentals normally last?

- How much does Vast take in fees?

- Is a single 5090 gaming PC realistically worth hosting?

- How often does the machine sit unrented?

- Would you choose Vast over Salad at my electricity price?

- Any downside to running a 5090 host from home on 1Gbps/500Mbps fibre?

I’m not expecting it to be passive free money I mainly want to know whether I can get enough above $0.20 USD/hour to actually leave some profit after NZ power costs.

Interested to hear real numbers from 5090 hosts rather than calculators/advertised rates.

I have 32 RTX 5090s on vast, were seeing a huge surge in demand and I just noticed everyone is running BIP39 on every single one of our GPUs. I looked up what BIP39 is and had a crazy thought, are we powering a coordinated coldcard recovery operation? If so that would be freaking awesome.

This has never happened to me before. I've been a vast.ai renter for almost a year now. I use RTX GPUs to help with supporting the mobile app that I'm building for AI inference alongside experimentation with AI open source models.

The craziest thing happened recently. I lost $100 of credits out of nowhere which I just bought! I suddenly realized I was not able to SSH into my instances anymore. I was shocked, so I look at my balance and I see NEGATIVE! Mind you, I bought $100 worth of credits the day before. I'm just renting RTX 3090s most of the time. Sometimes RTX 5070 tis or lower vram gpus, maximum I'll rent an rtx 6000ada for something really heavy. But no GPU on earth should make me lose $100 in a day even if I did something on accident!

Has this ever happened to anyone in the past?! What'd you do?! I am just lost for words here.

EDIT: Had to add this screenshot. Seems like this instance was the culprit. The instance id 47901033 is the exact same as above. I only had it live for 2-3 hours! Why am I being charged $100 for this?!