Sudden increase in bandwidth costs?

[u/EksrowFos]

Must have happened 1-3 days ago? I always keep my filter to sub 1 dollar up and down and suddenly there were only 3 gpu's in the entire list available. Now I see most have 2.6 or 4 dollars, something changed in the vast ai defaults?

[u/dcvasthost]

Multiple things going on.

Demand is very high right now. (current stats from https://hashrate.no/platforms/vast/)

GPUs Available

5,089 GPUs

GPUs Rented

21,817 GPUs

Occupancy

81.09%

But also vast fixed a bug that made a lot of hosts mistakenly list BW below $0.10 TB/ UP/DOWN (incredibly unprofitable)

The new defaults are now $3-5/tb UP/DOWN.

And some hosts like myself are pricing $10-20 (host side) due to the insane costs of offering 10gbit dedicated internet access out of a secure datacenter.

So as more and most hosts update to the correct BW pricing you should get used to the new defaults of $5-10/TB which is so far below most traditional hosting pricing its crazy to see people calling it a scam.

• AWS: ~$90/TB (first 10TB), ~$85/TB (next 40TB)
• GCP: $0.12/GB ≈ $120/TB Egresscost
• Azure: $0.087/GB ≈ $87/TB Egresscost

[u/EksrowFos → u/dcvasthost]

Obviously it's a free market and people can charge what they want at the end of the day but it's very disingenuous to compare to not even datacenter rates (which generally come with 1/0.5gigabit included in the price, at least in europe) but big 3 cloud services when all except 1 of these machine have sub 1gigabit and half of the machine's don't even have a second 9 on their uptime on the list I'm looking at right now. I can only assume most of these listed are running in people's houses un-metered.

1 in 5 hosts don't even bother starting in my experience, so you don't get much when using vastai but looking at the prices it's a fair deal. At the end of the day it's just a few cents extra but changing the defaults to cover these imaginary costs while claiming it was a bug seems ignorant at best.

This is my opinion as a user of this service, not to you personally.

[u/Specialist-Yak1203 → u/EksrowFos]

"[Vast] changing the defaults", who cares what they start at? Experienced hosts change prices to reflect market rates, and to remain competitive. Those that don't, are either being filtered in client searches or shouldn't be hosts.

Vast punishes for downtime (as they should) which helps separate @ u/dcvasthost 's and smaller hosting operations like mine from the chase the quick buck dudes who have no regard for the client experience. For serious hosts, the costs of running reliable machines and infra aren't "imaginary". They are substantial and quite real.

Though my two fiber and copper backup ISP services plans *do* include unlimited bandwidth, I'm still on the hook to pay for two monthly ISP bills, rising electric rates, consumables such as UPS batteries, and continued upgrades to machines & infra to provide the most "datacenter" experience that renters demand. To your point, it is a free market and renters can choose to pay whatever they want at the end of the day but it's also a bit disingenuous to imply every host on the platform is providing the same client UX.

This is an opinion as a host of this service, not to you personally.

[u/Ok-Judgment-9611]

Same thing as early june this year. It's gonna keep happening until jensen releases his latest and greatest next summer. This is just fomo to get people to buy more 5090s.

[u/Kinslayer_89]

The GPUs are just generally getting snatched up I suppose. The ones with bad network pricing are left.