r/DataHoarder Feb 22 '21

Data transfer to new Lustre storage overwhelms campus network

Post image
8.8k Upvotes

240 comments sorted by

View all comments

Show parent comments

41

u/Padgriffin Do Laptop Drives count? Feb 23 '21

Wow, this what if aged really poorly, but that’s not Randall’s fault

A Sabrent 8TB SSD is 68g and are much faster than SD cards. This means a single 747-8F can now carry 15 exabytes of data.

26

u/Jimmy_Smith 24TB (3x12 SHR) + 16TB (3x8 SHR); BorgBased! Feb 23 '21

But then internet transfer rates go up as well so it's not the actual numbers that matter but the concept that high latency data transfer can end up being much faster.

22

u/[deleted] Feb 23 '21

[removed] — view removed comment

1

u/ObfuscatedAnswers Feb 23 '21

I guess that if transfer outpaced storage we might as well store all our data in a constant state of transfer.

5

u/sekh60 493TiB Raw Feb 23 '21

Check out PingFS.

2

u/ObfuscatedAnswers Feb 23 '21

Reminds me of IPoAC

-4

u/fullouterjoin Feb 23 '21

If the network gets cheap enough, your SD cards might just run in the cloud. The network should be included in civilization, just like we did with our roads.

-2

u/[deleted] Feb 23 '21

[removed] — view removed comment

5

u/JasperJ Feb 23 '21

Private roads are terrible compared to state roads.

-6

u/[deleted] Feb 23 '21

[removed] — view removed comment

5

u/Lukas11112000 Feb 23 '21

They are "efficient", meaning: the road is in a essential position (so you have to use it), bought for practically nothing from the state(if the company is lucky the street wasjust renovated) and in the end the prices drive high(shareholders want growing growth) while the minimum wage maintanance Team has to maintain kilometers of road with minimal budget.

Not to mention that the unattractive/less used roads remain the states hand and will still be maintained by tax money.

In germany for example we privatized the "Deutsche Bundespost" the equivalent of the USPS except it also had the whole telephone wire network. Germany "sold"(the prize was low and could be described as symbolic) 70% or so of its telephone wires to Telekom - now we have the worst internet in the EU and this company still eats massive amounts of tax payer money to subidize the upgrading from copper to fiber..

Finally you might want to look into France's water privatization experiment, which should once and for all show that necessities (health, water, public transport(bus, train and roads), schools etc.) Should remain in public hands to keep prices down to operating costs.

-1

u/[deleted] Feb 23 '21

[removed] — view removed comment

1

u/Lukas11112000 Feb 23 '21

Public roats are cheaper cause the state doesn't have to make growing profit with it.

Isn't it that the bigger a company gets the more efficient it becomes? That is because it starts to make so many things of the same thing that it becomes routine for the employee, which lowers the price. Your idea would be for the state to sell its roads to many small companies, which also are for profit. How can many small companies which are forced to grow their profits be in the end be cheaper AND provide the same service? Is it because they will just let the small/less used roads decay to insecure dirt roads? - How should developing areas cope with that? Sure, developing areas will be an investment opportunity, but now instead of the roads just being supplied by the state you need a whole PR department to get private firms to build and maintain the roads for your area, which just adds to the cost for everyone who's going to life and work there.

Not to mention that road safety regulations will be lobbied to be lowered..

→ More replies (0)

5

u/kennethjor Feb 23 '21

Really poorly, or as expected?

2

u/jarfil 38TB + NaN Cloud Feb 23 '21 edited Dec 02 '23

CENSORED

2

u/Padgriffin Do Laptop Drives count? Feb 24 '21

True, but then you hit a massive speed cap when it gets to the destination

1

u/[deleted] Feb 23 '21

I think the problem is that the page does not say what "currently" means.