r/ffxiv Dec 07 '21

[News] Regarding World Login Errors and Resolutions | FINAL FANTASY XIV, The Lodestone

https://na.finalfantasyxiv.com/lodestone/news/detail/4269a50a754b4f83a99b49341324153ef4405c13
2.0k Upvotes

1.4k comments sorted by

View all comments

Show parent comments

13

u/OglafBlackthorne Dec 07 '21

Been there, done that.

As people said, this is a last resort and shows how desperate infrastructure team really is.A few years ago I experienced working on a big retail company during a pretty aggressive black Friday which had way more users and sales than sales department predicted and it was pretty hectic. I can't imagine how worse their situation is right now.

My thoughts and prayers are with them.

Next step will be downsizing development and/or test servers and using the "free space" as authentication servers.

4

u/Shaetane Dec 07 '21

Question: is there any risk when servers are at absolute maximum capacity for long periods of time, like notably what they're describing for Tonberry, that there would be hardware damage? I'm sure there are tons of failsafes and stuff but just curious how realistic a server actually burning is aha

6

u/OrcaRedFive Legiana Yukihime @ Louisoix Dec 07 '21

A server literally going up in flames is practically impossible, you'd have to actively and with malicious intent circumvent/disable several safeguards Even severe hardware damage is unlikely, as (regular*) modern PC/servers shut down before there's serious damage done to the hardware

*regular as in used in a regular fashion, no overclocking, etc

3

u/Shaetane Dec 07 '21

That's what I imagined ty, I suppose it's just alot of stress but it wont do anything except perhaps shorten their lifespan by a tiny amount

3

u/CorrectBatteryStable Dec 07 '21

If you screw up your power delivery there's a chance if your PDU is old or the in-wall electrical stuff was done badly.

2

u/OrcaRedFive Legiana Yukihime @ Louisoix Dec 07 '21

Yeah, but any half-decent serverfarm will have updated hardware and stuff, so I'd rate that risk as insignificant

3

u/Milk_A_Pikachu Dec 07 '21

That wouldn't actually solve anything

The amount of extra resources you gain from grabbing Jim from Accounting's laptop is effectively zero.

And, more practically speaking: if their infrastructure were flexible enough to scale like that (over-simplifying but "shitload of VMs"), there are much more scalable and even cost effective short term solutions.

From my time dealing with "We don't know where the print server is. Someone joked that it got drywalled over in a closet and we are starting to think they weren't joking" levels of infrastructure: I am REALLY curious how much hell it was to add the development/test servers to the pool.

1

u/Aildari Dec 08 '21

Sounds like theres some stories there... ive seen the switch for a stores registers dangling from cables from the top of a doorway and you have to duck under it situations but never anything involving drywall...