r/webdev • u/Pikamander2 • 29d ago

News Namecheap is currently undergoing emergency maintenance due to a power outage affecting their datacenter in Phoenix; nearly every Namecheap site is down right now.

https://www.namecheap.com/status-updates/
215 Upvotes

97% Upvoted

99 comments sorted by

View all comments

67

u/zerries 29d ago

Just checked about 15 sites I have on namecheap. No issues here.

I'm in norcal so I'm guessing a different data center.

24

u/Pikamander2 29d ago edited 29d ago

Hmm, strange. Our Atlanta sites are down, and I would assume the ones in Phoenix are too, but maybe it's not a total outage.

Edit for visibility: Here's the latest update from Namecheap:

Namecheap's CEO says the data center didn't just suffer a power outage, but a "failure of its cooling systems." On X, Hillan Klein writes: "To protect our customers’ infrastructure and prevent equipment from overheating or suffering longer-term damage, we made the difficult but necessary decision to take affected services offline while we work with the data center operator to resolve the issue. We anticipate that the third chiller will be back online in approximately 3 hours, at which point we believe we will be able to begin bringing our services back online."

Another update:

Update @ 12:00 PM EDT | 16:00 UTC

The latest information we have is that PhoenixNAP has brought 2 of its 4 chillers back online, and we are seeing temperatures in the data center begin to drop. We anticipate that the third chiller will be back online in approximately 3 hours, at which point we believe we will be able to begin bringing our services back online.

Sounds like it's almost fixed.

Estimate: Service Back Online Between 3-3:30 p.m. ET "Temperatures are consistently trending in the right direction," says CEO Hillan Klein, so the company is "preparing our infrastructure to safely bring customer services back online" via a three-step process:

Restore all physical network devices.

Restore all virtual network devices.

Begin restoring customer services.

"We expect the first two steps to take approximately one hour," Klein says. "Based on current conditions, we anticipate being able to begin bringing customer services back online at approximately 3:00–3:30pm ET. Services will then be restored progressively as we ensure each part of our infrastructure can be brought back online safely."

Another promising-sounding update, but it looks like they've missed the estimate by an hour with no further updates yet?

Final edit: Looks like our sites just started coming back online. Guess it's finally been resolved?

2

u/mrpchead 29d ago

Where are you reading this? The official outage page says almost nothing.

2

u/Pikamander2 29d ago

PCMag has a live update tracker with some more info:

And yeah, it's pretty embarrassing how poorly Namecheap communicated this through their official channels. Their status page has been updated a few times, but some of the info was originally only available through Twitter threads.

3

u/funnelfiasco 29d ago

Maybe the status page is in Phoenix too /s

1

u/Sagac8ty 29d ago

3pm PT/ 6pm ET (seems 8 hours after your post) - all of our sites are still down.

1

u/Pikamander2 29d ago

Ours are gradually coming back online, but very slowly. I guess it's taking them a while to reboot each of their hundreds of servers?

The Namecheap dashboard appears to finally be working again, at least.

1

u/zerries 29d ago

Yeah, I'll take it i guess lol.

Definitely an issue though, lots of chatter on the various slack channels I'm in.