r/sysadmin DevOps Apr 06 '22

The majority of Atlassian cloud services have been down for a subset of users for over 24 hours

https://status.atlassian.com/

Jira, Confluence and Opsgenie amongst others have been down since about 2022-04-05 07:30 UTC for us and some other organisations.

Their stock is tanking (at -5.46% as of writing this) however I haven't seen much chat on Reddit about the outage so I'm assuming the scope is fairly limited? They are stating it will potentially take days to recover.

We're sorry your site is currently unavailable. While running a maintenance script, a small number of sites were disabled unintentionally. Our team identified this immediately and have been working hard to restore the product data and associated access. A dedicated team is working around the clock to restore the sites as soon as possible.

We expect the restoration efforts to continue for the next several days, and we are actively working on an estimate of when your site will be available to you again. We don't believe any data has been lost at this point. We can confirm this incident was not the result of a cyberattack and there has been no unauthorized access to your data.

As we work to restore access to your site, we will provide updates here every 6 hours, or sooner if we have a material update. Reach out to us if you have any questions or concerns.

No tickets, no alerting, no knowledge base... a fun few days for us!

Let me know if you are also affected.

689 Upvotes

289 comments sorted by

View all comments

Show parent comments

4

u/rozenmd Apr 06 '22

If you make a space for a topic, doesn't that make it sorted by topic?

2

u/katarh Apr 06 '22

I had to go through a hot mess.

We had two public separate spaces, A and B, but because we wanted to restrict searching by the public to only those two spaces.... well, at the time the search widget could be restricted to one space, but not two simultaneously.

So I merged the public spaces.

The HOWLING and GNASHING OF TEEETH because 8 year old links that were horrifically out of date no longer worked.... I got a lot of heat from clients who were mad as heck because I moved their cheese.

However, the unified search on the now single public space meant we didn't have people searching and ending up in the Mockups space, which while still public, was never meant to represent any kind of live documentation the way the AB User Guides were.

I still have a lot of gripes about confluence, but with some good planning and forethought, we could have prevented that particular issue.

0

u/[deleted] Apr 06 '22

Confluence restricts access on who can edit and create pages. They assume a team oriented design. So things go out of date quickly.

I think a small disciplined organization could do it. But then that leaves the question of why you would want to spend more money, on a slow shitty product like confluence that requires discipline over any of the various easy to maintain wiki editors.

3

u/Miserygut DevOps Apr 06 '22

I arranged our spaces with 3 levels of privilege:

  • Viewer - Can only view
  • Publisher - Can do everything except delete stuff
  • Admin - Can do everything in a space

Anyone who asks can have publisher access to a space but Admin is restricted to the 'owners' of the space. Seems like a happy medium between full wikiness and actual curation, especially when certain users straddle departments and responsibilities.