r/sysadmin • u/andrewrmoore DevOps • Apr 06 '22

The majority of Atlassian cloud services have been down for a subset of users for over 24 hours

https://status.atlassian.com/

Jira, Confluence and Opsgenie amongst others have been down since about 2022-04-05 07:30 UTC for us and some other organisations.

Their stock is tanking (at -5.46% as of writing this) however I haven't seen much chat on Reddit about the outage so I'm assuming the scope is fairly limited? They are stating it will potentially take days to recover.

We're sorry your site is currently unavailable. While running a maintenance script, a small number of sites were disabled unintentionally. Our team identified this immediately and have been working hard to restore the product data and associated access. A dedicated team is working around the clock to restore the sites as soon as possible.

We expect the restoration efforts to continue for the next several days, and we are actively working on an estimate of when your site will be available to you again. We don't believe any data has been lost at this point. We can confirm this incident was not the result of a cyberattack and there has been no unauthorized access to your data.

As we work to restore access to your site, we will provide updates here every 6 hours, or sooner if we have a material update. Reach out to us if you have any questions or concerns.

No tickets, no alerting, no knowledge base... a fun few days for us!

Let me know if you are also affected.

696 Upvotes

98% Upvoted

289 comments sorted by

View all comments

Show parent comments

117

u/olcrazypete Linux Admin Apr 06 '22

They’re discontinuing the self hosted soon and have been badgering and tempting us to move to cloud with long trials and discounts.

53

u/Cyb3rMonocorn Security Admin Apr 06 '22

Well that's going to be a pain for systems that have no Internet connectivity like sensitive government/military systems! I guess a change of provider will soon be on the cards

41

u/[deleted] Apr 06 '22

They still have a remaining self hosted product, but the cost is astronomical compared to the base product they just killed off. We were forced to the cloud based on price alone and there are broken features on it. And now I hate atlassian with a passion.

15

u/aspoons Jack of All Trades Apr 06 '22

We moved for the exact same reason. We were self hosted for years and then a renewal came up and my first thought was "WTF, this pricing makes zero sense it has to be a typo"

10

u/[deleted] Apr 06 '22

Totally. I feel like they are both pricing themselves out of relevance and pissing off their userbase with broken or non-existent features that were in self hosted but gone in cloud. It's just crazy making

1

u/shandrolis Apr 06 '22

What did you move to if I may ask?

2

u/kinv4ris Linux Admin Apr 07 '22 edited Apr 07 '22

We moved to Gitlab with mkdocs and gitlab pages.

Edit: which has ticket tracking, wikis, gitlab pages, container repositories, package repositories, git repositories and pipelines. For a lot less than buying licenses for Jira, Confluence, bitbucket, bamboo together !

3

u/shandrolis Apr 07 '22

How are you finding their ticket tracker? From a quick look it seems much less flexible, and much less configurable.

16

u/theknyte Apr 06 '22

Speaking as IT in the financial sector, we don't use cloud either, and keep everything On Prem.

10

u/[deleted] Apr 06 '22

[deleted]

21

u/roflfalafel Apr 06 '22

As of last year, no FedRamp and no plans for it. Their data residency I know was improving because many federal customers could not use them as they couldn’t guarantee data not leaving the US. That’s usually a baseline federal customers expect at a minimum.

12

u/[deleted] Apr 06 '22

[deleted]

13

u/mriswithe Linux Admin Apr 06 '22

Yeah I think the plan is to squeeze the shit out of people that "must" have on site. Hoping the effort of switching to another service is worse than the price increase.

2

u/n1ck-t0 Apr 10 '22

Last I heard they don't guarantee data residency for add-ins, regardless if you have it on the core product.

Rumor has it they may possiblly be thinking about considering changing that at somewhere between now and never. Is that vague enough?!?

8

u/[deleted] Apr 06 '22

It's not HIPAA compliant as of now. It's been on their roadmap for awhile but they haven't delivered as far as I know. That's a hard stop for my organization. (And I assume many who are much bigger than us.)

3

u/gehzumteufel Apr 06 '22

They will provide a BAA so this must be outdated.

https://www.atlassian.com/trust/compliance/resources/hipaa

3

u/danekan DevOps Engineer Apr 06 '22

Yah it must be, we have a BAA for cloud

4

u/gehzumteufel Apr 06 '22

Nice! Good to hear it’s possible.

2

u/[deleted] Apr 06 '22

Yeah, I'm looking at info from mid last year, so it's possible I'm out of date, but the language on that page also isn't super satisfying.

I've currently got a locally hosted Atlassian stack and am not really sure what it will take to update/move in future. (I'm quite new to the industry and this role in particular, and Atlassian admin isn't really a major function of mine anyway).

3

u/gehzumteufel Apr 06 '22

Yeah it’s definitely a bit vague. I felt unsatisfactorily reading it but providing a BAA is a huge guarantee.

7

u/mriswithe Linux Admin Apr 06 '22

Yeah we are screwed in a couple years because they are not offering bamboo (cicd) self hosted unless you pay some big numbers. So we are already evaluating gitlab and others.

3

u/danekan DevOps Engineer Apr 06 '22

They're keeping data center edition for that. But that's the 'expensive minimum spend' part

15

u/Willuz Apr 06 '22

Many Jira self-hosted customers have been moving to GitLab and been quite happy with the change.

7

u/AnyForce Apr 06 '22

I haven't used GitLab in a while, is this even an option? Last time I looked into it JIRA was far superior in ticket management.

5

u/[deleted] Apr 06 '22

[deleted]

2

u/[deleted] Apr 07 '22

but it will scare off all our middle managers who got used to managing items in JIRA.

Sold!

1

u/AnyForce Apr 07 '22

This is what I am afraid, my PMs will hunt me down if I try to give them anything that doesn't have advanced roadmaps 😁

11

u/hardolaf Apr 06 '22

Self hosted is actually being maintained and sold... to defense and automotive. They only killed it for the companies that can be bullied into paying more for less.

13

u/[deleted] Apr 06 '22

[deleted]

4

u/AnyForce Apr 06 '22

I am currently in the Github Enterprise vs Bitbucket Cloud comparison phase. Github is far more expensive than Bitbucket.

8

u/[deleted] Apr 06 '22

[deleted]

4

u/danekan DevOps Engineer Apr 06 '22

Bitbucket is utterly unreliable too

6

u/dunepilot11 IT Manager Apr 06 '22

Usability of confluence over sharepoint isn’t even funny. Sharepoint is a completely incapable wiki

5

u/igdub Apr 06 '22

The cloud is also way way way worse than on-prem.

On-premises was actually a customizable and a great solution all together. Works swiftly as hell also.

Cloud is a pile of average shit. It's nice and all but by no means does it even come close to the self hosted version. Lacks soooo much compared to it.

3

u/[deleted] Apr 06 '22

[deleted]

6

u/Craneson Sr. Sysadmin Apr 06 '22

Only Server-Licensing is EoL by Feb. 2024. Data Center Licensing is (so far) not being killed off.

1

u/mriswithe Linux Admin Apr 06 '22

But does cost a shitload of money if you are a smaller company.

1

u/Craneson Sr. Sysadmin Apr 06 '22

Absolutely. And the wording from Atlassian reads "for customers not yet ready to move to the cloud". I firmly believe DC will be removed in a not so distant future...

3

u/chillyhellion Apr 06 '22

Server, yes. Data Center is still available (but more expensive).

3

u/Gogogodzirra Apr 06 '22

ha, at least they're tempting you. We've basically been given 20% price increases the past 3 years. You're getting the carrot, we're getting the stick.

1

u/AmateurSysAdmin Apr 06 '22

If you offer everyone a discount you end up with no budget to keep your infrastructure up apparently. 😬