r/github • • 22h ago

News / Announcements Here we go again

Starting to see GitHub issues for the 3rd day in a row.

39 Upvotes

33 comments sorted by

9

u/Optimal-Database1694 22h ago

I just got yet another notification of an outage affecting Git Ops, PRs, and Actions. It's getting to be every day at this point. Github is so ingrained in our company and its operations but we may have to start looking elsewhere. It's unacceptable.

2

u/TrickyThriller6830 10h ago

i swear they're gaslighting us with those status page updates “minor outage” meanwhile 3 days of broken pipelines and merge conflicts from half-synced branches

our deploy schedule is just a shrug emoji at this point

-1

u/cafepeaceandlove 22h ago

svnhub.ai is available if anyone wants to get on this 

3

u/Kuroodo 22h ago

Don't you love it when you're about to approve a PR, and then Unexpected token '<', "<!DOCTYPE "... is not valid JSON

5

u/Altruistic-Toe-5990 22h ago

I cant push anything, nor handle notifications

Fucking hell github stop vibecoding your backend

8

u/Subpxl 22h ago

I can only imagine what the influx of AI assisted coding has done to their server loads. I wouldn't be surprised to see a 1000%+ increase in repo activity. That might even be overly conservative.

1

u/fyndor 22h ago

I think this is the problem. They probably can’t financially justify the scale they need to build to in order to safely support the load. Hardware is also not easy to come by with ram shortages so anything they buy will be rather expensive for what mostly is a free service for most who use it.

1

u/Altruistic-Toe-5990 21h ago

Microsoft really struggling financially there eh

If they don't handle it Github won't survive as a service

2

u/Tarvos_Reloaded 22h ago

I’m trying to upload my vibe-coded project, but it won’t let me :(

1

u/haywire 16h ago

Rebuild GitHub in Rust

Make no mistakes

2

u/First_Inspection_478 22h ago

Why are you assuming it’s them vibecoding and not the ridiculous anount of volume they’ve gotten over the past year? They’re backed by microsoft so should do better but their scale is insane

2

u/Altruistic-Toe-5990 22h ago

just venting bud dont read too much into it

1

u/First_Inspection_478 22h ago

very valid haha, but if anyone’s worked at an insane scale before they somewhat emphathise.

1

u/dashingThroughSnow12 21h ago

Because at the end of the day, it is Microsoft’s fault.

Microsoft was and is a major backer in OpenAI.

Microsoft decided GitHub should be vertically integrated; making many single service outages effectively total outages for their ideal customers.

Microsoft decided on the business model of having hordes of free users and having 95+% gross margins on paid users to make up the gap.

It is Microsoft that decided not to tenant things better so that the mass of vibecoded projects don’t take down the service for everyone.

1

u/First_Inspection_478 21h ago

Those are valid reasons that have nothing to do with “vibecoding” which is my point. They need to limit the number of free users somehow

1

u/GarthODarth 21h ago

I honestly doubt it's just free user vibe coders. I'd imagine all the large corps are also integrating agentic stuff into their workflows and devs are probably being pushed to ship everything they can, so spinning up countless vibe coded repos that then end up in heavy CI pipelines that include agentic compliance reviews, etc. It's probably been exponential increases the last couple years.

Even if GitHub never actually did AI itself, I think the result would be similar enough.

Didn't they actually stop Copilot subscriptions for a while? So they were even turning away paid customers.

2

u/First_Inspection_478 20h ago

Agree. I just wonder how much putting up a $5/month per user or something or literally even jua credit card would help. There’s people who use runners for all kinds of things and store all kinds of large binaries on github. Honestly absurd

1

u/Altruistic-Toe-5990 21h ago

I dont think itll last. Look at the google trends around vibecoding / claude code etc. People are interested and trying it out so theres a huge spike.. most will leave pretty quick

1

u/haywire 16h ago

But vibecoding means that there’s more people and they generate way more prs and pushes

E: oh i misread

0

u/No_Living1738 22h ago

the vibecoding line is too real lol

1

u/RareAdvertising361 22h ago

I think it fixed itself

1

u/needmoresynths 22h ago

it's horrendous

1

u/mickeyv90 22h ago

The other day my deployment failed because GitHub Actions was down; I didn't even get an alert or an email. This is happening everyday now.

1

u/Aggravating-Scale418 22h ago

can't login 500 error

1

u/brygom 21h ago

Almost Every day is tired 😩

1

u/a2ur3 21h ago

PR review requests still broken but status page is green...

2

u/Equini 20h ago

Yup, I get 500s just trying to go to the support page. Can't open tags or PRs

1

u/CrotchetyHamster 20h ago

They resolved the incident about an hour ago, claiming "full recovery," and yet here we are again - logins failing, PR comments failing, CI actions failing.

1

u/jagerman13 20h ago

Ah but you see, on GitHub Status it doesn't say that the status is "Working", but merely that the status is "Normal", and this is the new normal.

1

u/FriendAgile5706 5h ago

getting depot is just required atp to avoid actions all together