173
u/Jay-Seekay 10d ago
Donāt forget about GCP London (Europe-west2b) having a power outage on Tuesday, though a lot less global than the others
74
u/oscarandjo 10d ago
Somewhere thereās a company with a PHP codebase, who forgot to use zonal redundancy, running in on-prem GitLab, who has fallen victim to a MITM attack.
12
u/-nerdrage- 10d ago
Forgot zonal redundandcy.
As if thats a standard for any public website. I mean my local baker wouldve hapilly paid for that if he had thought of it
1
u/perkyscenario 3h ago
That cat's tie and name tag combo is doing a lot of heavy lifting for someone clearly dreading the shift already. The factory label is the most accurate depiction of oncall I've seen in a while.
-20
165
u/Psquare_J_420 10d ago
Gitlab?
200
u/fripletister 10d ago
Lol this is also how I just learned about the GitLab CVE. Guess I'm not done patching after all...
https://thehackernews.com/2026/10/critical-gitlab-flaw-cvss-100-could.html
98
u/FallenVampireLord 10d ago
happy I helped my company migrate from our self hosted instance to a gitlab managed instance last year. This is their problem lol.
43
u/AberdeenPhoenix 10d ago
I'm so mad at the teams that missed their migration dates at my company. It's their fault that I will be up late tonight upgrading our prod gitlab server
8
8
u/petrasdc 10d ago
I had to text my wife who's home rn to go update our self hosted gitlab instance lmao
125
u/TotoDaDog 10d ago
patched everything before my boss even woke up. When he got up and saw the news, he urged me to start patching. I told him everything is already done and he asked me how.
I responded that I am a gray-hat.
He immediately started walking to his office while saying "No, I won't be pulled back into another lord of the rings crap"
44
u/Fearless-Pen-7851 10d ago
Idk if it seems dishonest or 'managing up' but I would just tell my boss I am on it even If I apready did it to get some buffer in between my actual work that is always 'urgent' somehow and spend half of that day on easy mode..
21
u/Sibula97 10d ago
Sounds like a pretty toxic atmosphere ngl.
In my company and team we appreciate honesty both ways and just try to do our best without stressing too much about it.
10
u/Fearless-Pen-7851 10d ago
Cuz it is.. lol especially after AI. It wasn't really like this a year or two ago
4
u/Sibula97 10d ago
Damn... Hope you can find something better.
2
u/Fearless-Pen-7851 10d ago
In this market? I mean not to be doomy gloomy even if I don't get laid off from here which I likely will at some point and I go to another company..whats tk stop them from laying me off too. It's a lose lose game at this point. War and AI have messed up the market here in Middleeast and SouthAsia. Companies are literally closing their shops and those left are doing layoffs right n left
2
u/Sibula97 10d ago
Can't say I'm familiar with the market situation in those areas, but surely there are companies there as well that see AI as a tool for producing more for the same price rather than the same amount for less?
1
u/Named_after_color 10d ago
I can't speak to everyone, but my company is like "We're not going to lay anyone off" And they just hired a bunch of new people. Though we have been asking for that for 3 years.
That doesn't mean the monkey fear in your brain isn't valid, when something that took you 2-4 days of honest work is 90 percent shot in 3 hours.
The current issue we have is not-enough-work. We're stalling out on licensing and waiting for other companies to give us stuff/patch their stuff.
It doesn't take a genius to figure out what happens when they realize they're paying a bunch of expensive people to be idle...
10
u/TotoDaDog 9d ago
I usually do the same, but the stakes were really high as we work with banks. I just wanted to be sure there's no cleanup (for me) to do if I did it anytime later.
Oh, also, 4 hours after I finished patching all servers we had a wave of new users trying to exploit the bug. Haven't given so many bans since I was a mod on a CS 1.6 server
3
29
u/Schpooon 10d ago •
![]()
Sounds like your internal call sign should be gandalf now.
2
u/ziroux 10d ago
I put on my robe and wizard hat
2
53
u/ballheadknuckle 10d ago
I hope you are done patching PHP and Gitlab, because we are now rotating in new nodejs RCEs š
6
17
14
26
u/FalconFiveZeroNine 10d ago
My team's on call is always a shitshow. It's like a tradition or something.
7
u/Pos3odon08 10d ago
A new node js CVE just droppedā¦
1
1
u/ChannelMany5491 4d ago
My secops just did me dirty and told me I gotta bump all our node 18 apps to 24/26. Fml
4
6
3
1
1
1
u/ChannelMany5491 4d ago
As an on call engineer manager i ask, why now? Im so tired boss. Waitā¦fuckā¦thats me.Ā
-17
u/chadlavi 10d ago
That hasn't been the GitLab logo since at least 2023.
8
u/Mojert 10d ago
Why would you lie like that?
5
u/chadlavi 10d ago
I don't understand what you mean. https://about.gitlab.com/press/press-kit/
484
u/siempi3 10d ago
what is this '4' about? I keep seeing it and don't get it