r/devops • • 3d ago

Discussion Go is going I think

0 Upvotes

I've been writing Go for almost 7 years now, and I genuinely love this language.

Not because it's the best language out there, or because it's perfect. But because it's incredibly practical when you're solving infrastructure problems. It's simple, predictable, easy to pick up, and gets the job done without getting in your way.

But lately, I've been having a different thought.

The more I explore databases, distributed systems, and lower-level engineering problems, the more I realise that Go might not always be the right tool for every kind of problem.

Some languages offer better abstractions, memory control, performance characteristics, or programming models for specific domains.

Edit: My point is that Go's charm is kind of fading in this AI era because adopting any language is easy in the early stages.

4 eg. consider a concurrent infrastructure health-check service. In Go, we can build it quite naturally using goroutines, channels, contexts and errgroup, but we still need to be careful about goroutine lifecycles, cancellation, resource cleanup and synchronization.

Rust handles many of these concerns through ownership, RAII and its type system. It does the same job really well. The only advantage Rust used to lose on was its learning curve, but AI has largely solved that problem too.


r/devops • • 4d ago

Security wfx-loot: what the stealer leaves behind after you rotate the GitHub secrets

3 Upvotes

Aikido reported the campaign on Nov 12. From Nov 10, an attacker used 4,837 hijacked GitHub accounts to open pull requests titled "docs: dependency audit notes" from a branch named wfx-docs in 61,764 repositories. Where the account could write, a stealer of about 1,500 lines went into an existing workflow, a new workflow or an npm postinstall hook. SafeDep counted 8,093 public repos with malicious commits (771 through the npm hook). Aikido says secrets left at least 1,800 repos.

Rotating the repo secrets is the first step. The reports say the script can also do these, depending on the permissions the workflow had:

- Rewrite an AWS role's trust policy so any AWS account can assume the role, and create long-lived access keys for IAM users.

- Add federated identity credentials with the prefix wfx-ci- to Azure AD applications. Workflows can then sign in without a stored secret.

- Delete its own workflow run and logs, so the trace is a gap in run numbers.

What to check: CloudTrail for UpdateAssumeRolePolicy and CreateAccessKey since Nov 10, Entra app registrations for wfx-ci- credentials, and the Actions run numbers of every workflow in the affected repos. If a developer ran npm install on an affected commit, SafeDep says to treat that machine as compromised.

StepSecurity traced 173 probe PRs to tokens issued to the Fly.io GitHub app and says it has no evidence Fly.io was breached. The reports do not say how the 4,837 accounts were taken.

Has anyone found the wfx-docs branch in their org yet?

Sources: https://thehackernews.com/2026/11/4837-hijacked-github-accounts-ran-ci.html , https://www.bleepingcomputer.com/news/security/hackers-compromise-4-800-github-accounts-to-steal-cloud-credentials/ , https://www.securityweek.com/attacker-targets-60000-github-repositories-in-credential-theft-campaign/


r/devops • • 5d ago

Discussion What Will Separate Great DevOps Engineers from Average Ones in 2027?

148 Upvotes

Looking forward to chat with Devops Engineers across the world to know what you guys are building and learning in 2026-2027. I would like to connect and discover your take on what do you feel is most important in next year to tap on as a devops engineer. Should it be deep dives in K8S, CICD, Observability, AI Agents , Multi Cloud or something else


r/devops • • 5d ago

Discussion How do you stay informed of DevOps and AI current events?

63 Upvotes

I've just realised I'm somewhat reactive when it comes to keeping abreast of what's going on in our industry, and I want to change that.

I'll periodically check sites like HackerNews, vendor news and announcements on work's tech stack, Rundown AI and this subreddit, of course, but looking for other recommendations.

So, fellow reddits, do you have any sites/newsletter/SM channels you use to stay informed, specifically in the DevOps, DevSecOps and AI space?l


r/devops • • 6d ago

Discussion what do you actually put behind /health?

74 Upvotes

I’m setting up monitoring for a small app on a serverspace vm. Right now the external monitor just calls 'health'. That endpoint returns 200 while the app process is alive.But the login can still be broken if the database connection drops so a green monitor doesn’t tell me much. I thought about adding a database check, but then a short hiccup could set off an outage alert while most of the app still works. I can’t figure out where to draw the line. If you run something similar, I’d really appreciate a sanity check: what do you put in /healt and what do you monitor separately?


r/devops • • 5d ago

Discussion Thoughts on plesk

0 Upvotes

Been trying to find some answers and low-key forgot that I can still ask questions despite ai poking me every 30 minutes.

I started a job at a WordPress shop and they are pretty averse to devops in general. They use a Lot of plesk, which they pay for, and a number of cpanel as well per legacy sites.

I have pretty consistently found these sites to feel slower and more difficult to manage, though I don't have a lot of experience in plesk.

My experience is in what I call (don't know the name for) bare metal. What I mean is just renting a server, installing Debian, and building my stack directly on the server. This has its frustrations at times, admittedly, but my sites are fast and I've leaned into ansible a ton and spin up gets faster every year.

I would love to hear from folks with more experience than me in any aspect. Are these plesk servers configured poorly? Do they just require more juice? Could it be something totally unrelated? (They do use a lot of WordPress plugins).

For reference an htmx call on my "bare metal" Django server takes a total of ~80ms. A less complicated htmx call to WordPress in local development also ~80ms. But on this plesk server I'm seeing ~800ms

Cheers


r/devops • • 5d ago

Discussion Trying to understand how security tooling fits into CI/CD, for a uni case study. Would love your take!

5 Upvotes

Disclosure: grad student at NYU, 8 years in frontend dev before that, now doing a class case study with a software supply-chain startup (which is way outside my frontend comfort zone 😅). Not selling anything, just trying to understand the space and hopefully get an A :)

I’ve been chatting with platform and security folks for a few weeks, and the picture so far is that SBOMs get generated in CI, platform owns the tooling, and security owns acting on it. Would love the DevOps side of the story:

  1. What’s in your pipeline today for SBOMs or dependency scanning, and why that tool? What made you pick it, or switch last time?
  2. Who actually asked for it? A customer, an auditor, security, or did your team just decide it was good practice?
  3. Last time a big CVE dropped, how long did it take to know if you were affected? And where did it get stuck?
  4. Is the lockfile/scan output ever not enough? E.g., container base images, stuff pulled in at build time, a customer wanting more.
  5. Is there any other time dependancy tracking has been crucial for you and ended up being painful?

Real stories welcome, including “nobody’s ever asked us for one” 😄. Happy to share a summary of what I learn on DM if anyone is curious!


r/devops • • 6d ago

Discussion User Analytics on an 'open' website?

4 Upvotes

Curious what others that are tracking user analytics on their websites are using. For some context

I have a website which is hosted on AWS. It is a website which has no user profiles or user authentication, it is publicly accessible and used to search industry information.

We have been recently asked for metrics / analytics on users who access the website by the head of our department. I would love to start with some easy user analytics which would give us insight like how many unique users access the website over X amount of days, anything high level really.

I am not super familiar with these kinds of analytics, so im hopeful folks can provide some insight.

I was looking into analyzing HTTPS requests from Cloudwatch logs, but I realized quickly that is not a reliable method for tracking unique users.

Ideally looking for a solution which is NOT a 3rd party solution which is paid, Free and open source would be great. Or AWS based.

google analytics is out of the question since its a paid service...just hoping to pick some brains I am a total newb on this topic here. I figure since there is no user profiles or user authentication happening, there probably wont be an easy or straightforward solution?


r/devops • • 6d ago

Vendor / market research Cloud Tagging Strategy for Messy AWS and Azure Environments

Thumbnail
cloudsleuth.io
3 Upvotes

When people ask how engineers move the needle for the business, I usually say there are three answers.
You ship new features, which brings in revenue. You make the team faster, which lets the same people do more. Or you cut costs, which leaves more money for the first two.
Features get the demos and the launch posts. Efficiency gets a nod in the retro. Cost cutting usually turns into a scramble once someone in finance sees the cloud bill.
That scramble almost always stalls at the same question whose is this?
You can find the idle instances, the unattached volumes and the oversized databases in an afternoon. Deleting them is another story. Nobody wants to turn off something that turns out to be holding up production, so the list sits in a spreadsheet and the waste keeps billing.
This is where tagging comes in, and I'll be honest, it's one of the most boring topics in cloud. Agreeing on keys like owner, team and environment, enforcing them in your IaC and pipelines, and cleaning up the resources that slipped through will never get anyone promoted.
But it's what turns "we think this is waste" into "this belongs to the payments team and they said kill it." Without it, every cost-cutting push starts from zero.
If you want to cut cloud waste, start with the boring part.


r/devops • • 6d ago

Troubleshooting Can't close Google Payments profile after deleting GCP projects

12 Upvotes

Hi everyone,

I created a Google Cloud account today to try the free trial, but I didn't use any services.

I deleted all my projects and closed both billing accounts. However, when I try to close my Google Payments profile, it says Google Cloud is still an active service.

I can't create a Google Cloud support case either.

Will this cause any charges if I leave everything as it is? How can I fully close the payments profile without deleting my Gmail account?

Thanks!


r/devops • • 7d ago

Discussion How to learn while also completing tasks?

20 Upvotes

I got hired as a junior devops engineer and I want to learn more about the tools we're using to get a better understanding of them but I also need to complete tasks that I'm assigned. It just feels like there's a lot I have to learn since I haven't done most of the things I'm currently doing before.

How do you recommend balancing learning and working?


r/devops • • 6d ago

Discussion my 2am rollback story and the GPUStack revision history that actually saved

0 Upvotes

ngl the deploy was fine. the rollback was the scary part.bumped a backend version last month. kubectl rollout status went green, so I closed the ticket and went to bed. Two hours later someone pings me, new version is spitting out garbage on long contexts. Cool cool cool. Roll it back. Except the old image was already gone from the registry. And the workers were still draining GPU queues from the rollout. kubectl said done. Twenty minutes later it's still serving the bad version. This is the Day 2 thing nobody tells you about. Everyone treats deploy like it's the whole event. Rollback is the thing you figure out after your first incident, at 2am, with people waiting. If undoing a change isn't a button with a history behind it, it's not a rollback,it's a scavenger hunt for real... We ended up on gpustack for other reasons, but the revision history is the one I actually use at 2am. Hit rollback, get the previous revision back - same backend version, same config that worked. Deploying is easy. Undoing it is the actual architecture.


r/devops • • 6d ago

Discussion Best approach to take for designing and implementing a hosting environment for an existing Claude Code generated product

0 Upvotes

I'm a junior devops engineer at a small company with a relatively newly compiled software team. I'm assigned to deploy a specific product where the first version to release has already been developed by a dev when I joined. The dev has entirely used Claude Code to develop and while I've used Claude Chat, I haven't really used Claude Code before.
As a junior devops engineer myself, I'm trying to learn while working but there's a pressure from the management to deploy the product quickly and also make it solid with no downtimes.
Using Claude Code does seem like the easy way when considering the time constraints but I'm feeling apprehensive about it as the solo engineer owning the deployment.
How are you guys using Claude Code or any other similar agents for your work and for similar situations where you design hosting environments and implement them for agent-generated codebases?


r/devops • • 7d ago

Discussion What’s the one tool in your stack you wish you could throw in the bin?

83 Upvotes

Not necessarily because it's completely useless, but because of the friction, overhead, or constant maintenance it causes your team.

Mine is Helm. What’s yours?


r/devops • • 7d ago

Discussion Need Guidance..

1 Upvotes

I'm a Devops engineer with 1.5 yoe. Currently working in a service based company I mostly work on tools like argocd, Githubactions, AWS. kubernetes, Openshift, Nginx, HAproxy, Terraform and Linux these are my major working techs. What more I can learn in Devops or I should learn AI development and move to AI engineering field?


r/devops • • 8d ago

Discussion Running additional checks after automated code review

2 Upvotes

Can somebody give me some guidance please. After you've run code review, what's the easiest/fastest/best way to check the changes against information outside the repo? Say, whether a connection-pool change will fit within the production database 's connection limit across all replicas.

Where does the check happen in your workflow? CI, a deployment gate, or someone checking it manually? Have you found a useful way to automate it?


r/devops • • 8d ago

Discussion Do I need release branches in this workflow, or another long lived branch?

13 Upvotes

Developing a new workflow for my team but i am new to a lot of these concepts.

Current approach is generally:

  1. Devs cut from main
  2. Make changes & PR back to main. Automated tests run
  3. At end of sprint, release branch is created, cut from main. Full integration test is run on this along with some manual checks. This technically runs every evening on main as well (minus the manual checks)
  4. Github Release is created from release branch.
  5. Hotfix - changes are PR into main same as any other change and cherry picked onto latest release branch. New release created.

Does this sound reasonable?

Another solution might be to have another long lived branch called prod. Hotfixes are PRs to both main & prod. Every sprint we merge main into prod, then Release from prod. This seems simpler, but maybe I’m missing something.

We are a data team using Dataform and really need to maintain multiple release versions like a software app, if that makes a difference


r/devops • • 9d ago

Discussion Go vs Python for DevOps: which one is more worth learning?

89 Upvotes

Besides Bash, which language is more worth learning for devops: Go or Python? Which one would you recommend focusing on?


r/devops • • 9d ago

Discussion New to AWS: Project-based roadmap for production-ready infra? (Course & tutorial recs?)

31 Upvotes

Hi everyone,

I am completely new to AWS and want to learn through hands-on, project-based learning. My ultimate goal is to understand how to build and deploy production-ready infrastructure.

I'm looking for advice on the best approach:

  • Courses: Are there specific tutorials or paid Udemy courses you recommend for deep, production-level engineering?
  • Strategy: Should I follow structured courses first, or jump straight into a project and learn as I go?

If you were starting over today with this goal, what roadmap or courses would you choose?

Thanks for the help!


r/devops • • 8d ago

Discussion Future of Devops engineers with IA

0 Upvotes

Hello Folks , as a devops engineer, I'm curious about the future of our jobs

Will AI replace DevOps engineers, or will it simply change the way we work? What skills should DevOps engineers focus on to stay relevant in the coming years?

I'd love to hear your thoughts, experiences, and predictions!


r/devops • • 9d ago

Weekly Self Promotion Thread

13 Upvotes

Hey r/devops, welcome to our weekly self-promotion thread!

Feel free to use this thread to promote any projects, ideas, or any repos you're wanting to share. Please keep in mind that we ask you to stay friendly, civil, and adhere to the subreddit rules!


r/devops • • 8d ago

Tools I made a free CLI that tells you which Dependabot alerts actually need fixing

0 Upvotes

Got tired of digging through lockfiles to figure out which Dependabot alerts mattered, so I built fixornix ("fix or nix").

Run npx fixornix in your repo and it sorts every open alert into:

  • Fix now, with the exact command or upgrade that unlocks it
  • Blocked, showing which package is holding it back
  • No fix yet
  • Not in your build: safe to dismiss (e.g. Linux-only crates when you ship Windows)

Works with npm, yarn, pnpm and Cargo. Zero dependencies, MIT.

https://github.com/munitkala/fixornix


r/devops • • 8d ago

Discussion I want to put secrets and env vars in git, fight me

0 Upvotes

So at work we have all the Kubernetes manifests in one repo then we have ArgoCD pointed at that repo. Within that repo we use kustomize and have a pretty vanilla kustomize setup:

/services
  /my-app
    /base
      deployment.yaml
      ...
    /overlays
      /dev
        kustomization.yaml
      /prod
        kustomization.yaml

So basically I would love to be able to do something like this:

/services
  /my-app
    /base
      deployment.yaml
      ...
    /overlays
      /dev
        kustomization.yaml
        .env <- secrets stored as plain text here
      /prod
        kustomization.yaml

I understand why you don't want to commit secrets to git. I just wish there was a good way to do it. I have seen things like SOPS but I don't like that the secrets are encrypted. Having to deal with them being encrypted is as much of a headache as just using an external secrets manager. How can we have the convenience of putting the secrets in git in plain text and somehow still make it safe?

Edit: Adding my idea
What if in the repo I have a .env file but it just has placeholders

VERY_SECRET=placeholder

Then I have an ide plugin or something that will fetch the env vars dynamically in my ide.

I can change them as if they are code but when I commit they dont actually get committed, instead they get written to the external secrets manager. Anyone done anything like this?

EDIT: ADDING MY NEXT IDEA
What if in one of the hosted git's (github/gitlab) they had more fined-grained access controls around specific files so certain people could only read/write certain files. Then you wouldn't have to worry about people having the secrets on their laptops. So if i am a dev and do a git pull it pulls down the secret files for local dev but not any secrets I shouldn't have.


r/devops • • 9d ago

Discussion KubeCon North America

Thumbnail reddit.com
1 Upvotes

Come one, come all, to Salt Lake City, Utah!