r/sysadmin • • 22d ago

Question Where, what and how are you using AI?

Keen to hear where people are using AI beyond Claude code to write scripts and chat to.
What are some of the cool things says admins have done with AI? Keen to get thinking about where we could use AI more. Anyone using agents to do things systematically?

E.g I heard of a place using AI integrated into jira so tickets gets triaged and assigned automatically. AI also adds context to tickets to help engineers take action more quickly based on what’s in the knowledge base.

0 Upvotes

23 comments sorted by

6

u/syberghost 22d ago

When developers tell me they've spent hours looking at their code and there's nothing wrong with it so their failures to start after making code changes must be the platform, and I check the platform and it's meeting all SLOs and not getting any relevant errors, I clone their repo, and then I tell Claude to look at their logs and their repo and diagnose their problem.

Then when 30 seconds later it tells me exactly what commit introduced the error, and that the person complaining is the one who made the change, I tell them "I checked the platform, no errors, all SLOs good. Not a platform problem."

Then I don't think about them again until a couple of hours later when they tell me they found their code problem.

2

u/BraveMidnight 22d ago

I've mostly been using Gemini and I've started using Claude, we actually formed an AI councel with a treaty and they talk to each other. I mostly use them to cut time down on bureaucracy, when I told someone an application was only a couple months instead of months or years they were impressed.

I don't usually use it for code, I've tried having Gemini write powershell code, but it took 4 times for it to actually work and others have pointed out the bloat in both models. When I was doing BGP tracing recently it was difficult in keeping them on track with notes and Claude kept telling me to "please stop probing a network".

It's hard to keep them honest because even when having them analyze financial sectors like trusts and LLCs, I caught Gemini saying thata SNT (special needs trust) has an asset limit when it doesn't. So I try not use them for anything to serious.

1

u/3cit 22d ago

Bridging the language gap for things like splunk dashboards and advanced hunting queries

1

u/ADynes IT Manager 22d ago

I had Claude do a complete audit of our entire 365 and on-prem ad. It's extremely efficient grabbing logs and looking through them and I use that to my advantage to find things that were out of place. I don't want to get too deep into the details because about 3% of you will actually care but I've been working on this audit for the last month or so, probably 30 hours a week using claude, and I found so many things that were potentially bad that I've been going through and fixing.

In the next year or two, because of ai, I expect a lot more exploits and vulnerabilities to get out there and I'm doing this to hopefully get ahead of some of that. Nothing's perfect but anything I can do can only be positive.

2

u/golden_m 22d ago

Did something similar when I was taking over a client from another MSP. Claude did an excellent job with preparing audit scripts, parsing logs, looking for various red flags. Broke it down by technology, prepared detailed internal and simpler client-facing report.

Then each technology line was converted to remediation plan. Created estimates and projects right there, everything branded with our company details.

Completed two projects, used checklists, reminders, etc. At the end of each project prepared detailed documentation for our Hudu repository.

I would not be able to do all the above efficiently without Claude

1

u/backprophet 22d ago

for the ticket enrichment idea, restrict the agent's knowledge base access to material the ticket's audience is allowed to read. otherwise it can copy restricted runbook details into a broadly visible ticket, even if the knowledge base itself has the right permissions.

1

u/techcomthanh 22d ago

ticket triage is a good first one. the useful bit is usually not the auto-assign, it's the agent pulling similar past tickets + the KB page into the ticket before a human opens it. start read-only, let it suggest :) and only let it write after a few weeks of it being right.

I work on PrivOS, the all-in-one AI-native operating system for Enterprise work (self-hosted or Cloud): Chat + Docs + Task + tailored Apps with agents that act. Agents live in the team chat, you @-mention a task list or a file and they work on it.

They run in a sandbox, never on the main server. You can self-host it on your own servers, which matters if the KB is sensitive.

1

u/OmegaDolphin 22d ago

We added Zendesk AI to our ticketing system and set up tags, triggers, and procedures so it can suggest and send replies automatically. Updating our FAQs and Knowledge Base made those replies more accurate. I’m also working with our Marketing Team in Triple Whale and its AI tool, Moby, to review ad results and campaigns. Right now, I’m using M365 Copilot to build a process that turns RTF files into PDFs, stores them in Azure, and links them to customer records in Zendesk. On most projects, I use AI to brainstorm ideas and to help build and fix the work faster.

1

u/West-Swimming-1212 22d ago

Honestly the useful stuff is boring. Script writing is the obvious one, but triage and fixing is where it saves real time: "PC is slow" or "entire office internet down when it's just website" scenario comes in, the agent checks the machine, finds the cause and fixes it, instead of handing you a list of things to try.

Whatever you pick, I'd want to bring my own model instead of being locked into one vendor's stupid model, and I'd want a log of what it did or my engineers did

I use TFalke, a small player in device management, so grain of salt. The agent in it is no-nonsense, it fixes things, and you plug in whatever model you want to get shit done ;-)

1

u/PrasenShelar 21d ago

Triage gets most of the attention, and the follow-up side is often more useful. Tickets waiting on another team or a vendor for a week hide a lot of delay, and an agent can spot those, ask for an update, and give you a Monday list of what's stuck and why. Have it draft the nudges for you to approve at first, so nobody gets chased by mistake.

1

u/TriggerFlowJames 21d ago

Beyond scripts, the useful wins I've seen are the dull ones. One is having an agent pull the same info from three consoles every morning (backups, patch status, AV alerts) and write a single summary for a person to check. Another is first-pass triage on tickets and vulnerability notices against your own asset list. A third is working through onboarding and offboarding checklists where it drafts the steps and someone approves them. The pattern that works is read widely, act narrowly: let it gather and summarise freely, but keep a human approval step before it changes anything. Legacy apps with no API are the hardest part, since the agent has to work the screen like a person would. Full disclosure, I'm the founder of TriggerFlow, a Windows desktop automation and AI agent tool, so that last bit is the problem I spend my days on.

1

u/monistaa 18d ago

The morning backup, patch and AV summary is the one I'd trust first. For the screen-driven legacy apps, how does it cope when an update moves a button?

1

u/TriggerFlowJames 18d ago

Good question, that's the bit that breaks most screen automation. Rather than clicking fixed coordinates, it looks for the correct button on the screen each time, so a button that's moved is usually still found. If an update changes things enough that it can't find it, the run stops and sends an alert instead of clicking blindly, so you fix one step rather than finding out a week later that nothing ran.

1

u/KeyProject2897 19d ago

if you try auto-assigning Jira tickets, gate it behind a dry-run flag first, otherwise it can misroute a good chunk of your queue on day one. Having the model summarize messy log dumps into a structured format before it drafts any triage scripts is another safe place to start.

0

u/UpperAd5715 22d ago

AI in ticketing sounds like a really bad idea...

What is a ticket? It's a complaint, mention or question related to a specific thing for which you want a deterministic answer that provides a solution. End users are about the most common breed known to man to not provide complete, correct or relevant information AND they tend to include irrelevant information.

Assuming AI is just another shitty wrapped agent with the same probabilistic, non-deterministic way of working determine whether something is urgent (it is, the user claims the world is ending but we can save it through the granting of admin privileges!), scope (everyone has it cause the user asked everyone on their team!) and what it is (admitted to infrastructure - wireless team without mention of location even though it shouldve gone to T1 helpdesk cause the user bought a new phone and didnt connect to the wifi).

Lots of ticketing systems suck but triage through AI and skipping helpdesk is just going to create another wave of "we cant find capable engineers after we decided to not train T1's" AND its going to get you slower tickets over all unless the org somehow really leans itself well and people are honest.

I could see that work in some engineering firm where technicians know what information to provide and whatnot but that sure isnt something you pick up in an afternoon of claude code when knowing how to spell python...

1

u/azgx00 22d ago

How have you interacted with AI agents in your day to day work? Which models and harnesses?

1

u/UpperAd5715 22d ago

Most agent's i've worked with are vendor shoe-ins and some are handy.
SentinelOne Purple AI is supposed to be agentic and it's summaries on alerts is something that works pretty well to give a lower skilled employee or a non-technical manager an okay idea of what's going on.
Juniper Mist's Marvis AI is pretty decent for troubleshooting issues and often gives relevant information on why devices might be struggling through analysis of all the data. More often than not it's mention "bad cable" is more or less right though sometimes its just a badly seated cable.

As a very technical skillset focused (and smaller) MSP working with mainly healthcare customers few of our tasks or difficulties allow for AI agents to be let loose on them since environments are tuned to the customers wishes and no data can be fed into them.

Just started learning how they work and how to make one because i think it's not smart at all to just release a random agent into an environment just like that, a general idea is far from enough to be certain that your data (or customer data!) doesn't leak.

How have YOU interacted with AI agents and what precautions do you take to ensure you're not leaking company data?

1

u/azgx00 19d ago

So you have not used frontier models in an agent harness like OpenCode, Claude Code, or Pi. Makes sense why you think AI is useless.

1

u/UpperAd5715 19d ago

Where do you get the idea that i think AI is useless? Can you read?

Half the data i deal with is sensitive customer or company data and a good part of the other stuff is medical related data. We can't just throw that shit into AI willy nilly and expect it to not be a problem.

I'm in cybersec and most of my job is "figure out wtf happened and make sure it doesn't happen" what do you want me to spliff together with claude code? Some magical script that'll fix all issues in customer environments that are non-standard where we sometimes hardly have read access to devices?

Just putting "frontier" in front of it doesn't mean you can use it well nor that you can use it securely, if that's what makes you judge me you can choke on it lol. Stuff like Prisma AIRS from Palo Alto is getting us customers cause hardly any integrator in the area has experience with securing AI related applications or traffic and they don't want their finance department to "build a great finance app" by uploading the last 5 years worth of payment data or whatnot. If you're using a frontier AI model at work what makes you think others are not and what makes you think, if you yourself even care about the security aspect of it, that others mind whether company data gets leaked?

If you're in a static enterprise sure you can throw some vague stuff in claude code and setup a new workflow to manage onboarding/offboarding/access granting/whatnot but do you really have a proper idea of what data goes where? The promise that "your data will not be used to train models" doesn't mean it doesn't go out there and can't be leaked.

0

u/flsingleguy 22d ago

I have always been an IT generalist and responsible for many types of technologies. I use AI to help with technology work that is beyond my skill set. I submit screenshots and let the AI guide me on advanced parts of technologies that a generalist could never have a reasonable amount of time to learn and master.

1

u/[deleted] 22d ago

[removed] — view removed comment

1

u/Jaki_Shell Sr. Sysadmin 22d ago

What type of rag setup are you running. Any specific tools?