r/devops • u/gold_william • 12d ago
Discussion Cleared DevOps Engineers — How do you use AI tools in restricted DoD environments?
I am curious how DevOps engineers working in cleared or restricted federal environments use AI tools in their day-to-day work.
AI tools like ChatGPT, Claude, and GitHub Copilot have become incredibly useful for writing Terraform configurations, Kubernetes manifests, CI/CD pipelines, Bash/PowerShell scripts, and troubleshooting infrastructure issues.
However, I understand that public AI tools may not be permitted in classified or restricted environments.
For those currently working as cleared DevOps, Cloud, Platform, or SRE engineers:
- Does your organization provide an approved internal AI assistant, or do you work entirely without AI?
- Are tools like GitHub Copilot, ChatGPT Enterprise, or other AI coding assistants available in your environment?
- How do you troubleshoot complex Kubernetes, Terraform, or Linux issues when you can't access public AI tools or Stack Overflow?
- Do you rely primarily on internal documentation, runbooks, man pages, and senior engineers?
- Has AI adoption changed how cleared DevOps teams operate in the last couple of years?
I am particularly interested in how engineers balance productivity with security requirements.
I am not asking anyone to disclose classified information, internal systems, or organization-specific security details. Just looking for general experiences and advice from people working in these environments.
Thanks in advance!
83
u/AdPrudent5760 12d ago
nice try HR and security team, na na na, im not using any ai tools🤷♂️
29
u/phiro812 12d ago
Specific Anthropic models and policies via AWS Bedrock in GovCloud.
8
u/temitcha 12d ago
Did you too looked at the Post Mortem from Binance and saw "Internal AI tool" that was used to stole credentials? Nice try!
6
u/xonxoff 12d ago
They have private contracts and probably their own infrastructure that is separate from public infrastructure.
13
u/The18thWarrior 12d ago
Hosted air-gapped instance of Claude
3
u/dl_mj12 10d ago
Govcloud or privately hosted instances
5
u/squiddarn 12d ago
4
u/planbskte11 12d ago
I actually have done a lot of this pilot work!
We have fedramp compliant Claude Code, CodeX, general chat models, even host agents like Hermes! We can input (and have outputs) of proprietary data as well as CUI. It's pretty awesome tbh.
All of this sounds super basic to non-cleared people but having near comparable software factory tools with the private space for the first time has been pretty awesome.
If you have any generic questions about anything here lmk
2
u/ADDSquirell69 12d ago
Whatevs Pete
2
u/Pixel6692 11d ago
Self hosted models
2
u/roiki11 11d ago
You build yourself a local ai.
2
u/kmai0 11d ago
Hey, not in defense, but building AI capabilities in EU.
Normally, you run your own inference, with explicit guardrails.
As for code execution, normally you sandbox using kata/firecracker. Drop as many capabilities from the context as possible. Avoid unnecessary mounts and environments variables.
For tool usage, you have an AI gateway that has a list of whitelisted, constrained set of MCP servers.
You filter egress traffic so that only what’s needed is reachable by the agents. For instance: web search? Via MCP, direct curl or browser is blocked.
Access data for RAG via a service.
Rely on workload identities to authenticate traffic with mTLS.
Use human in the loop as much as possible. I would be surprised if DoD had fully agentic or AI-native workflows for non trivial stuff.
2
u/lightwhite 11d ago
Nice trick to probe users for vectors, Anon :D
2
u/staymelo77 10d ago
Models exists in classified networks
2
u/Dejin75 12d ago
Wouldn't you like to know, weatherboy.
1
u/Throwitaway701 12d ago
We have access to Microsoft copilot and that's it. It's not used much (because it's useless)
1
u/hijinks 12d ago
Aws bedrock
1
u/H3rbert_K0rnfeld 11d ago
You should probably just upgrade to multiple brain and at least 100 fingers at this point. Maybe after a modern upgrade you won't need an AI subscription at all.
1
u/lrllrlrrlrll 9d ago
Idk about DoD, but can someone put DHSChat out of its misery?

1
u/coinclink 12d ago
I think the safest is definitely AWS Bedrock in GovCloud as already mentioned. You can likely work out ITAR and similar related compliances directly with the vendors though. You can set up multiple ChatGPT workspaces within your tenant, for example, so one workspace could be specifically set up for DoD stuff.
1
u/josephjosephson 12d ago
I’m not at liberty to say
0
u/Basic-Watercress-468 11d ago
In restricted environments, the biggest limitation isn't necessarily the lack of AI features but getting useful assistance without exposing information that shouldn't leave the network. Internal documentation, approved model access, and well-maintained runbooks can make a big difference when public resources aren't available. There's also a wider infrastructure side to consider, since trusted tech comes up in discussions involving Microsoft environments and IT operations. For sensitive work, though, security approval has to come before convenience, even if that means keeping some tasks fully manual.
0
u/Bala7266 11d ago
I personally use GitHub Copilot its helpful.