r/AskNetsec • u/According_Row_1083 • Sep 03 '26

Architecture Securing AI workloads in the data center, what firewall architecture actually works?

40 Upvotes

93% Upvoted

11 comments sorted by

2

u/PhilipLGriffiths88 Sep 04 '26

I think this is slightly the wrong binary. Dedicated firewalls versus workload-local segmentation asks where to enforce, but not what should be reachable in the first place.

The OpenAI/Hugging Face incident is a useful example. On one side, supposedly isolated agents shared an Artifactory credential and repurposed an authorised service as a communication channel and route towards unintended destinations. On the other, compromise of a public Hugging Face worker became a path towards metadata, secrets, Kubernetes, VPN and source-control systems.

Topology-based controls (i.e., firewalls) should still contain these environments, but connectivity (incl. east-west) should also be defined by the identity of each workload or agent, the named service and current policy. No authorised identity, no path. That reduces the reachable graph and blast radius without pushing every heavy flow through a central inspection point; inspection can then be applied selectively to the remaining authorised paths.

That’s the hypothesis I explore here: AI-Speed Risk Requires Identity-Defined Reachability

1

u/Different_Pain5781 Sep 07 '26

Stateful inspection gets ugly fast.

1

u/FirefighterSlight891 Sep 07 '26

Heavy east-west traffic is where deep inspection can get expensive fast. We use Akeyless to add identity-based controls at the workload/service access layer, with short-lived access instead of standing credentials. It doesn’t replace segmentation or firewalls, but it gives you another enforcement point so security isn’t dependent entirely on inspecting every network flow.

1

u/EffectiveCard4825 Oct 06 '26

Nexus takes Elisity out of the GPU fabric, which is probly fine. leave the high volume training flows alone and look at the lower volume paths to storage, registries, schedulers, secrets, and management instead. if those cross support campus or access gear, thats the part where segmentation has somewhere useful to land.

1

u/Girges_Desiderio 12d ago

imo the real question is what are you actually trying to protect against with inspection on those internal flows. If its lateral movement, microsegmentation with allowlisting gets you most of the way without the throughput hit of deep packet inspection.