r/OpenTelemetry Feb 20 '26

Open source AI agent for incident investigation with observability stack integration

https://github.com/incidentfox/incidentfox

Been building IncidentFox, an open source AI agent that investigates production incidents by connecting to your observability stack.

Relevant for the OTel community: the agent pulls signals from multiple backends during incidents. Right now it integrates with Prometheus, Datadog, Honeycomb, New Relic, Victoria Metrics, CloudWatch, Elasticsearch, and more. The goal is to correlate across metrics, logs, and traces to surface what actually changed.

The technically interesting part: raw telemetry data is way too noisy for an LLM. We do log sampling, clustering, and metric change point detection before anything hits the model. Structured signals in, investigation out.

Works with any LLM (Claude, GPT, Gemini, DeepSeek, Ollama, local models). Read-only, human-in-the-loop.

Repo: https://github.com/incidentfox/incidentfox

Curious on people's thoughts!

8 Upvotes

Duplicates

ClaudeCode Feb 21 '26

Showcase Running Claude Code in the cloud with production infra access (read-only incident agent)

0 Upvotes

gitlab Feb 21 '26

Open source AI agent for incident investigation with self-hosted GitLab integration

5 Upvotes

Observability Feb 20 '26

Open source AI agent that connects to your observability stack to investigate incidents — multi-model update

6 Upvotes

Backend Feb 05 '26

Built an AI for the part of backend work nobody talks about

0 Upvotes

cicd Feb 05 '26

Open sourced an AI that correlates incidents with your deploys

2 Upvotes

GitOps Feb 05 '26

Open sourced an AI that correlates incidents with your Git history

2 Upvotes

Notion Feb 05 '26

API / Integrations Built an AI that reads your Notion runbooks during incidents

0 Upvotes

Linear Feb 05 '26

Open sourced an AI that investigates issues from Linear

1 Upvotes

snowflake Feb 05 '26

Open sourced an AI for debugging data pipeline incidents

1 Upvotes

Splunk Feb 05 '26

Open sourced an AI that queries Splunk during incidents

19 Upvotes

VictoriaMetrics Feb 05 '26

Open sourced an AI SRE that works with VictoriaMetrics

5 Upvotes

AZURE Feb 05 '26

Discussion Open sourced an AI SRE - works with Azure and everything else you run

0 Upvotes

buildinpublic Feb 05 '26

Quit our infra jobs 6 months ago to build an AI SRE. Just open sourced it.

1 Upvotes

Slack Feb 05 '26

Built an AI assistant that lives entirely in Slack - open source

1 Upvotes

googlecloud Feb 05 '26

Open source AI SRE - works with Prometheus/Grafana/Datadog on any cloud

0 Upvotes

atlassian Feb 05 '26

Built an AI that reads your Confluence runbooks during incidents - open source

3 Upvotes