Uber ADR (Agentic AI Detection and Response)
ADR (Agentic AI Detection and Response) is Uber's open-source enterprise security system for AI agents, covering discovery of unsanctioned AI tools on endpoints, telemetry capture of agent intent/tool-use/execution traces, a benchmark (ADR-Bench: 300+ tasks, 134 MCP servers, 17 agent attack techniques), and a dual-agent detector for risky agent behavior. It is deployed in production at Uber to secure employee-facing coding agents (Cursor, Claude Code, Codex, GitHub Copilot CLI, DeepSeek) and customer-facing support agents; the accompanying paper was accepted to MLSys 2026. The prevention component and offline red-teaming engine (ADR Explorer) are not included in the open-source release.
What it is
The open-source release of Uber's ADR includes four of the five described components — Discovery, Sensor, ADR-Bench, and the Detector — but not Prevention (stopping unsafe actions) or the offline ADR Explorer red-teaming engine that hardens detection pre-deployment. So this is an inventory + telemetry + benchmark + detection toolkit, not an enforcement product.
How it works
The default detector, adr, is a two-tier dual-agent design: high-recall triage first, then deeper agentic reasoning only on suspicious sessions. Running the real detector needs both an Anthropic and an OpenAI key. A keyless llamafirewall detector exists for smoke tests. Sensor observability covers 7+ AI coding tools across macOS, Linux, and Windows.
Preconditions / Affected
Relevant if you have employees running agents like Cursor, Claude Code, Codex, GitHub Copilot CLI, or DeepSeek Harness, or customer-facing support agents, and want visibility rather than blocking. Detection requires API keys (spend) unless you use the keyless baseline.
What to do
Setup:
git clone https://github.com/uber/ADR
cd ADR/Detection
uv sync
export ANTHROPIC_API_KEY="..." OPENAI_API_KEY="..."For a keyless smoke test, run with --detector llamafirewall (see Detection/README.md). The full evaluation workflow — inflate the packed benchmark, run detectors, plot figures — is in docs/REPRODUCIBILITY.md. Component entry points:
Discovery/README.md— endpoint inventory, probes, fingerprint catalogSensor/README.md— telemetry collection and unified schemaDetection/README.md— ADR-Bench, detector baselines, MCP infrastructure
Caveats
Apache 2.0, but Detection/benchmark/agentdojo/ is vendored MIT third-party code under its own license. The benchmark ships synthetic fixtures — fake credentials, emulated environments, prompt-injection scenarios — labeled for defensive research only (docs/OPEN_SOURCE_REVIEW.md). No enforcement/prevention is included, so ADR here detects and reports; acting on findings is on you.
Organisations named here
- MLSys 2026
Technologies named here
- ADR
- Cursor
- Claude Code
- ADR Discovery
- Codex
- ADR Sensor
- GitHub Copilot CLI
- ADR-Bench
- DeepSeek Harness
- ADR Detector
- Gemini CLI
- AI support agents
- llamafirewall
- ADR Explorer
- ADR Prevention
- AgentDojo
- Model Context Protocol
Techniques named here
- 17 agent attack techniques
- Prompt-injection scenarios
Related in AI Security
