Skip to content

Back to the catalog

AI-Assisted Vulnerability Management
cloud.google.comarticle

AI-Assisted Vulnerability Management

Mandiant/Google Threat Intelligence Group blog outlining a blueprint for safely integrating LLM agents into vulnerability management: defense-in-depth guardrails (input sanitization treating codebases as untrusted, sandboxed workload isolation, JIT scoped machine identities, toxic flow analysis for runtime exfiltration monitoring), a risk-based vulnerability management scoring formula combining CVSS, asset context, and EPSS/threat intelligence, and a "binary vs architectural oracle" framework explaining why AI agents excel at memory-corruption bugs (crash/no-crash feedback) but struggle with authz bypasses and business-logic flaws. It also covers IDE vs CI/CD remediation workflows, post-deployment controls like model pinning and immutable audit logs, and a longer-term push toward memory-safe language migration (e.g., C/C++ to Rust) using LLM assistance.

TL;DR Mandiant's blueprint for safely deploying AI agents in vulnerability discovery/remediation, covering guardrails, RBVM scoring, and where LLMs succeed vs fail at proving exploitability.
Document

What it is

A Mandiant Consulting blog by Jules Czarniak giving operational guardrails for deploying privileged LLM agents into codebases, dev environments and CI/CD pipelines for automated vulnerability discovery and remediation. The existing summary lists the framework references and controls; below are the specifics it omits — the driving metric, the provider constraints, and the layered/ordering details that change how you'd actually stand this up.

Why now

Per the cited M-Trends 2026 report, mean time-to-exploit (TTE) has dropped to -7 days — vulnerabilities are often exploited roughly a week before a patch exists. That negative window is the stated justification for automating discovery/remediation with agents at all.

What to do

Beyond the controls already in the catalog summary, the page specifies:

  • Zero data retention (ZDR): enforce strict ZDR agreements with LLM providers so proprietary code and discovered vulnerabilities are never used to train external models.
  • Clear the AUP hurdle first: many cloud/LLM providers block or throttle automated offensive security probing by default. Establish rules of engagement and authorized-testing agreements before pointing an agent at a target.
  • Red-team the agent itself before deploying autonomous scanners that spin up sandboxes and execute code — validate resilience against jailbreaks, recursive logic loops and prompt injection so the security tooling doesn't become the attack vector.
  • Two-layer defense, in order: Layer 1 = deterministic policy engines as chokepoints; Layer 2 = reasoning-based guard models (Model Armor or provider-agnostic equivalents). Enforce data security before the prompt reaches the model.
  • Non-production + synthetic data for all testing; agents should not reach PII/PHI at all.
  • JIT tokens scoped to the exact repo and branch under review, tied to a distinct machine identity that maps back to a human controller for accountability/consent — so a compromised container cannot pivot to adjacent codebases.

How the trust boundaries stack

flowchart LR
  A[Untrusted input:\ncode, comments, deps, MCP] --> B[Layer 1\ndeterministic policy]
  B --> C[Layer 2\nguard model]
  C -->|clean| D[Agent in\nunprivileged sandbox]
  C -->|injection/PII| X[Blocked]
  D -->|JIT token,\nrepo+branch scoped| E[PR / commit]
  D -.runtime.-> F[Toxic flow analysis\nmonitors exfil paths]

Caveats

This is architectural guidance from a consulting practice, not a tool or reproducible procedure — no code, versions, or benchmarks. The fetched text is truncated mid-sentence in the Toxic Flow Analysis section, so the TFA detail is incomplete. The named frameworks (SAIF, NIST AI RMF, OWASP Top 10 for LLMs) are referenced, not reproduced; you'd still need to consult them to operationalize.

Organisations named here

  • CISA
  • CMMC
  • FAIR
  • FedRAMP
  • PASTA
  • PCI DSS
  • SAIF

Technologies named here

  • Model Armor
  • Wiz
  • CodeMender
  • LangChain
  • AutoGen
  • SAST
  • DAST
  • EDR
  • SOAR
  • External Attack Surface Management
  • Cloud Security Posture Management
  • Continuous Threat Exposure Management
  • Google Assured Open Source Software
  • Identity-Aware Proxies
  • Mandiant Threat Modeling Security Service
  • CVSS
  • EPSS
  • Model Context Protocol
  • NIST AI RMF
  • OWASP Top 10 for LLM Applications
  • SLSA
  • SOC 2
  • EU AI Act

Techniques named here

  • Indirect prompt injection via source code/dependencies
  • Malicious prompt injection
  • Supply chain poisoning of MCP/skills
  • Session memory poisoning
  • Recursive loop hijacking
  • Data exfiltration via agent tool use
  • Memory corruption
  • Authorization bypass
  • SSRF
  • Contextual narrowing during SAST-prompted LLM triage
  • Attention degradation over long context