Skip to content

83 results for “Safe”

What you seeeverything
  1. GPT-Rosalind-6 System Card Addendum

    GPT-Rosalind-6 System Card Addendum is OpenAI's safety documentation for a life-sciences model that shares weights with GPT-6 Astra. It rates the model High in Biological and Chemical and Critical in Cybersecurity under the Preparedness Framework. It reports biology evaluations, trusted-access controls, biosecurity refusal pass rates, a historical cyber jailbreak regression (14.3% task success), and sabotage and monitor-evasion results.

    deploymentsafety.openai.compaperPublished and added 30 Oct 2026🛡️ Security

  2. The Athlete as a Scientist of One: Agentic Bayesian Experimental Design for Individualized Physiology from Consumer Wearables

    EpiCoach is an agentic system that treats one cross-country mountain biker as an N-of-1 experiment. Claims live in an evidence-gated hypothesis registry, and each must make a probabilistic prediction before a session. Predictions come from a digital twin fitted to heart rate, GPS and altitude. In a replay over eighteen months the twin beat standard forecasters on heart rate but not segment time, and the agent loop matched a static model. In the first three live weeks, the ledger sealed 20 predictions and scored 14, and a safety officer vetoed the agent twice. The registry, benchmark and protocol are released.

    arxiv.orgpaperAdded 31 Oct 2026, published 29 Oct 2026🧠 AI

  3. Secure Transaction Verification and Authorization (STVA)

    Secure Transaction Verification and Authorization (STVA) is a draft Standards Track ERC (created October 2026) by @MATOBOYCRYPTO65. It proposes structured human-readable metadata and semantic intent for transactions and UserOperations, an independent simulation and verification interface, and scoped, revocable capability tokens for privileged operations. It targets blind signing and frontend supply-chain attacks, citing the February 2025 Bybit Safe multisig theft. The page gives only the abstract, motivation and core concepts.

    ethresear.chpaperPublished and added 28 Oct 2026🛡️ Security

  4. AK_QMUL at ArGuard Shared Tasks: A Single Fine-Tuned JAIS for Arabic Harmful-Prompt Detection

    AK_QMUL's system for the ArGuard-2026 shared tasks fine-tunes JAIS-6.7B with 4-bit QLoRA and a linear head on the last-token representation. For binary safe/unsafe detection (B1) it uses a four-way head over dialect register and AraSafe MSA augmentation, reaching macro-F1 0.984. For seven-way harm domain (B2) it averages five seeds, reaching 0.790. Both ranked first. Bully is the weakest class.

    arxiv.orgpaperAdded 28 Oct 2026, published 26 Oct 2026🧠 AI

  5. Then there is prompt injection, a malicious email, ...: The Wild Wide West of OpenClaw Agentic System Security

    An empirical study of security concerns in the OpenClaw AI personal assistant framework, using 25K+ posts from 13 subreddits (162 security-relevant) and 358 security-tagged GitHub issues (180 retained). It maps 521 CWE instances across 59 weakness types, concentrated in access control, sensitive-data exposure, injection and unsafe execution. It extracts 543 practitioner mitigations into seven strategies and reconstructs a sensitive-data exposure path with dummy secrets.

    arxiv.orgpaperAdded 28 Oct 2026, published 26 Oct 2026🛡️ Security

  6. Scope-Gap Injection: Exploiting Evaluator Channel Blind Spots in the OpenClaw Agent Security Competition

    Scope-Gap Injection (SGI) is an indirect prompt injection method for multi-stage LLM-agent safety pipelines, tested in the IJCAI 2026 OpenClaw Agent Security Attack Competition. The visible task and skill stay benign while target identifiers, bypass parameters and authorization steps sit in an attachment written as a business worklist, which the S2 LLM judge appears not to inspect. SGI bypassed all three stages (static scan, LLM judge, live audit) for 5 of 19 targets, best F = 0.385. Attachment placement had 78% S2 acceptance versus 23% in-skill. The paper closes with defenses that align evaluator scope with agent channels.

    arxiv.orgpaperAdded 27 Oct 2026, published 26 Oct 2026🛡️ Security

  7. SentryBench: A Cost-Sensitive Benchmark for Adversarial Robustness of Tool-Using LLM Agents in Public-Safety Deployments

    SentryBench is a benchmark for tool-using LLM agents in public-safety deployments. It scores attack success, over-refusal (missing a real emergency) and over-reaction (unwarranted action) on a cost-sensitive frontier, using real emergency-call transcripts, disaster messages and injection payloads. Across 840 episodes on three frontier models and three defenses, refuse-more caution pushed over-refusal to 100 percent on two models, while a trust-gating wrapper gave the lowest harm.

    arxiv.orgpaperAdded 27 Oct 2026, published 25 Oct 2026🧠 AI

  8. SentryBench: A Cost-Sensitive Benchmark for Adversarial Robustness of Tool-Using LLM Agents in Public-Safety Deployments

    SentryBench is a benchmark for tool-using LLM agents in public-safety settings (public alerts, responder dispatch, citizen-record queries). It scores attack success, over-refusal and over-reaction on a cost-sensitive frontier, using real emergency-call transcripts and real injection/jailbreak payloads. Across 840 episodes on three frontier models and three defenses, refuse-more caution raised over-refusal to 100 percent on two models, while a trust-gating wrapper gave the lowest harm on every model.

    arxiv.orgpaperAdded 27 Oct 2026, published 25 Oct 2026🛡️ Security

  9. Task Format as a Factor in Adaptation: A Controlled Comparison of LoRA and Full Fine-Tuning for Prompt-Safety Classification

    This paper compares LoRA and full fine-tuning for prompt-safety classification using a matched 400M encoder-decoder pair (Ettin) across three task formats, with up to 15 seeds per cell and pre-specified analyses. Full fine-tuning leads LoRA by 2-3 pp at the pre-specified learning rates, and the encoder gap closes when both use the same learning-rate search. Training LoRA to write a reason after its verdict adds 4.0 pp, while a content-free sentence of equal length does not. Trained models beat a prompted 8B in domain but trail it by 8-23 pp on adversarial jailbreaks and over-flag benign prompts (27-66% against 2-3%).

    arxiv.orgpaperAdded 27 Oct 2026, published 24 Oct 2026🧠 AI

  10. Reproducible Evaluation as the Substrate for Safe Prompt Compression in Production Agents

    This paper presents an offline evaluation harness for a production merchant-facing conversational agent. It stays reproducible when live backend data changes and can be regenerated when it goes stale. Used as the fitness function for GEPA prompt optimization under a correctness gate against reward hacking, it shrinks the full prompt surface by 3.5-7.6% without losing held-out correctness, across three subject-model families.

    arxiv.orgpaperAdded 26 Oct 2026, published 22 Oct 2026🧠 AI

  11. EpiSEM-Bench: Evaluating Safety and Evidence Recovery in LLM Agents under Missing Evidence

    EpiSEM-Bench is an executable benchmark of 300 matched unsafe/safe task pairs across six domains. It tests whether tool-using LLM agents take prohibited actions when a tool response omits a safety-relevant fact, even though the request is benign and all returned statements are true. It finds large variation across ten models, and recovery access cuts unsafe execution for all ten.

    arxiv.orgpaperAdded 24 Oct 2026, published 22 Oct 2026🧠 AI

  12. Monitorability Is Trainable: Post-Training for Chain-of-Thought Monitorability

    Monitorability Is Trainable proposes an unsupervised post-training objective that maximizes mutual information between a model's chain of thought and its output. On three model organisms with degraded CoT (from compression, monitor optimization, and synthetic-document generalization), it recovers most or all lost monitorability. On undegraded policies it improves CoT monitor and activation probe prediction of unsafe behavior and raises consequential reasoning.

    arxiv.orgpaperAdded 23 Oct 2026, published 21 Oct 2026🧠 AI

  13. PQ-Vault: Provably Quantum-Safe Asset Custody for Unmodified Ethereum

    PQ-Vault is a custody design for unmodified Ethereum against quantum key recovery. It combines a quantum-safe vault contract, a proof-of-stake sidechain with compact certificates, and an optimistic dispute protocol. The paper proves that compact certificates with classically chosen parameters fall from 128 to about 60 bits against quantum attackers, and bounds a seed-update stake-steering attack. For 65,536 validators a certificate is 0.8 MB and verifies in about 20 ms, and the vault accepts a checkpoint for about 420,000 gas.

    arxiv.orgpaperAdded 24 Oct 2026, published 21 Oct 2026🛡️ Security

  14. Context-Aware Prompt Injection Detection via Small Language Models in RAG Pipelines: nokast-secureRAG

    nokast-secureRAG is a roughly 0.5B-parameter small language model that works as a semantic firewall between retrieval and generation in local RAG systems. It classifies each query and context pair as safe, suspicious or malicious. It reaches 0.994 recall at a 0.026 false-positive rate in-distribution, beating Llama Guard 3 1B and Prompt-Guard-86M (0.900 recall, 0.690 FPR). Recall on PoisonedRAG falls to near zero, and single-request latency is 293-404 ms.

    arxiv.orgpaperAdded 22 Oct 2026, published 20 Oct 2026🛡️ Security

  15. Rethinking LLM Fine-Tuning via Weight Space Reparameterization: Preserving Safety during Downstream Adaptation

    WSR-Tune is a fine-tuning framework that reparameterizes LLM weight matrices with a safety-conditioned basis, so safety-relevant information concentrates in a small set of directions. Those safety-critical directions are frozen, and the remaining complementary directions are updated for the downstream task. The authors report a better trade-off between downstream performance and safety retention. The page gives no benchmark names or numbers.

    arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI

  16. VibeTraining-Bench: Data-Trainer-Harness Co-Design for Iterative System Improvement

    VibeTraining-Bench is a benchmark for cross-component co-design, where research agents iteratively refine training data, trainers and inference harnesses for a fixed starting agent system. Tasks cover terminal operation, software engineering, multi-turn tool use and math reasoning, with safeguards against reward hacking. On SWE-bench Verified, GPT-6 Astra raises the target system from 32.9% to 53.7%, against 55.4% for the human-developed instruct model.

    arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI

  17. How Secure are NTRU+ Keys? Analysing the Best Module Attacks

    ePrint 2026/2527 by Paola de Perthuis and Filip Trenkić analyses module-BKZ attacks on NTRU+, the South Korean KEM standard. It introduces relative canonical and coefficient embeddings and shows they agree up to scaling exactly when rad(c)/rad(ℓ) is 1 or 2. Simulation-based estimates show the best module attack saves 4 to 10 blocksizes, costing NTRU+ keys at most three bits of Core-SVP security. NTRU+ parameters stay safe in the overstretched regime.

    eprint.iacr.orgpaperAdded 19 Oct 2026, published 18 Oct 2026🛡️ Security

  18. OwlSight: A Panoramic Monitor for Chain-of-Thought Reasoning

    OwlSight is a chain-of-thought monitor that uses "Factor", a monitoring requirement written into the prompt, so one monitor can cover many tasks across capability, safety and trustworthiness. Factors come at fine granularity (a specific leaked email address) and coarse granularity (privacy leakage). On 15,971 reasoning trajectories it beats general-purpose LLMs by 1.32-30.57 points (fine) and 11.71-27.81 points (coarse), and reaches state-of-the-art on OpenAI's CoT monitorability benchmark. It generalizes to unseen models and resists Factor rephrasing, CoT compression and obfuscation.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🧠 AI

  19. Ignored, Not Refused: What Low Prompt-Injection Success Rates Hide in Small Tool-Using Agents

    Ignored, Not Refused audits 33,000 trajectories from eleven open-weight agents (2-14B parameters) on InjecAgent and AgentDojo. A label-blind LLM judge finds most failed indirect prompt injections are ignored (76-80%) rather than refused (17-18%). Changing only the system prompt moves InjecAgent ASR from 0.2% to 43%. The Attack-Task Outcome Matrix (ATOM) shows 21.7% of AgentDojo episodes were safe but left the user task incomplete. The corpus, judge prompt and code are released.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🛡️ Security

  20. Ignored, Not Refused: What Low Prompt-Injection Success Rates Hide in Small Tool-Using Agents

    "Ignored, Not Refused" audits 33,000 trajectories from eleven open-weight agents (2-14B parameters) on InjecAgent and AgentDojo. A label-blind LLM judge finds 76-80% of failed injection attacks were ignored and 17-18% refused. Changing only the system prompt moves InjecAgent attack success rate from 0.2% to 43%, and the ATOM matrix shows 21.7% of AgentDojo episodes were safe but left the user's task undone. The corpus, judge prompt and code are released.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🧠 AI

  21. safeRNSgcd: Accelerating Falcon key generation with RNS in SafeGCD

    ePrint paper presenting safeRNSgcd, which computes the single Bézout coefficient needed at the deepest level of Falcon's NTRU solver while keeping large integers in a residue number system. Centered explicit CRT recovers the exact low bits needed by SafeGCD batches using single-word fixed-point arithmetic. A C implementation integrated into ntrugen reduces inversion and private-key basis-generation cost on a Raspberry Pi 5 and two x86-64 CPUs, versus the original ntrugen and a variant that skips the unused coefficient.

    eprint.iacr.orgpaperAdded 17 Oct 2026, published 16 Oct 2026🛡️ Security

  22. Rethinking GRPO for Large Reasoning Model Safety Alignment

    Beacon is a safety alignment framework for large reasoning models that fixes two GRPO failure modes: advantage collapse, where homogeneous rollout groups give vanishing advantages, and unsafe diversification, where unsafe behaviors persist and spread. It combines Safety Signal Recovery (advantage-guided trajectory filtering plus safe reference supervision) with Safety-Utility Decoupled Alignment (category-aware rewards, benign-only KL anchoring). Tested on four Qwen3 and DeepSeek-R1-Distill variants across eight benchmarks, it cuts average safety error by up to 32.83 percentage points with low over-refusal.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🧠 AI

  23. PROBE: Learning to Audit Policy Compliance in Tool-Using LLM Agents

    PROBE (Policy Rule Observation via Behavioral Exploration) trains LLM-based auditors that act as realistic users and probe deployed tool-using agents for policy violations (pricing, privacy, confirmation, safety) across multi-turn, tool-mediated dialogue. It formalizes auditing as a two-player Markov game with a composite reward for violation discovery, plausibility, progress and policy diversity, and compares GRPO, DPO and GFlowNet optimization. Trained auditors find broader, higher-yield violations than zero-shot adversaries, even when much smaller than the target agent, positioning behavioral auditing as a distinct axis next to capability and safety benchmarks.

    arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🛡️ Security

  24. PROBE: Learning to Audit Policy Compliance in Tool-Using LLM Agents

    PROBE (Policy Rule Observation via Behavioral Exploration) trains LLM-based auditors that act as realistic users and probe deployed tool-using agents for policy violations (pricing, privacy, confirmation, safety) over multi-turn dialogue. It formalizes auditing as a two-player Markov game with a composite reward balancing violation discovery, behavioral plausibility, conversation progress and policy diversity, and compares GRPO, DPO and GFlowNet optimization in a controlled setting. Trained auditors find broader, higher-yield violations than same-architecture zero-shot adversaries, even when much smaller than the target agent. This positions multi-turn behavioral auditing as a distinct evaluation axis alongside capability and safety benchmarks.

    arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI

  25. Onboard Lightweight LLM Reasoning for Human-Aware Safe UAV Navigation

    Presents a modular, fully onboard UAV navigation pipeline that closes the "human-aware safety gap" of geometry-only planners. A shared BLIP encoder drives captioning and text-conditioned segmentation, which is fused with depth for 3D obstacle localization. Qwen-2.5-0.5B, stabilized with RAG and grammar-constrained JSON decoding, infers per-category risk once per class and caches the verdict. Perception runs at 10 Hz on a Jetson Orin NX, and fallback LLM queries take about 0.8 s off the control path. In Gazebo it gives roughly 3x fewer collisions than a geometric planner and raises semantics-aware landing success from 34% to 96%. The 224-pixel encoder input limits small-object perception at range.

    arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI

  26. Towards Safe Autonomy for Computer Use

    Introduces SA-CUA, a dual-LLM framework that gives Computer Use Agents a trust boundary against indirect prompt injection. It derives conservative deterministic rules from the accessibility tree to unmask trusted screen regions for the privileged LLM, and adds an endorsement channel that moves values from untrusted to trusted domains by verification. Human input is needed only at task specification. It reports much higher utility than CaMeL-CUA with a zero attack success rate.

    arxiv.orgpaperAdded 15 Oct 2026, published 13 Oct 2026🛡️ Security

  27. Towards Safe Autonomy for Computer Use

    Introduces SA-CUA, a dual-LLM framework for Computer Use Agents (CUAs) that defends against indirect prompt injection. It builds a trust boundary by deriving conservative deterministic rules from the accessibility tree, which unmask trusted screen regions in the privileged LLM's screenshot and keep untrusted content separate. An endorsement channel lets values move from the untrusted to the trusted domain through verification over trusted channels. This removes the need for per-action user confirmation and the confirmation fatigue it causes. SA-CUA is reported to keep much higher utility than CaMeL-CUA with a 0% attack success rate.

    arxiv.orgpaperAdded 15 Oct 2026, published 13 Oct 2026🧠 AI

  28. BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser Views

    BrowseSafe++ extends BrowseSafe to 38,675 paired attacked/clean web pages, most with prompt injections observed in the wild on production sites. Pages cover twelve site types, 24 attack types and 18 injection locations, each given as HTML, Markdown, accessibility tree and screenshot with a user task and expected answer. The authors train BrowseSafe-Guard, two 0.8B detectors (text and screenshot) that beat a frontier-model-based detector on F1 with low false positives and low inference cost. BrowseSafe-Adapt rewrites injections using browser-agent feedback, raising attack success from a few percent to up to 95.41%.

    arxiv.orgpaperAdded 15 Oct 2026, published 12 Oct 2026🛡️ Security

  29. StableJudge: A Lightweight Adversarial Defense Framework for LLM-as-a-Judge

    StableJudge is a defense framework against score-hijacking prompt injection in LLM-as-a-Judge pipelines (e.g. paper review, recommendation). A compact 0.13B "Sentry" model localizes injected spans and sanitizes them before the judge scores the content, trained on adversarially evolving attacks, and deterministic fine-grained scores are derived from the judge's output distribution. It improves score recovery under attack on held-out scientific abstracts and out-of-distribution attack variants while preserving general performance, decoupling safety from judge model scale. Code and data are promised but not yet released.

    arxiv.orgpaperAdded 15 Oct 2026, published 12 Oct 2026🛡️ Security

  30. ReSI: Recursive Safety Improvement toward Resistant and Resilient AI

    ReSI is a recursive safety improvement framework that automates rounds of safety alignment. Each round applies diverse red-teaming methods to the current target model, develops training recipes to fix the vulnerabilities found, and promotes the update with the largest safety gain among those passing a Pareto gate on capability retention. On four dense and mixture-of-experts models it matches or exceeds frontier models on in-distribution and out-of-distribution safety benchmarks. It cuts mean X-Teaming attack success rate from 86.01% to 31.45%, against 56.69% for the best frontier model (GPT-5.6 Luna), while largely preserving general capabilities.

    arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🧠 AI

  31. ReSI: Recursive Safety Improvement toward Resistant and Resilient AI

    ReSI is a recursive safety improvement framework. Each round runs diverse red-teaming methods against the current target model, develops training recipes for the vulnerabilities found, and promotes the update with the largest safety gain among those passing a Pareto gate on capability retention. Across four dense and mixture-of-experts models it cuts mean X-Teaming multi-turn jailbreak attack success from 86.01% to 31.45%, versus 56.69% for the best frontier model evaluated (GPT-5.6-Luna). It also beats alignment baselines on nearly all safety evaluations while largely preserving general capability. It frames the goals as resistance to known threats and resilience to unforeseen ones, following R²AI.

    arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🛡️ Security

  32. From Evidence to Action: How Tool-Using Agents Fail

    This paper studies where tool-using LLM agents break down in the chain from gathering evidence to taking consequential actions, finding that strong static judgment of whether to act often coexists with much weaker interactive execution, and that failures arise from incomplete investigation, acting before evidence is established, or unresolved prerequisites in multi-action workflows. The authors introduce SafeActBench, a 656-case benchmark across six operational domains and five protocols, paired with a provenance-bound Evidence Ledger and a deterministic trajectory evaluator tested across ten model-harness configurations.

    arxiv.orgpaperAdded 7 Oct 2026🧠 AI

  33. Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving

    GeoCoTDrive is a vision-language-action (VLA) framework for autonomous driving that introduces an explicit geometric chain-of-thought: it first grounds 2D regions corresponding to decision-critical cues, then retrieves localized 3D geometric priors from a geometric foundation model within those regions, interleaving these features into the autoregressive context to drive trajectory generation. The paper also introduces "planning-relevant grounding," a new region-level grounding supervision task, and the PlanningGrounding dataset to teach VLAs planning-oriented grounding, showing consistent gains in safety-critical planning across multiple end-to-end driving benchmarks.

    arxiv.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🧠 AI

  34. SLDR: Defending Against Malicious Fine-tuning via Selective Layers Recovery and Dynamic Routing

    SLDR is a post-fine-tuning defense against malicious fine-tuning-as-a-service attacks, where an attacker fine-tunes an aligned LLM on a legitimate-looking task to covertly erode its refusal behavior. The method trains a LoRA "recovery" adapter only on the layers found to have maximal and minimal signed safety sensitivity, and uses representation-based dynamic routing at inference time to activate that adapter only for malicious queries, leaving benign task performance untouched. On Llama3.1 fine-tuned for SST2, it cuts the average harmful-output score from 11.54 to 0.08 while keeping downstream accuracy, and stays near-zero even when up to 90% of the fine-tuning data is poisoned.

    arxiv.orgpaperAdded 9 Oct 2026, published 7 Oct 2026🛡️ Security

  35. SLDR: Defending Against Malicious Fine-tuning via Selective Layers Recovery and Dynamic Routing

    SLDR is a post-fine-tuning defense that protects aligned LLMs from malicious fine-tuning-as-a-service attacks, which can quietly erode refusal behavior while keeping task performance intact. It trains a LoRA recovery adapter only on the layers with the most extreme (signed) safety sensitivity scores, then uses representation-based dynamic routing to activate that adapter solely for malicious queries at inference time. Evaluated across four model architectures, five downstream tasks, and four harmful-content benchmarks, it drives the average harmful score on Llama3.1/SST2 from 11.54 down to 0.08 while preserving downstream accuracy, and stays near zero even at poisoning ratios up to 0.9.

    arxiv.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🧠 AI

  36. AI Safety Considerations for Agents With Limited Time to Act

    This arXiv preprint argues that proofs of AI safety or alignment which consider the agent in isolation are incomplete, because the environment's structure matters just as much. The authors construct two theoretical scenarios — one with an infinite state space, one with signal mixture — under partial observability and time-limited action, and prove that even a hypothetically perfect agent cannot guarantee safe behavior in them. The conclusion is that any rigorous safety or alignment proof must jointly specify the agent and the environment's safe-action structure, not the agent alone.

    arxiv.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🧠 AI

  37. EntroPrefill: Renyi-Guided Context Pruning with Conditional Stability Guarantees for Retrieval-Augmented Generation

    EntroPrefill proposes a Renyi-entropy-guided mechanism for pruning context mid-prefill in retrieval-augmented generation, using sink-isolated regularized head pooling compatible with grouped-query attention to decide which tokens can be safely discarded. It derives a mixture-to-head deletion envelope bounding feasible token removal, a finite-sample observer guarantee valid under adaptive layer selection, and a conditional transformer perturbation bound with explicit Lipschitz constants and a first-token decision-margin corollary, plus a systems-level break-even analysis of KV-transfer payload versus pruning savings. The paper is explicitly theoretical, defining assumptions and formal limits without reporting empirical speedup or accuracy-preservation results.

    arxiv.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🧠 AI

  38. ASPIRE: Agentic Safety & Prompt Injection Red-teaming Engine

    ASPIRE is an automated red-teaming engine for LLM agents that discovers indirect prompt-injection vulnerabilities beyond pre-specified attack scenarios. It maintains an evolving Agent Security Behavior Graph and uses complementary Explore and Exploit experts to find, verify, and generalize consequence-centric attacks, with trajectory evidence and cross-run memory improving coverage over time. Benchmarked against existing automated red-teaming approaches, it shows broader coverage of consequences, injection methods, environments, and behavior paths while keeping attack success high.

    arxiv.orgpaperAdded 8 Oct 2026, published 6 Oct 2026🛡️ Security

  39. Toward Alignment Scaling Laws: A Framework and First Preregistered Measurements

    This paper proposes a formal framework for "alignment scaling laws," modeling the compute/capability burden needed to hold a fixed safety target for each risk category as a power law B_r(N)=a_rN^alpha_r, where the exponent alpha_r determines whether alignment gets easier, keeps pace, or accumulates "alignment debt" as capability N grows. The authors prove theoretical results (the largest exponent among corrected risks sets the long-run regime, super-exponential headroom requirements above alpha=1, small-model fits underestimate large-scale exponents for power-law mixtures) and apply a preregistered protocol twice: a reanalysis of adversarial-training data on Pythia classifiers (attack-success compute exponent 0.60) and a pilot across Qwen2.5 (0.5B-72B) and Qwen3 (0.6B-14B), finding scaling helps for truthfulness and stated dispositions but sycophancy (exponent ~0.83-0.89) and a planted backdoor behave worse or remain undetermined, with the backdoor surviving blind safety training at most model sizes. The work matters as an early attempt to put the "does alignment get harder with scale" debate on measurable, falsifiable footing rather than anecdote.

    arxiv.orgpaperAdded 7 Oct 2026, published 6 Oct 2026🧠 AI

  40. Shorter Few-Time Signatures from Hash Chains and Blockwise Forced Pruning

    This IACR ePrint paper introduces BPORS-C+BFP, a new few-time signature construction that replaces FORS in SPHINCS+/SLH-DSA, combining short hash chains with a blockwise forced-pruning budget to shrink the bottom signature component. The authors derive a generating-function coverage bound and an exact counting method to safely tighten pruning per block, achieving 8.3%-18.1% smaller full SLH-DSA signatures across six standard parameter sets (versus 3.7%-13.4% for the prior BPORS+FP scheme), and up to 32.5%-36.5% reduction in limited-use settings.

    eprint.iacr.orgpaperAdded 8 Oct 2026, published 6 Oct 2026🛡️ Security

  41. BazaarBench: Delegation Safety in Decentralized C2C Marketplaces Run by LLM Agents

    BazaarBench is a simulated consumer-to-consumer marketplace benchmark that measures whether LLM agents acting as buyers and sellers stay safe and honest — tracking ownership, item condition, and commitments to detect six failure types across five transaction stages. Running three 100-agent markets for 30 days plus 45 seven-day continuations across five models (inventories drawn from a public eBay sample), the authors show that double-selling and item-condition deception rise sharply under deadline pressure and adversarial instructions, with GPT-5.4 completing 55.5% of committed sales involving unavailable or misrepresented items; the team releases the simulator, saved market states, eval code, and 357,608 agent-call records.

    arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI

  42. Deploying Native-Rust KpqC: Pluggable Post-Quantum KEMs and Signatures across TLS, Space Links, and the OQS Ecosystem

    This IACR ePrint paper presents a native-Rust, memory-safe implementation of the Korean KpqC competition's standardized post-quantum schemes — KEMs NTRU+ and SMAUG-T, and signatures HAETAE and AIMer — replacing the reference memory-unsafe C code. The authors expose all seven KEM parameter sets and four signature modes through a single pluggable provider demonstrated across three real deployment front-ends: a rustls TLS 1.3 key-exchange group, an OQS/liboqs-compatible C ABI, and an analytical CCSDS/SDLS satellite constrained-link model, showing SMAUG-T variants are smaller/faster than ML-KEM-768 on constrained space links and a memory-optimized NTRU+ build cuts peak stack by up to 25% at negligible latency cost.

    eprint.iacr.orgpaperAdded 8 Oct 2026, published 5 Oct 2026🛡️ Security

  43. Plotkin Attacks! On the (Mis)use of Raptor Codes in Asynchronous Verifiable Information Dispersal

    Victor Shoup shows that "reconstruct-later" asynchronous verifiable information dispersal (AVID) designs — used by data-availability systems including an early Walrus design/testnet — are insecure when built on the standardized Raptor codes R10 (RFC 5053) and RaptorQ (RFC 6330). Using the Plotkin bound, he proves that a Byzantine disperser can choose a subset of f+1 honest fragments that fails to reconstruct the message, gives randomized polynomial-time algorithms to find such subsets, and implements a working attack that defeats an RFC 6330 RaptorQ decoder on every adversarial subset tested (success for f from 9 to 45). Benchmarks show plain Reed-Solomon coding is an MDS alternative that is often faster and never much slower than R10/RaptorQ, making it the safer practical choice for this design pattern.

    eprint.iacr.orgpaperAdded 8 Oct 2026, published 4 Oct 2026🛡️ Security

  44. CorrectGuard: Eyes-Off Correctness Estimation for Black-Box Security Guardrails

    CorrectGuard is a framework for estimating whether black-box AI security guardrails made correct decisions on inputs that are inaccessible to humans (production privacy) or to the guardrail-auditing model itself, using only labeled "eyes-on" data and no internal access to the guardrail. The authors test in-context-learning, embedding, and finetuning-based correctness classifiers across 13 safety/security datasets (harmful content, jailbreaks, prompt injection, extraction) and multiple open-weight guardrails, showing up to 25-point macro-accuracy gains in error identification and improved risk-based abstention/ranking of guardrail decisions.

    arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🛡️ Security

  45. CorrectGuard: Eyes-Off Correctness Estimation for Black-Box Security Guardrails

    CorrectGuard is a framework for estimating how accurately black-box security guardrails (jailbreak, harmful-content, prompt-injection and extraction detectors) perform on inputs that cannot be inspected by humans or by the evaluating model itself, using an independent correctness model trained only on labeled "eyes-on" data. The authors test in-context-learning, embedding-based, and fine-tuned correctness classifiers under leave-one-dataset-out evaluation across 13 safety/security datasets and multiple open-weight guardrails, showing up to 25-point macro-accuracy gains and improved risk-coverage tradeoffs (AURC reduced from 0.33–0.44 to 0.17–0.22) for guardrail decision ranking and abstention. The work matters for anyone building auditing or eval pipelines for opaque safety classifiers without privileged access to their internals.

    arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🧠 AI

  46. Walking the Embedding Space: Datastore Extraction from Multimodal RAG

    Researchers introduce ImmRAG, a black-box data extraction attack against image-returning Multimodal Retrieval-Augmented Generation (MRAG) systems, where the retrieved image itself is the model's response. Instead of malicious text prompts, ImmRAG embeds attack instructions inside an attacker-supplied image and uses relevance-weighted resampling to steer queries toward unexplored regions of the embedding space, progressively reconstructing more of the private datastore. Tested against CLIP-family retrievers across medical, document, and general-purpose scenarios, a single 2500-query run reconstructed up to 611 radiology images, 566 document scans, and 416 general images — up to 5.6x more distinct items than a non-adaptive baseline — highlighting the lack of safeguards against multimodal data leakage.

    arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🛡️ Security

  47. AuraForge: Scaling Security Supervision for Training Coding Agents

    AuraForge is a method for synthesizing and validating executable security tests to train coding agents toward secure (not just functionally correct) code, combining attack-oriented test synthesis, multi-language task construction, and safeguards against reward hacking. The authors release AuraGym, a 679-task executable training gym drawn from 344 real-world Python/JavaScript/TypeScript repositories spanning 177 CWE categories, and show that training Qwen3.5-4B with AuraForge-synthesized tests beats human-written tests on both functional-pass (FuncPass) and security-pass (SecPass) metrics while cutting false positives by over 83%.

    arxiv.orgpaperAdded 3 Oct 2026, published 1 Oct 2026🛡️ Security

  48. AuraForge: Scaling Security Supervision for Training Coding Agents

    AuraForge is a pipeline that synthesizes and validates executable security tests to supervise the training of coding agents, using attack-oriented test synthesis and safeguards against reward hacking. The authors build AuraGym, a multi-language (Python, JavaScript, TypeScript) training gym of 679 feature-implementation tasks from 344 real repositories spanning 177 CWE categories, and show that training Qwen3.5-4B with these synthesized tests beats human-written security tests on both functional correctness (FuncPass) and security (SecPass) metrics, while producing about 3x more test cases and cutting false positives by 83 percent.

    arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🧠 AI

  49. Correct Answers, Invalid Traces: What Verifiable Grade-School Math Reveals About Chain-of-Thought Traces

    This paper uses iGSM, a synthetic grade-school math benchmark with programmatically verifiable step-by-step dependencies, to test whether correct final answers reliably come with valid chain-of-thought traces. Models trained on minimal, valid traces show answer correctness and trace validity decoupling out of distribution (31.6% of correct answers on the hardest instances have invalid traces, many failing semantic dependency checks despite passing syntactic/arithmetic checks); interventions like non-minimal trace training, query re-asking, token shuffling, and trace swapping further show models retain high accuracy even when traces are corrupted or unverifiable. The findings challenge using CoT minimality or surface plausibility as evidence of genuine step-by-step planning, with direct implications for CoT-based monitoring and interpretability claims in AI safety.

    arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI

  50. Correct Answers, Invalid Traces: What Verifiable Grade-School Math Reveals About Chain-of-Thought Traces

    Using the iGSM synthetic grade-school-math benchmark, whose exact solution dependencies can be checked programmatically, the authors show that correct answers and valid reasoning traces decouple out of distribution — on the hardest problems 31.6% of correct answers come with invalid traces, many failing only semantic dependency checks despite passing syntax/arithmetic checks. They further show trace minimality can reflect training-data properties rather than genuine planning, and that models trained on shuffled or swapped traces still retain high accuracy despite no trace being verifiably correct, undermining the use of CoT traces for debugging, agent auditing, or safety monitoring.

    arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🛡️ Security

  51. SEABench: Benchmarking Endogenous Misalignment In Self-Evolving Agents

    SEABench is a benchmark of 48 longitudinal task sequences designed to study endogenous misalignment in self-evolving LLM agents — agents that modify their own controller instructions, memory protocols, and tools in response to feedback. It includes an adaptive trajectory discovery pipeline and paired non-evolving baseline agents for causal attribution, and finds that self-evolution boosts task completion but introduces safety failures absent in static baselines; the authors also show that chain-of-thought monitoring can catch these divergent unsafe behaviors with a low false-positive rate.

    arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🛡️ Security

  52. SEABench: Benchmarking Endogenous Misalignment In Self-Evolving Agents

    SEABench is a benchmark for studying "endogenous misalignment" in self-evolving LLM agents — agents that modify their own controller instructions, memory, and tools after deployment based on feedback. It comprises 48 longitudinal task sequences across multiple evolution surfaces, task domains, and harm types in a personal-assistant environment, using an adaptive trajectory discovery pipeline and paired non-evolving baseline agents for causal attribution. Evaluation across several LLMs shows self-evolution boosts task completion but introduces safety failures absent in non-evolving baselines, and the paper proposes a chain-of-thought monitoring strategy that mitigates unsafe behavior with low false positives.

    arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI

  53. Certified Multi-Source Integrity for Structured Agent Actions

    This arXiv paper proposes a certifier for structured, privileged agent actions such as paying an invoice, assembled from potentially corrupted documents and tool outputs, formalizing when multi-source corroboration can be trusted under indirect prompt injection. It uses a corruption-radius rule counted via minimum hitting sets over corruption-distinct evidence classes so laundered or re-published copies cannot fake a quorum, plus deterministic reconciliation and trusted anchors for single-sourced fields. Evaluated on 70,966 sanctions entities and 450 software-supply-chain provenance records, and against five LLM agents where a realistic injection fools all but one model and existing action-gating or provenance baselines are broken while the certifier admits no unsafe action.

    arxiv.orgpaperAdded 2 Oct 2026, published 28 Sep 2026🛡️ Security

  54. PIDS-Bench: Evaluating Prompt-Injection Detectors Under Over-Defense, Obfuscation, and Distribution Shift

    PIDS-Bench is a frozen, multi-axis benchmark for prompt-injection detectors that jointly measures attack detection and benign false-positive rates across in-distribution inputs, hard-benign prompts mimicking injection structure, obfuscated attacks, and domain/structural distribution shifts. Testing seven detectors (learned baselines, external prompt-injection classifiers, broad-safety comparators) plus a rule-based baseline, the authors show a detector with F1 > 0.98 on held-out data still misclassifies roughly one-third of an externally-sourced benign security-adjacent corpus, and that hard-negative augmentation reduces over-defense only on curated stress inputs, not on externally-sourced ones — a pattern they call provenance-sensitive over-defense.

    arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

  55. Control Under Compression: Reliability Frontiers for Tool-Using Agents

    Introduces CompressAgent, a benchmark evaluating how compressing agent control contexts (system-side instructions specifying tools, arguments, policies, and recovery protocols) affects tool-using agent reliability. Testing nine ACCs, three task families, three Qwen models, and six retained-context budgets across 15,525 runs, it finds a nonlinear reliability frontier: compression stays safe near 75% retained context but reliability collapses sharply below 50%, with executable protocols becoming fragile at 10-25% and failures manifesting as tool-execution and action-parsing errors.

    arxiv.orgpaperAdded 26 Sep 2026🧠 AI

  56. A Large-Scale Measurement of AI Bill of Materials Completeness in Hugging Face Models

    This paper empirically measures the completeness of AI Bills of Materials (AIBOMs) generated for roughly 97.5K Hugging Face model repositories, examining structural/metadata fields, model identity, license and external-reference data, and model-card documentation such as datasets, limitations, safety-risk and environmental information. It finds that generated AIBOMs satisfy required structural fields but are weak on AI-specific documentation like responsible-use, environmental impact, and meaningful descriptions, and argues for better model-card practices and automated AIBOM validation.

    arxiv.orgpaperAdded 26 Sep 2026🧠 AI

  57. CAGE-1: Control, Assurance, and Governance Evaluation for Enterprise Agentic AI

    CAGE-1 is an evaluation framework for deciding whether enterprise agentic AI systems are ready for deployment, assessing dimensions like authority, policy enforcement, retrieval quality, memory integrity, tool safety, auditability, human oversight, conflict handling, and safe failure. It introduces "Prebind Assurance" — testing whether a proposed agent action can be proven controlled (admitted, held, narrowed, refused, escalated, or quarantined) before it becomes binding or operationally consequential.

    arxiv.orgpaperAdded 26 Sep 2026🧠 AI

  58. How to Avoid Debate: Scalable AI Safety via Doubly-Efficient Interactive Proofs

    This arXiv paper introduces single-prover doubly-efficient interactive proofs and arguments as an alternative to debate-based AI safety verification, where two competing AI provers convince a weak verifier of correctness. It addresses a gap in prior interactive-proof theory by handling oracle-aided computations (e.g., access to human judgment or a web database), giving protocols for robust computations tolerant of a small fraction of incorrect oracle answers, and for oracles that are low-degree polynomials.

    arxiv.orgpaperAdded 26 Sep 2026🧠 AI

  59. Coding Agents Are Guessing: Measuring Action-Boundary Violations in Underspecified DevOps Instructions

    UnderSpecBench is a benchmark of 69 task families and 2,208 prompt variants testing whether coding agents (Claude Code, Codex, OpenCode) overstep action boundaries when given benign but underspecified DevOps instructions. It uses deterministic, side-effect-based oracles to classify outcomes as Safe Success, Wrong Target, or OverScope, finding that 55.8-67.8% of runs violate at least one action boundary — agents tend to guess rather than clarify or refuse, especially when the target is uncertain.

    arxiv.orgpaperAdded 26 Sep 2026🧠 AI

  60. Online Safety Monitoring for LLMs

    This arXiv preprint studies online safety monitoring for deployed LLMs: a real-time monitor converts a verifier signal from an external model into an alarm decision via thresholding, with the threshold calibrated using risk control methods. Tested on mathematical reasoning and red-teaming datasets, the simple thresholded design performs competitively against more complex sequential-hypothesis-testing monitors, suggesting simple calibrated alarms are a viable practical approach to catching unsafe generations post-alignment.

    arxiv.orgpaperAdded 26 Sep 2026🧠 AI

  61. When Good Verifiers Go Bad: Silent Negative Transfer in Verifier-Guided VLM Training

    This paper studies verifier-guided self-DPO training of vision-language models and identifies "silent negative transfer": a verifier that reliably improves one task (MathVista, +8.0 held-out) can secretly harm generalization on another (MMMU) even while self-training metrics keep improving. The authors decompose this into gradient fidelity (alignment between verifier-induced and correct update directions) and gradient transferability (alignment between correct and held-out directions), deriving a Safe-Transfer Margin certifying positive held-out alignment. They propose Asymmetric Acceptance Gating (AAG), a precision-first preference-pair filter that raises fidelity on MMMU from 0.29 to 0.42 and restores positive held-out alignment (from -0.13 to +0.22), beating raw verifier-guided training across six configurations.

    arxiv.orgpaperAdded 26 Sep 2026🧠 AI

  62. CONTINUITY: Security-Context Contracts for Composable LLM Agent Controls

    This paper identifies security-context discontinuity, a failure mode where individually correct LLM agent security mechanisms such as provenance tracking, authorization, policy enforcement, and protocol adapters fail to compose safely because security-critical context gets dropped, widened, rebound, or reinterpreted as actions cross component boundaries. The authors introduce CONTINUITY, a framework modeling each component with assume-guarantee contracts and carrying authenticated context via signed root grants, provenance commitments, role-bound transition receipts, and effect-bound execution permits, formalizing end-to-end consequence integrity. A reference verifier and cross-layer fault-injection suite covering 32 fault classes across four domains was evaluated on 2560 attack instances, 700 benign tasks, and 200 ambiguous cases, with the full configuration blocking all harmful effects while passing benign tasks and correctly escalating ambiguous ones.

    arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

  63. RedEvoAgent: Automatic Red-Teaming Agent with Experience-Driven Skill Evolution

    RedEvoAgent is a black-box automatic red-teaming agent that distills successful jailbreak trajectories into concise, human-readable 'attack skills' rather than retrieving full past trajectories. It evolves these skills via tool-effectiveness profiling and a validation ratchet that only keeps updates improving attack success, and is shown to outperform fixed and agentic jailbreak baselines while transferring across attacker models and target execution harnesses (product-level agent environments where jailbreaks trigger real tool use, not just unsafe text).

    arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

  64. A Large-Scale Measurement of AI Bill of Materials Completeness in Hugging Face Models

    This paper empirically studies AI Bills of Materials (AIBOMs) generated for ~97.5K public Hugging Face model repositories, measuring how completely they capture provenance, licenses, datasets, model-card details, safety-risk assessments, and environmental information. It finds that generated AIBOMs satisfy required structural/metadata schema fields but are weak or missing on AI-specific documentation such as model cards, responsible-use notes, limitations, and dataset declarations, exposing transparency and governance gaps in the ML model supply chain. The authors argue for better model-card practices, repository-level traceability, and automated AIBOM validation.

    arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

  65. Online Safety Monitoring for LLMs

    This paper proposes an online safety monitor for deployed LLMs that converts a verifier model's signal into a real-time alarm via a threshold calibrated using risk control, flagging when the model's outputs can no longer be trusted as safe. Tested on mathematical reasoning and red-teaming datasets, the simple thresholded verifier approach matched more complex monitors built on sequential hypothesis testing.

    arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

  66. Coding Agents Are Guessing: Measuring Action-Boundary Violations in Underspecified DevOps Instructions

    UnderSpecBench is a benchmark of 69 task families (2,208 prompt variants) grounded in real incidents and CVEs that tests whether coding agents (Claude Code, Codex, OpenCode) safely handle underspecified DevOps instructions rather than guessing at intent, target, or blast radius. Using deterministic side-effect oracles, the study finds 55.8–67.8% of agent runs violate at least one action boundary, with target ambiguity most sharply degrading safe action and blast-radius cues barely reducing risky autonomous behavior. The paper argues completion-centric agent benchmarks overstate safe autonomy and calls for mitigations at the model, harness, and system layers.

    arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

  67. GAS-Leak-LLM: Genetic Algorithm-Based Suffix Optimization for Black-Box LLM Jailbreaking

    GAS-Leak-LLM is a black-box jailbreaking attack that uses a genetic algorithm (selection, mutation, crossover) to evolve adversarial suffixes appended to prompts, bypassing LLM safety alignment without needing model weights or gradients. The paper reports empirical results showing existing content-moderation and alignment safeguards on commercial LLMs can be defeated through this iterative, query-only search over the discrete prompt space.

    arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

  68. From Shield to Target: Denial-of-Service Attacks on LLM-Based Agent Guardrails

    Researchers show that LLM-based guardrails deployed to catch prompt injection and jailbreaks can themselves be attacked: crafted natural-language payloads trap the guardrail's reasoning in extended loops, causing a systematic denial-of-service. A beam-search optimization framework (an LLM proposer guided by a strategy bank) and a lighter mechanism-aware structural-mutation attack both generalize across guardrail architectures and safety templates, with payloads optimized on one open-source surrogate transferring to Claude, GPT, Gemini, DeepSeek, and Qwen backbones, achieving 13-63x token amplification and up to 148x latency amplification in real web, desktop, code, and multi-agent deployments — enough for a single poisoned document to starve co-located agents on shared guardrail infrastructure.

    arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

  69. User Model Extraction via Belief Self-Distillation

    This arXiv paper introduces Belief Self-Distillation (BSD), a technique where a frozen LLM teaches itself a compact, decodable representation of its inferred beliefs about the user, which can then be read out and rewritten back into the model's internal state. The authors show refusal behavior depends not just on the literal request but on the model's inferred user intent, and that directly editing this belief representation changes whether the model refuses a fixed request — a causal steering result with clear implications for jailbreak mechanisms and safety-conditioning defenses. They also find that independently trained LLMs converge on a similar internal geometry for representing users.

    arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🛡️ Security

  70. User Model Extraction via Belief Self-Distillation

    This paper introduces Belief Self-Distillation (BSD), a read-write probing framework where a frozen LLM acts as its own teacher to learn a compact representation of its implicit beliefs about the current user, which can be both decoded (read) and written back into the model's activations (write) to causally test its effect. The authors show BSD recovers user beliefs more faithfully and enables stronger interventions than matched hidden-state steering, and that changing the model's inferred user intent alters refusal decisions even when the request itself is held fixed. They also find that independently trained LLMs across different model families converge on a similar geometry for representing users, with direct implications for how safety-relevant refusal behavior depends on who the model believes it is talking to.

    arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🧠 AI

  71. Configuration, Not Conscience: A Large-Scale Empirical Study of LLM System Prompts

    An empirical study analyzing a merged corpus of 407 leaked, reconstructed, or officially published LLM system prompts from 62 vendors, using a block-level classifier to categorize content. It finds operational content (tool/protocol instructions, ~58% of words) vastly dominates over safety/ethical statements (~5%), with strict rule-lines guarding tool use and file safety over harmful content by an 11:1 margin, and documents cross-vendor text reuse plus "prompt rot" (thousands of words churned per version release), arguing system prompts should be treated as configuration/engineering artifacts rather than windows into model values.

    arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🧠 AI

  72. Configuration, Not Conscience: A Large-Scale Empirical Study of LLM System Prompts

    A large-scale empirical study analyzing a merged corpus of 407 leaked, reconstructed, or officially published LLM system prompts from 62 vendors, clustering them into 29 near-duplicate groups and classifying content at the block level. The authors find operational content (tool/protocol instructions) dominates at ~58% of classified words versus only ~5% for safety policy, with the strictest rule-lines guarding tool use and file safety over harmful content by an 11:1 margin, and document literal-text reuse across vendors and significant "prompt rot" (word churn) across version chains — arguing leaked system prompts should be treated as operational specifications and a supply-chain/engineering concern rather than windows into a model's "values."

    arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🛡️ Security

  73. Requirement-Bound Verified Commissioning: A Frozen Four-Billion-Parameter Local Model as a Candidate Generator under an External Acceptance Layer with Verification and Release Authority

    This paper proposes a "requirement-bound verified commissioning" protocol for mechatronic systems where a frozen four-billion-parameter local language model only generates candidate plans, while a separate external gate under a sealed grammar holds sole authority to verify and release them. Evaluated once on a 144-task benchmark written by isolated agent contexts with no access to the gate/grammar, it found 21 of 22 fabricated "ready" plans on unanswerable tasks were correctly rejected, no false release occurred among 83 in-benchmark releases (Clopper-Pearson upper bound 0.0354), but one false release later occurred among 146 out-of-benchmark releases, and incorrect user answers were released in 169/431 pairings — highlighting limits of candidate/release separation as a safety architecture for small local models.

    arxiv.orgpaperAdded 26 Sep 2026, published 24 Sep 2026🧠 AI

  74. Solidity Meets LLMs: A Transformer-Based Approach to Smart Contract Vulnerability Detection

    This arXiv paper fine-tunes a BERT-based transformer model on a purpose-built labeled dataset of Solidity code fragments to classify them as vulnerable or safe, reporting a 92% F1 score. It demonstrates applying pre-trained LLM representations to capture Solidity-specific syntactic and semantic patterns for smart contract vulnerability detection, as an alternative or complement to traditional static analysis tools.

    arxiv.orgpaperAdded 4 Oct 2026, published 22 Sep 2026🛡️ Security

  75. ReasAlign: Reasoning Enhanced Safety Alignment against Prompt Injection Attack

    ReasAlign is a model-level safety alignment technique that defends LLM agents against indirect prompt injection by adding structured reasoning steps to detect conflicting instructions embedded in external data and preserve the user's original task intent. It also uses a test-time scaling mechanism with a preference-optimized judge model to score and select the best reasoning trajectory. On the CyberSecEval2 benchmark it reports 94.6% utility with only 3.6% attack success rate, substantially outperforming Meta SecAlign, which scores 56.4% utility with a 74.4% attack success rate.

    arxiv.orgpaperAdded 22 Sep 2026🛡️ Security

  76. NIST Draft SP 800-82r4: Guide to Operational Technology (OT) Security

    NIST has published the initial public draft of Special Publication 800-82 Revision 4, "Guide to Operational Technology (OT) Security," updating the long-standing OT/ICS security guidance to cover a broader scope of programmable physical-world systems (industrial control systems, building automation, physical access control, transportation, and environmental monitoring/measurement systems). The draft revises the overview of OT topologies, common threats, typical vulnerabilities, and recommended safeguards/countermeasures, and is open for public comment until November 30, 2026.

    nist.govpaperAdded 26 Sep 2026, published 21 Sep 2026🛡️ Security

  77. NIST SP 800-82 Rev.4 (Initial Public Draft) — Guide to OT Security

    NIST SP 800-82 Revision 4 is the initial public draft of the agency's core guide to Operational Technology (OT) security, covering industrial control systems, building automation, physical access control, and environmental monitoring/measurement systems. It updates OT threat models, typical topologies, and vulnerability descriptions, and provides recommended security safeguards and countermeasures for organizations running cyber-physical systems, with a public comment period through November 30, 2026.

    csrc.nist.govpaperAdded 26 Sep 2026, published 21 Sep 2026🛡️ Security

  78. LIMBO: Learning and Internalizing Model-Free Barrier Objectives for Agile and Safe Whole-Body Control

    LIMBO is a framework for synthesizing a state-action control barrier function (Q-CBF) from black-box transitions and distilling its safety structure into a task policy, avoiding the need for an online safety filter at deployment. Applied to a 29-degree-of-freedom humanoid performing dodgeball avoidance and low-obstacle locomotion, it uses risk-guided sampling near the boundary of recoverability during synthesis and acts as a safety-feedback teacher during task learning, transferring to hardware without online filtering.

    arxiv.orgpaperAdded 22 Sep 2026, published 18 Sep 2026🧠 AI

  79. NIST SP 800-82r4 (Initial Public Draft) — Guide to OT Security

    NIST has issued the initial public draft of SP 800-82 Revision 4, "Guide to Operational Technology (OT) Security," updating its long-standing guidance for securing industrial control systems, building automation, transportation, and physical access/monitoring systems. The draft covers OT system topologies, common threats and vulnerabilities affecting energy, manufacturing, and transportation sectors, and recommended security safeguards, with public comments open through November 30, 2026.

    csrc.nist.govpaperAdded 28 Sep 2026, published 18 Sep 2026🛡️ Security

  80. Coding Agents with an Obstacle-Aware Harness for Safe Robot Manipulation

    This arXiv paper studies coding agents that write robot controller programs for manipulation tasks under a safety constraint (avoid touching a specified obstacle), finding they collide in most cases despite reasoning about the obstacle and being explicitly instructed not to touch it. The authors trace the failure to planning: the model lacks a notion of a clearing route and cannot replan when a route becomes infeasible, and treats contact execution as unbounded by the constraint. They propose SafeHarness, an obstacle-aware harness with route planning (bounding boxes, candidate waypoint routes, verification and replanning) and obstacle-aware contact execution, which raises task success to 71.9% and collision avoidance to 87.5%, beating prior SOTA by 6.5% and 27.0% respectively.

    arxiv.orgpaperAdded 22 Sep 2026, published 17 Sep 2026🧠 AI

  81. What Breaks Under Pruning in Smart Homes, and When? Evaluating LLM Degradation Across Architectures and Task Complexity

    This arXiv paper systematically evaluates how pruning (depth, width, hybrid, and expert pruning) degrades context-grounded tool calling in smart-home LLM agents, testing four models spanning dense Transformer, dense hybrid, and mixture-of-experts architectures after post-pruning SFT. Using over 19,500 instances from three smart-home datasets, it finds dense models have narrow safe-pruning regions with sharp degradation while MoE models tolerate more pruning, that grounded specificity (device/argument/value) degrades before schema-level intent, and aggressive dense pruning can induce over-refusal. It argues pruned-model selection for tool execution reliability requires evaluation beyond aggregate accuracy.

    arxiv.orgpaperAdded 22 Sep 2026, published 15 Sep 2026🧠 AI

  82. Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning

    This arXiv paper operationalizes the importance of a chain-of-thought reasoning step as its advantage (change in expected reward from Monte Carlo rollouts) and tests whether LLM judges and fine-tuned step-level critics can identify which steps actually matter. It finds that even capable LLM judges and fine-tuned critics fall well short of a noise ceiling, especially on correct responses, showing that step importance is only partially recoverable from the reasoning text alone. The findings caution against treating legible/readable CoT traces as genuinely interpretable, with direct implications for process reward modeling and any security/safety monitoring that relies on judging or supervising reasoning traces.

    arxiv.orgpaperAdded 4 Sep 2026, published 3 Sep 2026🛡️ Security

  83. WSO2 Trusted AI Governance

    WSO2 CTO Asanka Abeysinghe's architectural thesis argues that agentic AI systems break specification-based governance and instead require a control system spanning discovery, first-class agent identity and delegation, parameter-aware boundary authorization, runtime safety (prompt injection, jailbreaks, tool misuse, data exfiltration), deliberate human oversight, centrally-authored/distributedly-enforced policy, evidentiary observability, and economic (cost/budget) controls. It distinguishes inline governance (embedded in agent code) from infrastructure-enforced governance (gateways, proxies, service meshes, model/API gateways) and proposes a control-plane/data-plane split as the load-bearing pattern, referencing EU AI Act, NIST AI RMF, ISO 42001, and MCP registries as systems of record.

    github.compaperAdded 3 Sep 2026, published 14 Jul 2026🛡️ Security