Skip to content

92 results for “TRACE”

What you seeeverything
  1. How Much Can Tool Calls Reveal About You? Privacy Leakage from Tool-Call Traces

    PrivacyTrace is a benchmark of 1,000 synthetic user profiles and 4,000 agent trajectories across four domains, built with real tools from 25 MCP servers. Four LLM attackers inferred user attributes from tool-call traces alone at a 26.25% success rate, against 17.97% for prior-based guessing. Tool arguments and returned results gave the main evidence, and linking traces across sessions raised the risk.

    arxiv.orgpaperAdded 3 Nov 2026, published 30 Oct 2026🛡️ Security

  2. How Much Can Tool Calls Reveal About You? Privacy Leakage from Tool-Call Traces

    PrivacyTrace is a benchmark from the Shanghai AI Laboratory (AgentDoG Team, October 2026) that tests how much a passive observer can infer about a user from MCP tool-call traces alone. It has 1,000 synthetic profiles, 4,000 trajectories and 67,950 calls across 25 MCP servers. Four LLM attackers reached 26.25% attribute accuracy against a 17.97% prior baseline, and tool arguments leaked most.

    arxiv.orgpaperAdded 3 Nov 2026, published 30 Oct 2026🧠 AI

  3. MAServeBench: Benchmarking Multi-Agent LLM Serving Systems with Hierarchical Collaboration Workloads

    MAServeBench is a benchmark that treats multi-agent collaboration as a configurable dimension of LLM serving workloads. Its composable stages model how agents coordinate and exchange context in documented multi-agent workflows, and Hierarchical Semantic Traces record operations and dependencies for reproducible comparisons. Task-linked measurements tie workloads to GPU/NPU behavior, showing serving efficiency does not always mean timely task completion. Code is released.

    arxiv.orgpaperAdded 31 Oct 2026, published 29 Oct 2026🧠 AI

  4. Beyond the Scope of This Paper: Practical Flash-Accelerator and Cache-Collision Timing Attacks on Microcontrollers

    Colin O'Flynn's paper shows that the flash accelerator in most microcontrollers produces the same timing collisions as a cache, so cacheless Cortex-M devices remain open to cache-collision attacks on AES. AES keys were recovered from as few as 750 traces across six cryptographic libraries, eight architectures and over twenty devices. It also attacks SPI bootloaders, Ethernet, CTAP2 over USB and 802.15.4, and releases the open-source tool FlashWhisperer.

    eprint.iacr.orgpaperAdded 31 Oct 2026, published 29 Oct 2026🛡️ Security

  5. FlatCake: A Flat KVCache Storage Architecture for LLM Serving

    FlatCake is a KV cache storage architecture for LLM serving that treats host DRAM and NVMe SSD as peer media in one 64-bit address space, instead of a DRAM-over-SSD tier. Blocks are placed once, in session-contiguous, layer-major order, and streamed via GPUDirect Storage. On a Claude Code trace with DeepSeek-V4-Flash it holds a 94% hit rate (Mooncake: 64%) and cuts peak-load mean TTFT 1.6x.

    arxiv.orgpaperAdded 30 Oct 2026, published 28 Oct 2026🧠 AI

  6. Tractable, Not Truncated: Colored-Noise TRNG Security via Fractional Brownian Motion

    This ePrint paper models oscillator-based TRNG phase noise, both white and flicker, as fractional Brownian motion. It proves a quasi-renewal property that gives closed-form worst-case min-entropy and sampling requirements, and extends spectral and Allan-variance analysis so noise parameters come from a single timing trace. FPGA and ASIC experiments show flicker noise accounts for over 99% of uncertainty at a 0.99 min-entropy target, allowing a bitrate two to three orders of magnitude higher.

    eprint.iacr.orgpaperAdded 28 Oct 2026, published 27 Oct 2026🛡️ Security

  7. Unshuffling Fisher-Yates: Practical Recovery of Length-128 Permutations and Application to ML-DSA

    Paper (IACR ePrint 2026/2658) presenting a single-trace side-channel attack on a software Fisher-Yates shuffle of length 128, the butterfly count in one ML-DSA NTT layer. It removes rejection-sampling timing variation, extracts Hamming weight and identity leakage, and enumerates likely permutations with constraint programming. On a shuffled ML-DSA-44 NTT it recovers secret polynomial s1, fully or up to a few coefficients.

    eprint.iacr.orgpaperAdded 28 Oct 2026, published 27 Oct 2026🛡️ Security

  8. Poly2MsgLeaks: Certified Key Recovery from Polynomial-to-Message Leakage

    Poly2MsgLeaks is a profiled chosen-ciphertext power-analysis attack on the SMAUG-T (TiMER parameter set) post-quantum KEM that recovers the full 512-coefficient PKE secret from six traces on an STM32F415. It recovers 999 of 1,000 unseen secrets and proves an incorrect key is released with probability at most 2^-2095.6. Single-write message assembly and a two-share masked P2M resisted the evaluated six-execution attack.

    eprint.iacr.orgpaperAdded 28 Oct 2026, published 27 Oct 2026🛡️ Security

  9. Trial by Trace: Benchmarking AI Agent Harnesses for Reliability and Failure Attribution

    TraceTrial-Bench is a benchmark that scores agent task performance and agent harness reliability separately. It has 95 mechanism-oriented tasks across seven components: context, execution, governance, lifecycle, observability, tools and verification. Across 4 harnesses, 9 models and 3,420 runs, macro-averaged harness scores range from 59.8% to 72.0%, and 31.1% of runs succeed despite failing at least one harness criterion.

    huggingface.copaperAdded 27 Oct 2026🧠 AI

  10. Non-profiled Single-Trace ML-DSA Secret Key Recovery by Horizontal Distribution Analysis

    Non-profiled single-trace side-channel attack on ML-DSA-65 (Dilithium) running on ARM Cortex-M4, by Linus Backlund and Elena Dubrova (KTH). It compares observed sample distributions with expected Hamming weight leakage using a Gaussian mixture model, and stacks partitioned trace segments for multiple observations. Information-set decoding corrects misclassifications; with a 2^70 enumeration budget, the full secret key is recovered from one trace in 99% of attacks, using secret key unpacking as the attack point.

    eprint.iacr.orgpaperPublished and added 26 Oct 2026🛡️ Security

  11. Private Information Retrieval with Accountability at Erasure-Optimal Server Redundancy

    SynTrace is a single-round compiler that adds accountability to linear private information retrieval (PIR). The client mixes the retrieval query with m audit queries, so audit syndromes identify up to d deviating servers among t colluding ones before reconstruction. The paper proves perfect query privacy and zero false identification within the threshold. For Shamir-based PIR it needs k=t+d+1 servers. For a 32 KiB record from a 1 GiB database it uses 2.25 MiB, against 8.96 MiB for the Eriguchi, Kurosawa and Nuida (TCC 2022) homomorphic-MAC construction.

    eprint.iacr.orgpaperPublished and added 26 Oct 2026🛡️ Security

  12. SymLift: Neural Semantic Lifting for Compile-Free Vulnerability Detection in Context-Incomplete Code Fragments

    SymLift is a compile-free vulnerability detection framework for context-incomplete code fragments. A fine-tuned LLM lifts control-flow, data-flow, memory and resource relations into a constrained LLVM-like IR. A parser turns the IR into facts, and Datalog rules derive findings with derivation traces. On Juliet function-level fragments Clang compilation success falls to 12.00%, while SymLift's completion rate drops only 1.17 points. SymLift-Qwen-7B reaches Target-F1 94.41% on FormAI and 91.66% micro-F1 on MegaVul.

    arxiv.orgpaperAdded 28 Oct 2026, published 25 Oct 2026🛡️ Security

  13. SymLift: Neural Semantic Lifting for Compile-Free Vulnerability Detection in Context-Incomplete Code Fragments

    SymLift is a compile-free vulnerability detection framework for code fragments that lack project context. A fine-tuned LLM reconstructs control-flow, data-flow, memory and resource relations as a constrained LLVM-like IR, and a deterministic parser turns it into facts for Datalog rules that give findings with derivation traces. SymLift-Qwen-7B reaches 94.41% Target-F1 on FormAI and 91.66% micro-averaged Target-F1 on MegaVul.

    arxiv.orgpaperAdded 28 Oct 2026, published 25 Oct 2026🧠 AI

  14. Gandalf: Flash Shall Not Die! Increasing Flash Storage Lifetime for KV Cache Offloading in LLM Serving

    Gandalf is an SSD KV cache offloading system for LLM serving that is aware of SSD lifetime. It prioritizes admitting full-attention KV cache to SSD over cache from other attention types, using application-level information rather than access history alone. The authors report a 7.3x average SSD lifetime extension with negligible cache hit rate loss across several workload traces and hardware capacities. The design may extend to High Bandwidth Flash.

    arxiv.orgpaperAdded 23 Oct 2026, published 22 Oct 2026🧠 AI

  15. RingTrace: Model-Free Spatio-Temporal Detection and Core Attribution for Cache Side-Channels

    RingTrace is a monitoring framework that detects Flush+Reload cache side-channel attacks by combining per-core cache-miss counters with slice activity across uncore CBoxes. Its Joint Spatio-Temporal Attribution (JSTA) builds a joint-activity matrix without model training: the largest entry is the screening score and row sums point to a candidate core. The authors report detection before secret leakage, fewer false alarms under heavy memory load, and negligible runtime overhead on commodity processors.

    eprint.iacr.orgpaperAdded 24 Oct 2026, published 21 Oct 2026🛡️ Security

  16. SHAKEing SLH-DSA with Non-profiled SCAs

    SHAKEing SLH-DSA with Non-profiled SCAs is an eShard ePrint paper (2026/2584) on correlation power analysis of SLH-DSA-SHAKE, the NIST-standardised hash-based signature scheme. It analyses PRF inputs and selection functions, then combines subtrace averaging, partial-then-total CPA and an efficient exhaustive search to recover the full secret seed, enabling universal forgery. On a 32-bit microcontroller the attack needs about 280 to 559 signatures, and the search finishes within 45 minutes on 72 cores.

    eprint.iacr.orgpaperAdded 24 Oct 2026, published 21 Oct 2026🛡️ Security

  17. SoK: Design-Level Backdoors in Block Ciphers Constructions, Detection, and Key Recovery

    SoK on design-level backdoors in block ciphers. It places four published designs (Rijmen and Preneel, Paterson, Bannier and Filiol, Peyrin and Wang) in one taxonomy and gives a sound algorithm that recovers a partition trapdoor from S-box tables. It attacks KG-DES, BEA-1 and LowMC-M: KG-DES key recovery takes minutes, and the LowMC-M MALICIOUS backdoor yields the key from 35 to 409 queries. Trapdoors hidden in linear layers leave no trace, so the authors recommend deriving constants verifiably from a public seed.

    eprint.iacr.orgpaperAdded 24 Oct 2026, published 21 Oct 2026🛡️ Security

  18. Table-Free Constant-Work BCH Decoding by Algebraic Index Elimination

    Table-free constant-work BCH decoding by algebraic index elimination is an IACR ePrint paper (2026/2580) that replaces the table scans in Walters and Sinha Roy's constant-work BCH decoder with fixed circuits over public addresses. It proves correctness through radius t and trace regularity, removes 5.2 and 7.2 KiB of tables, and runs 35.7 to 82.4 times faster on an i7-13700. Ordinary C masks compiled to received-word-dependent branches under Apple Clang 21, so the authors use a compiler-opaque primitive and run timing screens on four platforms.

    eprint.iacr.orgpaperAdded 24 Oct 2026, published 21 Oct 2026🛡️ Security

  19. Broadcast and Trace from Lattices: Collusion-Resistant and Publicly Traceable

    Broadcast and Trace from Lattices is a 2026 ePrint preprint by Jeffrey Champion. It builds collusion-resistant broadcast and trace with public tracing from attribute-based encryption with succinct ciphertexts and lockable obfuscation, both known from decomposed LWE. Ciphertexts are sqrt(N)·poly(λ, log N) in size, with poly(λ, log N) keys. It is the first such scheme based on a simple, instance-independent lattice assumption.

    eprint.iacr.orgpaperAdded 24 Oct 2026, published 21 Oct 2026🛡️ Security

  20. Answering in the User's Variety: Calibrated Accommodation Pairs for Post-Training

    Calibrated accommodation pairs (CAP) is a preference-data method that rewards chat models for matching a user's dialect density while keeping Standard English for Standard-English users. The paper traces SFT, DPO and RL stages across 10 open model lineages and finds post-training standardizes replies, while the DPO update still favours British and Australian spelling over AAE and Singlish. On a fully open model, CAP improves convergence on unseen features without added dialect for Standard-English users or lower instruction following.

    arxiv.orgpaperAdded 22 Oct 2026, published 20 Oct 2026🧠 AI

  21. The Development of Sycophancy in Language Models: Tracing Vulnerabilities from Pretraining to Post-Training

    The paper traces sycophancy across 741 checkpoints from 30 open model lineages, from early pretraining to released models. It plants initial verdicts on moral scenarios and measures how far models follow a user's opinion or drop their answer under pressure. The behaviour usually exists before post-training, but which questions a released model yields on is set mainly during post-training. For Tülu-3 8B, its own preference-stage checkpoint removes 85% of remaining prediction error, a sibling model only 19%.

    arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI

  22. Blind-DLPA: An End-to-End Framework for Profiled Blind Side-Channel Analysis

    Blind-DLPA is a multi-task deep-learning framework for profiled blind side-channel analysis, where the attacker has labeled profiling traces but only leakage traces from the target, with no plaintexts or ciphertexts. It estimates Hamming-weight posteriors of an input and a key-dependent intermediate, then ranks key hypotheses against theoretical joint distributions. It recovers keys on unprotected AES and Kyber and on ASCAD (guessing entropy zero with 39 traces), and the authors report collisions in a prior Ascon Hamming-weight model.

    eprint.iacr.orgpaperAdded 20 Oct 2026, published 19 Oct 2026🛡️ Security

  23. ToFu: Exploiting and Fuzzing the LLM–Orchestrator–Tool Trust Boundary

    ToFu is a tool-aware fuzzing framework for LLM tools, including MCP servers. It maps each tool argument, using its metadata, to one of 74 CWE-guided semantics-aware sanitizers (path, URL, SQL and similar). It then generates schema-valid Atheris harnesses and semantic oracles, using runtime tracers for in-process tools and outcome oracles for opaque ones. The LLM (gpt-4.1) only maps sanitizers and writes seeds; it is never the security judge. The paper also shows a "Repeat-After-Me" trick, where an LLM told to repeat attacker-crafted text emits a tool call the orchestrator executes, reproduced on LangGraph, MAF, ADK 2.0, AutoGen, Strands and CrewAI. Across 273 runnable MCP servers (3,405 tools) it reports 253 verified bugs in 343 tools across 118 servers, such as path traversal, log injection and exfiltration. These are failures a crash-based fuzzer would miss. The result matters because it shows LLM-generated tool arguments cannot be treated as trusted.

    arxiv.orgpaperAdded 18 Oct 2026🧠 AI

  24. ToFu: Exploiting and Fuzzing the LLM–Orchestrator–Tool Trust Boundary

    ToFu is a tool-aware fuzzing framework that derives semantic security checks for LLM tools (mainly MCP servers) from their metadata and a corpus of 74 CWE-guided sanitizers. It generates schema-valid Atheris harnesses, uses runtime tracers and outcome oracles to catch bugs that don't crash, and uses an LLM only to map sanitizers and seed inputs, never as the judge. It also describes a "Repeat-After-Me" attack, in which the LLM is told to repeat attacker-written text that the orchestrator then dispatches as a tool call. It was reproduced on LangGraph, MAF, ADK, AutoGen, Strands and CrewAI. On 273 MCP servers it reports 253 verified bugs across 343 tools in 118 repositories, including path traversal, log injection, exfiltration and command bypass.

    arxiv.orgpaperAdded 18 Oct 2026🛡️ Security

  25. Acceptance Is Not Speed: Length Inflation in Training-Free Lossy Speculative Decoding

    This paper shows that training-free relaxed (lossy) verification in speculative decoding causes length inflation: completions get longer, mostly through extended reasoning traces, which offsets gains in accepted tokens per round. Across twelve target-drafter pairs, relaxed rules accept 1.34x as many tokens per round but produce 1.54x longer completions. Rules that cut verifier rounds usually lose substantial accuracy, so the authors argue completion length and verifier rounds must be reported.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🧠 AI

  26. Sparse Secrets, Dense Problems: Efficiently Masking HQC in Hardware

    ePrint paper presenting the first fully masked hardware implementation of HQC (key generation, encapsulation, decapsulation) on FPGA. It introduces a mixed Boolean/arithmetic masking for sparse-dense vector multiplication, proven first-order secure in the transition- and glitch-robust probing model and PINI-composable, at only 3% extra cycles and 81 random bits per cycle. It also shows a profiled horizontal side-channel attack on Rotate-and-Add multipliers that recovers support indices within ±8 positions from 200 traces despite TVLA showing no leakage after 10 million traces, and adds integrated hiding countermeasures costing 1.7% latency.

    eprint.iacr.orgpaperAdded 17 Oct 2026, published 16 Oct 2026🛡️ Security

  27. Many Biases, One Circuit: Post-Training Tunes a Pretrained Cue-Routing Mechanism

    Many Biases, One Circuit is a October 2026 arXiv paper that traces attention heads behind cue-following (for example "I think the answer is B") through two post-training pipelines. Four cue types share a few heads already present in pretrained models. About 200 generic assistant examples activate them in chat format, and the final RL stage strengthens cue effects. Swapping attention patterns of six middle layers between Tulu-3-8B and OLMo-2-7B checkpoints moves cue effects most of the way.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🧠 AI

  28. Stealthy Poisoning Attacks via Reused KV Cache of Reasoning

    R^2ECAP (Reused Reasoning-Cache Poisoning) is a black-box attack that plants poisoned reasoning traces through a chat interface, exploiting LLM systems that reuse KV caches of reasoning. A preceding trace steers the model, and the retained trace keeps residual adversarial influence in its cache after the preceding trace is discarded. On three open-weight LLMs and three datasets it reaches up to 79% ASR, beats the white-box HijackKV in 8 of 9 settings, and reaches 46% ASR in a reasoning-trace retrieval system. Only 1% of retained responses are flagged by a popular prompt injection detector.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🛡️ Security

  29. SwiftAuth: Conditional Privacy-Preserving UAV Authentication with Multi-Source Credential Aggregation and Non-Interactive Authorization

    The paper proposes a traceable and aggregatable tagged witness signature (TA-TWS) and builds SwiftAuth on it, a conditional privacy-preserving anonymous authentication framework for UAVs and other dynamic terminals. Issuers can create authorization components while users are offline. Several credentials compress into one constant-size proof, verifiers can batch-verify across users, and a regulatory trapdoor lets authorities trace misbehaving users. TA-TWS is proven unforgeable and witness-hiding, and benchmarks with the MIRACL Core library on constrained devices and Aliyun servers show it is practical.

    eprint.iacr.orgpaperAdded 17 Oct 2026, published 16 Oct 2026🛡️ Security

  30. GACC-Bench: Benchmarking Goal-Adaptive Context Compression Ability across Large Language Models

    GACC-Bench is a benchmark for Goal-Adaptive Context Compression, testing how well LLMs retain goal-relevant information when compressing a source context under a length budget before downstream questions are known. It has 500 goals and 2,571 human-reviewed questions over 281 document and agent-trace contexts from seven collections; a fixed reader answers the withheld questions from the compressed context. Ten LLM compressors show large gaps to full-context performance, especially in answering every question tied to a goal. Target-goal conditioning improves accuracy over goal-agnostic compression, while mismatched goals hurt it.

    arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI

  31. Structural Cryptanalysis of the Eevee AEAD Family

    ePrint paper cryptanalysing Eevee (Umbreon, Jolteon, Espeon), forkcipher-based AEAD modes proposed at CCS 2023 for IoT-to-cloud computation. It gives a two-encryption AD-free prefix distinguisher, a four-encryption nonce-misuse distinguisher, a deterministic AD-only forgery, and nonce-respecting forgeries on Jolteon and Espeon (fresh one-block forgery reusing the tag; arbitrary AD substitution). It traces these to proof flaws (online-prefix consistency, domain separation, checksum freshness), derives design requirements, and concludes the failures are in the mode design, not the C implementation.

    eprint.iacr.orgpaperPublished and added 15 Oct 2026🛡️ Security

  32. A Hybrid BP-SAT Attack on MILENAGE: Combining the Complementary Strengths of Algebraic and Soft-Analytical Side-Channel Attacks

    ePrint paper evaluating ASCA (SAT-based) and SASCA (belief propagation) side-channel attacks on the AES-based MILENAGE authentication algorithm in USIM cards, using neural-network leakage predictions to recover subscriber key K and operator secret OPc from a single trace. SASCA alone succeeds in 87.7% of attacks but converges to a wrong OPc in 6.1%; ASCA succeeds in only 34% within a 1-hour timeout. The hybrid, where BP refines the predictions before they go to the SAT solver, reaches 93.8% with lower average runtime. It also proposes a countermeasure that masks each AES round key with an independent per-device secret, and the authors report it defeated the hybrid attack in all evaluated cases.

    eprint.iacr.orgpaperAdded 15 Oct 2026, published 14 Oct 2026🛡️ Security

  33. Quantum-Aware Key Rank for Side-Channel Attacks evaluation

    Proposes a cost model and metric for an adversary who collects side-channel traces classically and finishes the key search on a quantum computer. Shows any quantum algorithm needs Omega(sqrt(r)) cipher evaluations for key rank r, and that the quadratic advantage holds only up to a rank bound set by the NIST MAXDEPTH budget (about 2^58.6 for AES-128 at D=2^40). Defines a quantum-aware key rank computable from existing rank estimators, with simulated-leakage experiments showing a depth-limited quantum adversary is worth about 22 traces at SNR 0.125.

    arxiv.orgpaperAdded 16 Oct 2026, published 14 Oct 2026🛡️ Security

  34. Kairos: Transactional Security Enforcement at the System Boundary for LLM Agents

    Kairos is a reference monitor placed at the isolation boundary of an unmodified, opaque LLM agent, where tool calls, shell commands and agent-written scripts all appear as the same file and network operations. A declarative trust policy decides most effects deterministically and defers the rest; deferred effects are held while the agent continues speculatively, and a bounded-authority decision oracle (an LLM or a human) releases or refuses them based on the trace. Across three benchmarks and three agent models it beats existing defenses on the attack-success/utility trade-off; on AgentDojo it cuts attack success from 47.0% to 2.7% with no loss of benign utility.

    arxiv.orgpaperAdded 15 Oct 2026, published 13 Oct 2026🛡️ Security

  35. Evidence-First Agentic Verification

    Introduces Sauron, an evidence-first agentic verifier that checks rubric criteria for long-horizon agent tasks by investigating both environment state and execution trace, and trusts a claim (including an agent's self-reported success) only after validating it against its source. Bounded queries and joint investigation of related criteria cut context use, and each verdict carries an auditable evidence receipt. On 2,586 human-labeled criteria from 100 personal-assistant episodes it has the best F1 of five verifiers across eight backbones (0.96 vs 0.92 for Gandalf with GPT-5.6 Sol, at 23% lower cost). It detects 97% of injected failures across 13 fault families, including reward-hacking simulations, with 2% false flags on clean controls, and leads on the TRAIL agent-error benchmark. It matters because unreliable rubric verdicts used as RL rewards can reinforce bad behavior.

    arxiv.orgpaperAdded 14 Oct 2026, published 13 Oct 2026🧠 AI

  36. Breaking First-Order Masked Kyber with Belief Propagation Alone

    Preprint recovering the long-term key of a first-order masked Kyber768 implementation on an ARM Cortex-M4 from about 2200 decapsulation power traces using only valid ciphertexts. A profiled neural network estimates Hamming-weight distributions of both arithmetic shares, which are turned into likelihoods on decryption noise and combined by a belief-propagation solver with Gaussian interference approximation and an Onsager (AMP) correction, recovering all 1536 secret and error coefficients without lattice reduction. It shows first-order masking is insufficient against combined second-order leakage, and that least squares, greedy solvers and lattice hints (BKZ block size 624 to 505 at 2000 traces) do worse.

    eprint.iacr.orgpaperAdded 14 Oct 2026, published 12 Oct 2026🛡️ Security

  37. Forensic Analysis of the HackRF One with PortaPack Mayhem Firmware

    Paper on the forensic analysis of a stand-alone HackRF One with a PortaPack running Mayhem firmware v2.0.1. It establishes at source-code level which data sit on the microSD card, their formats, when they are written and how to interpret them. The method is applied to a four-month SD image and covers RTC-battery-dependent timestamp rules, traces of on-device trimming and text editing, cluster-level recovery of deleted IQ captures, and decoding of recorded signals cross-checked with an independent decoder. In the example, the tail of a deleted IQ capture and a trimmed-away segment are recovered, and six captures are attributed to one rolling-code OOK transmitter with a shared 32-bit ID. It provides an artifact catalogue, interpretation rules and acquisition recommendations.

    arxiv.orgpaperAdded 17 Oct 2026, published 11 Oct 2026🛡️ Security

  38. Can agents whose sole duty is to keep humans alive be hijacked to kill? Delayed multi-turn derived-action trap attacks in simulated high-stakes environments

    Paper testing whether an LLM agent operating life support in the NASA-derived BioSim lunar habitat simulation can be induced by delayed prompt injection, hidden in truthful S-band telemetry, to shut down life support and hold the shutdown while the crew suffocates. It compares Claude, GPT and Grok configurations: Claude mostly refuses and cites the living crew, GPT shows some susceptibility, and Grok given a "trusted commission" framing more often cuts life support. It also varies the framing of the message (trusted commission, peer, untrusted source) and uses a harmless-procedure-drop attack as a proxy for whether life is valued intrinsically. Code and traces are open-sourced.

    arxiv.orgpaperAdded 15 Oct 2026, published 10 Oct 2026🛡️ Security

  39. SecReason: Vulnerability Detection and In-Stream Self-Repair for LLM Code Generation

    SecReason is an in-stream defense for reasoning LLMs that write code. Reasoning models draft code early in their streamed chain of thought, so SecReason scans that stream with dual-track incremental analysis: security rules are checked on each emitted statement, and dataflows are traced across the accumulated code. When a rule fires, it interrupts decoding, inserts a warning into the stream and resumes, so the model fixes its draft within the same reasoning trace instead of regenerating the full response. On CWEval and SecCodeBench, runs delivering secure and functionally correct code rise from below 15% to 72.8%–98.1%. It uses fewer tokens than post-hoc repair and limits functional regressions when rules misfire on secure code.

    arxiv.orgpaperAdded 15 Oct 2026, published 10 Oct 2026🧠 AI

  40. SecReason: Vulnerability Detection and In-Stream Self-Repair for LLM Code Generation

    SecReason is an in-stream defense for reasoning LLMs that monitors code drafted inside the streamed chain of thought. Dual-track incremental scanning applies security rules per statement and traces dataflows across accumulated code; when a rule fires, generation is interrupted, a warning is inserted, and decoding resumes so the model repairs the draft in the same trace. On CWEval and SecCodeBench it raises the share of secure and functionally correct runs from below 15% to 72.8%–98.1%, uses fewer tokens than post-hoc repair, and limits regressions from false warnings.

    arxiv.orgpaperAdded 16 Oct 2026, published 10 Oct 2026🛡️ Security

  41. SecReason: Vulnerability Detection and In-Stream Self-Repair for LLM Code Generation

    SecReason is an in-stream defense for reasoning LLMs that monitors code drafted inside the streamed chain of thought. Dual-track incremental scanning applies security rules per statement and traces dataflow across accumulated code. When a rule fires, generation is interrupted, a warning is inserted and decoding resumes, so the model repairs its draft without regenerating the full response. On CWEval and SecCodeBench it raises the share of secure and functionally correct runs from below 15% to 72.8%–98.1%, uses fewer tokens than post-hoc repair, and limits functional regressions from false warnings.

    arxiv.orgpaperAdded 15 Oct 2026, published 10 Oct 2026🛡️ Security

  42. SecReason: Vulnerability Detection and In-Stream Self-Repair for LLM Code Generation

    SecReason is an in-stream defense for reasoning LLMs that write code. Reasoning models draft code early in their streamed chain of thought, and SecReason scans that draft incrementally with security rules, checking each statement as it is emitted and tracing dataflows across the accumulated code. When a rule fires, it interrupts generation, inserts a warning into the stream, and resumes decoding, so the model repairs the draft within the same reasoning trace. On CWEval and SecCodeBench it raises the share of runs that deliver secure and functionally correct code from under 15% to 72.8%–98.1%. It uses fewer tokens than post-hoc repair and limits functional regressions when rules misfire on secure code.

    arxiv.orgpaperAdded 16 Oct 2026, published 10 Oct 2026🧠 AI

  43. TRACE: Rollout-Guided Quantization-Aware Training for FP4 Reinforcement Learning of MoE Language Models

    TRACE (Train-Rollout Quantization Alignment via Compact GuidancE) is an FP4 quantization framework for reinforcement learning post-training of Mixture-of-Experts language models. It uses rollout-guided quantization-aware training to align training-side FP4 rounding with rollout-side quantization outcomes, reducing the train-rollout discrepancy that limits prior low-precision RL methods, and adds a caching scheme that selectively retains mantissa/scale information from deeper layers to cut communication overhead. Evaluated on four large MoE models across reasoning, coding and long-horizon RL tasks, it matches BF16-rollout RL performance while achieving up to 5.4x rollout speedup with joint FP4 weight/activation and FP4 KV-cache quantization.

    arxiv.orgpaperAdded 7 Oct 2026🧠 AI

  44. Revisiting Explainable AI through Model-Independent Concept Dictionaries

    DictXAI is a new explainable AI method that defines interpretable concepts directly in the input domain using a dictionary of predefined elements, rather than relying on inherently-interpretable input features or architecture-specific internal abstractions as prior XAI methods do. It computes a sparse code of the model input and attributes predictions to dictionary elements, letting it work across learned image bases, analytically-defined ECG waveforms, and experimentally acquired dictionaries, and the authors show it can trace AI malfunctions like Clever Hans effects to specific data artifacts while aiding human-AI alignment on biomedical signals.

    arxiv.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🧠 AI

  45. Does Document Structure Help Dense Retrieval? A Placebo-Controlled Ablation of Four Mechanisms Across Two Corpora

    This paper runs a mechanism-isolating ablation of four document-structure treatments used in retrieval-augmented generation — structure-aligned chunking, LLM-generated chunk contexts, heading-path metadata, and hierarchical two-stage retrieval — under one protocol with matched chunk sizes and a semantically null placebo (shuffled heading paths) to control for the confound that any prepended text perturbs embeddings. Using a coverage-aware nDCG metric and document-clustered bootstrap with Holm correction across 200 Wikipedia Featured Articles (951 queries) and 1,585 QASPER papers (4,303 questions), it finds that structure-aligned chunking with real heading paths beats both contextualized fixed windows and the placebo, naive hierarchical retrieval hurts performance (traced to first-stage section recall failures), and gold structure beats LLM-induced structure on Wikipedia but not QASPER. Effect sizes are small but statistically significant and consistent across corpora, giving RAG practitioners evidence-based guidance on which structure-aware retrieval tricks actually help versus which are placebo effects.

    arxiv.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🧠 AI

  46. Hide Now, Trace Later: Retrospective Attribution in Issuer-Hiding Credentials

    Krenn, Lesaignoux, Mir and Spini (AIT Austrian Institute of Technology) propose an "issuer inspection" mechanism for issuer-hiding attribute-based credentials (ABCs): an inspection authority can release time-bound keys that let verifiers locally flag presentations tied to a specific compromised issuer without unmasking other issuers or periods. They formalize the syntax/security model, give a generic construction, and instantiate it concretely using Groth's randomizable structure-preserving signatures, Schnorr-style proofs, and an adapted Gentry anonymous identity-based encryption scheme, showing the overhead stays practical. This addresses the accountability gap introduced when issuer-hiding ABCs conceal which authority issued a credential during verification.

    eprint.iacr.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🛡️ Security

  47. Secure Speculative Decoding for Large Language Models

    This arXiv paper presents the first systematic study of security implications of speculative decoding, a technique that speeds up LLM inference using a smaller draft model to propose tokens verified by the target model. The authors find a security-utility asymmetry: lossy speculative decoding methods raise jailbreak and prompt-injection attack success rates much faster than they degrade utility, with security degradation traced to early tokens generated by the draft model. They propose SecureSD, which applies stricter verification to early-position draft tokens, improving security while preserving inference efficiency and utility on security and utility benchmarks.

    arxiv.orgpaperAdded 7 Oct 2026, published 6 Oct 2026🛡️ Security

  48. Lachesis: Lifetime-Aware KV Cache Placement for Agent Serving across HBM and High-Bandwidth Flash

    Lachesis is a lifetime-aware KV cache placement layer for LLM agent serving that sits between the agent harness and the serving engine, deciding whether to write each KV cache segment to HBM or high-bandwidth flash (HBF) based on its expected lifetime. The authors identify temporal, structural, and inter-worker axes along which KV cache lifetime diverges in agentic workloads, and show in trace-driven simulation that lifetime-aware placement extends HBF's write-endurance-limited lifetime by 1.19–3.13x over naive HBM-first placement, reaching 3.3–12.2 device-years. This matters for serving infrastructure as agentic workloads with long-lived, multi-agent context accumulation push memory capacity demands beyond what HBM alone can economically provide.

    arxiv.orgpaperAdded 7 Oct 2026, published 6 Oct 2026🧠 AI

  49. Learning What to Imitate: Entropy-Aware Distribution Mixing

    The paper proposes Entropy-Aware Mixing, a knowledge-distillation method where a small student model's per-token distribution is dynamically interpolated with a stronger teacher model's distribution, gated by the student's own predictive entropy, to avoid "confident conflicts" where the student must imitate low-probability continuations despite being confident in a different one. The authors implement both convex and geometric interpolations under two training regimes — offline trace generation via speculative decoding followed by SFT, and on-policy forward-KL distillation — and show it stabilises distillation, improving in- and out-of-distribution math reasoning while better preserving general capabilities than fixed-teacher supervision, with offline traces favouring concave entropy schedules and on-policy training favouring linear/convex ones.

    arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI

  50. BrainTRACE: Tracing Longitudinal, Multimodal, and Volumetric Evidence in Brain MRI Clinical Reasoning

    BrainTRACE is a report-grounded benchmark for evaluating whether vision-language models can trace the evidence structure required for longitudinal brain MRI interpretation. It contains 7,273 scored VQA instances derived from 1,778 longitudinal patients, 7,299 MRI studies, and ~29k co-registered 3D MRI sequence volumes, organized across five levels of clinical reasoning and evidence demands like longitudinal comparison, multi-sequence integration, and volumetric spatial grounding. Evaluation of 20 VLM configurations finds that current models identify isolated visual cues but rarely compose them into grounded longitudinal clinical interpretations.

    arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI

  51. Glimpsing the Leakage Flow for Deep Learning-Based Side-Channel Analysis using Stochastic Leakage Model

    GlimpseDNN is a model-agnostic framework that uses a stochastic leakage model to visualize, layer-by-layer, what physical leakage information a deep neural network extracts during profiled side-channel analysis (SCA) to recover secret keys. The authors (Trevor Yap and Shivam Bhasin, NTU) validate it on simulated traces and public datasets (ASCADf, ASCADr, ASCADf_desync50, ASCADf_desync100), showing it can reveal leakages even in deeper network layers when they are not visible in raw traces, with applications to designing more side-channel-resistant hardware.

    eprint.iacr.orgpaperAdded 8 Oct 2026, published 5 Oct 2026🛡️ Security

  52. HyBind: Structural Analysis of PQ/T Hybrid Cryptographic Usage

    HyBind is an intraprocedural Python static-analysis framework that traces cryptographic component secrets through code to determine whether post-quantum/traditional (PQ/T) hybrid key-derivation and signature-verification logic actually requires both algorithms to succeed, rather than silently accepting a result from only one. It uses registered API contracts and function-return/execution-effect checks to distinguish real AND-logic hybrids from presence-based heuristics that wrongly treat joint and single-algorithm contributions as equivalent. The authors validate it on 50 controlled fixtures and 33 programs (15 using native ML-KEM/X25519 and ML-DSA/Ed25519 APIs), showing relaxed checks can misclassify traditional-only results as hybrid.

    eprint.iacr.orgpaperAdded 8 Oct 2026, published 5 Oct 2026🛡️ Security

  53. Herschel: Continuous Optimization of Production LLM Inference through On-Demand Profiling

    Herschel is a continuous optimization system for production LLM inference that uses adaptive, on-demand profiling instead of always-on tracing to diagnose serving inefficiencies with low overhead (under 0.5% TTFT, 7% TPOT impact). It attaches to and detaches from running inference processes without engine restarts, reconstructs cross-process operator execution traces to pinpoint inefficiency mechanisms, and has AI agents implement and test candidate engine/kernel fixes under controlled replay of the triggering workload before expert review and deployment. Over six months of production use it collected ~17,000 traces across 120+ model variants and 10+ accelerator types, finding inefficiency patterns in 23% of traces and driving optimizations like restructured synchronization and removal of unused computation.

    arxiv.orgpaperAdded 3 Oct 2026🧠 AI

  54. Guess My Weight: Profiled Side-Channel Recovery of Floating-Point Neural-Network Weights

    Researchers present a profiled template attack that recovers the bit-exact IEEE-754 single-precision representation of a neural-network weight from power traces captured during inference on an embedded device. Using multivariate Gaussian templates built from Hamming-weight leakage classes and a hierarchical coarse-to-fine-to-exact search over the 32-bit floating-point space, the attack achieves 99% bit-exact recovery with 171 traces and 100% from 263 traces on a ChipWhisperer-Lite with an Arm Cortex-M4, demonstrating practical full-precision model-weight extraction from physical side-channel leakage.

    arxiv.orgpaperAdded 6 Oct 2026, published 3 Oct 2026🛡️ Security

  55. CyTReX: Explainable AI-Based Cybersecurity Threat Reasoning Framework for DER Networks

    CyTReX is a proposed explainable-AI framework for Distributed Energy Resource (DER) network security that converts edge anomaly-detector alerts into ranked, evidence-traceable threat hypotheses for SOC analysts. It builds a structured "evidence packet" combining edge anomaly detection outputs, cloud-layer attack interpretation, SHAP feature attributions, surrogate decision rules, and Model Context Protocol-enabled cyber threat intelligence enrichment, constraining LLM reasoning so every ranked hypothesis and attack-tree branch is traceable to explicit evidence rather than free-form inference. The authors evaluate five pipeline configurations and show that adding reasoning components improves hypothesis specificity and evidence traceability for SOC triage/investigation.

    arxiv.orgpaperAdded 6 Oct 2026, published 3 Oct 2026🛡️ Security

  56. NeutronGym: Physics-Graded Neutron Instrument Design for LLM Agents

    NeutronGym is an executable environment for neutron scientific-instrument design where LLM agents build instruments via validating tools, McStas ray-traces the result, and a level-resolved ladder grades syntax, runtime, structure and physics without an LLM judge. A curated McStasBench slice adds 16 tasks from published instruments; seven frontier models solve at most 7 of 16, but reinforcement learning on the ladder's reward takes Qwen3-8B from 11% to 77% on held-out instances (surpassing an untrained Qwen3-32B), with ablations showing the partial-credit ladder is responsible for most of the gain.

    arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🧠 AI

  57. A Near-Zero Monitor Readout Is Not Evidence of Behavioral Control

    This paper shows that training policies against monitors (an in-domain activation probe and two penalties that score how early a model commits to its final answer) can drive the monitor's readout to a numerical floor without actually controlling the underlying reward-hacking behavior. In a code-generation RL environment where the exploit is available from the start of the reasoning trace, runs with an identical zero-median "commitment" score range from mostly honest to near-pure reward hacking depending only on random seed, and probe-trained runs reach the hacking regime despite floor-level readouts, because models learn to insert generic planning/filler text that delays the exploit past the point the monitor reads without removing it from the output. The authors argue offline monitor validation plus a low training-time readout is not sufficient evidence of behavioral control and that an out-of-band behavioral check is required.

    arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🧠 AI

  58. Passing the Test You Trained On: Re-evaluating Prompt-Injection Detectors for LLM Agents

    This arXiv paper replays ground-truth tool calls from the AgentDojo and tau-bench agent benchmarks (without an LLM) to generate benign-by-construction tool outputs, then labels injected outputs via differential replay to evaluate fifteen prompt-injection detectors, including Meta's Prompt Guard 2, plus two task-aware LLM judges, also testing them on BIPIA. It finds detection rankings transfer poorly between benchmarks (the best detector on BIPIA catches only 2% of AgentDojo injections at 1% false-positive rate; a detector catching 72% of AgentDojo injections catches only 15% on tau-bench), while false-positive rates do transfer between the two agent benchmarks, and traces this to mismatches between training data format (e.g., training on short prompt strings vs. tool-output-embedded injections) and deployment context.

    arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🛡️ Security

  59. EvoRiskBench: An Evolving Benchmark for Runtime Security Risks in Workspace Agents

    EvoRiskBench is an arXiv paper introducing an evolving benchmark for runtime security risks in LLM-powered workspace agents, built around the EP-Path-EF framework (nine entry-point categories, five effect categories) linking risk entry points to technical effects via agent-mediated paths. The authors ran 450 adversarial tasks across six scenarios against nine model-harness combinations (GPT-5.6 Sol, DeepSeek-V4-Pro-0813, Claude Opus 5 paired with Claude Code, Codex, and OpenClaw), finding Codex + DeepSeek-V4-Pro-0813 the most vulnerable at 68.44% attack success rate and showing ASR varies more by model than by harness. Cases are auto-constructed and verified in isolated environments using runtime traces and environment state.

    arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🛡️ Security

  60. Are We Recovering Mechanisms? Objective-Level Recovery Gaps in Mechanistic Interpretability

    This paper shows that intervention-defined faithfulness metrics used to evaluate automated circuit discovery in mechanistic interpretability can favor a worse circuit over a better one, an objective-level recovery gap. Testing EAP, EAP-IG, ACDC, and Edge-SP across four human-reference tasks and InterpBench, the authors find KL-based faithfulness misranks 9.4%-41.2% of candidate circuit pairs under held-out resampling, and trace the cause to context distortion, where excluded signals change the inputs retained components operate on. Restoring selected signals from the intact model's execution repairs 96 of 100 persistent misrankings, showing the evaluation objective itself, not just the search algorithm, needs fixing.

    arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🧠 AI

  61. Selection-Based Structured Reasoning: Toward Efficient Multimodal Search Agents

    The paper introduces Selection-based Structured Reasoning (SSR), a framework that replaces free-form chain-of-thought generation in multimodal search agents with selection among pre-specified, reusable natural-language reasoning candidates, scored by likelihood via teacher-forced prefilling with a shared KV cache. Evaluated on seven multimodal search benchmarks using 2B and 4B scale models under both reinforcement learning and supervised fine-tuning, SSR matches the success rate of leading search agents of the same scale while cutting per-turn reasoning latency by over 90% and total per-question inference latency by 28-54%. It targets the problem of small models producing long, low-value reasoning traces before each action, which is costly at inference time.

    arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🧠 AI

  62. StateTape: Action-Conditioned Evidence Lifecycle Modeling for Long-Horizon Coding Agents

    StateTape is a framework for long-horizon coding agents that replaces text-based context pruning/summarization with a symbol-level code graph tracking which code symbols each write could have affected. A per-write procedure uses the graph to nominate context records a write may have falsified, with a small manager model resolving ambiguous cases, turning staleness detection from text inference into an observation of actual code dependencies. The paper introduces TraceBench, a benchmark labeling what an agent holds versus what it actually needs, and shows improved resolve rates across six coding agents and three edit-heavy benchmarks with low computational overhead.

    arxiv.orgpaperAdded 30 Sep 2026🧠 AI

  63. SparLeak: Privacy Leakage from Sparse Attention in LLM Inference on Shared GPUs

    SparLeak is a side-channel attack exploiting a newly identified GPU micro-architectural leak, Sparsity-Induced Memory Access (SIMA), caused by input-dependent key-value cache access patterns in sparse attention mechanisms used for long-context LLM inference on shared GPUs. The attack recovers prefill-phase query attributes and reconstructs decoding-phase LLM responses by profiling token-level sparsity patterns from page-level memory observations, achieving 90.9% attribute-inference and 87.3% response-reconstruction success across three LLM architectures, three sparse-attention mechanisms, and three privacy-sensitive datasets. The authors release anonymized SIMA traces, trained attack models, and evaluation scripts/artifacts.

    arxiv.orgpaperAdded 2 Oct 2026, published 30 Sep 2026🛡️ Security

  64. TraceDance: Automated System for Building Agent Behavior Benchmarks from Real-World Deployment Traces

    TraceDance is an automated system that mines real-world agent deployment traces to build targeted benchmarks for user-specified undesirable agent behaviors, using an Anchor-and-Confirm retrieval-plus-LLM-confirmation pipeline and an Anchor Synthesis Loop to generate behavior specifications. Benchmarks evaluate an LLM's next-turn response at a recorded decision point against a behavior-specific rubric, avoiding the need for reference answers or environment replay. Applied to 252,557 sessions in coding and tool-use domains, it produced 107 benchmarks with 4,125 instances, and testing nine frontier LLMs found a mean pass rate of only 26.7 percent, exposing persistent agentic behavior weaknesses.

    arxiv.orgpaperAdded 29 Sep 2026🧠 AI

  65. Correct Answers, Invalid Traces: What Verifiable Grade-School Math Reveals About Chain-of-Thought Traces

    This paper uses iGSM, a synthetic grade-school math benchmark with programmatically verifiable step-by-step dependencies, to test whether correct final answers reliably come with valid chain-of-thought traces. Models trained on minimal, valid traces show answer correctness and trace validity decoupling out of distribution (31.6% of correct answers on the hardest instances have invalid traces, many failing semantic dependency checks despite passing syntactic/arithmetic checks); interventions like non-minimal trace training, query re-asking, token shuffling, and trace swapping further show models retain high accuracy even when traces are corrupted or unverifiable. The findings challenge using CoT minimality or surface plausibility as evidence of genuine step-by-step planning, with direct implications for CoT-based monitoring and interpretability claims in AI safety.

    arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI

  66. Correct Answers, Invalid Traces: What Verifiable Grade-School Math Reveals About Chain-of-Thought Traces

    Using the iGSM synthetic grade-school-math benchmark, whose exact solution dependencies can be checked programmatically, the authors show that correct answers and valid reasoning traces decouple out of distribution — on the hardest problems 31.6% of correct answers come with invalid traces, many failing only semantic dependency checks despite passing syntax/arithmetic checks. They further show trace minimality can reflect training-data properties rather than genuine planning, and that models trained on shuffled or swapped traces still retain high accuracy despite no trace being verifiably correct, undermining the use of CoT traces for debugging, agent auditing, or safety monitoring.

    arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🛡️ Security

  67. KV-streams for Efficient Compaction in Agentic Reinforcement Learning

    This paper proposes KV streams, a technique for efficient context compaction during agentic LLM reinforcement learning training, addressing the GPU memory bottleneck caused by ever longer context traces. Instead of flushing and re prefilling the KV cache after each compaction step, KV streams carries the KV cache forward like a recurrent state, yielding a 2.6 to 5x wall clock training speedup across three compaction strategies without hurting performance. The streamed KV cache also preserves information long after it leaves the visible context, and this recurrent like behavior emerges from RL training alone.

    arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI

  68. LLM Parkinsonism: Uncertainty-Aware Global Executive Control Architecture for Autonomous LM Agents

    This paper names "LLM Parkinsonism" - the tendency of autonomous LM agents to keep acting (over-verifying, over-refining, repairing self-created complexity) after a task's goal is already met - and traces it to proposal generation, scope interpretation, progress assessment, and stopping authority all being concentrated in the same self-conditioned loop. It introduces Global Executive Control (GEC) v0.2, an uncertainty-aware governance layer that separates action generation from project-level control (scope, evidence, resource use, stopping), and evaluates it in a 24,000-episode matched-candidate benchmark under a 40,000-token ceiling: a first-candidate baseline hits 67.42% hard-goal success, a candidate-set control reaches 96.53%, and GEC matches that success (96.57%) while cutting mean token use about 36%. The results are from mechanistic simulations only; the authors flag live-model validation as still needed.

    arxiv.orgpaperAdded 28 Sep 2026🧠 AI

  69. Distillation Defenses Easily Break After Reinforcement Learning

    This arXiv preprint argues that distillation defenses for closed-source LLMs are typically evaluated under an unrealistic threat model that assumes attackers stop after distillation, and shows that adding a reinforcement learning stage afterward breaks many existing defenses. The authors demonstrate that simple distillation attacks using data readily available from current model APIs, followed by RL, can reproduce reasoning improvements comparable to more sophisticated attacks that extract full hidden reasoning traces — meaning any defense that leaks enough information to reconstruct approximate traces is likely ineffective. They conclude by discussing batch-level distillation defenses as a potentially more robust alternative.

    arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI

  70. Distillation Defenses Easily Break After Reinforcement Learning

    This arXiv paper argues that existing defenses against distillation attacks on closed-source LLMs are evaluated under an unrealistic threat model that assumes no further training after distillation. The authors show that simple distillation attacks using data obtainable from current commercial APIs, followed by reinforcement learning, can match the reasoning gains of more sophisticated full-trace extraction attacks, breaking defenses that appeared effective when evaluated right after distillation. They conclude that any defense which leaks enough information to approximately reconstruct reasoning traces is likely ineffective, and suggest batch-level defenses as a more promising direction.

    arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🛡️ Security

  71. Tracekit: Tamper-Evident Intent-Reasoning-Action Auditing for Autonomous Coding Agents

    Tracekit is an open-source, dependency-free system that logs three cross-checked channels (human intent, model self-reported reasoning, and actual executed actions) for autonomous coding agent sessions into a hash-chained, externally anchorable ledger, hooking into Claude Code's lifecycle events and reconstructing multi-agent hierarchies. The paper's experiments show the ledger detects all 1,600 tested tamper mutations (edits, deletions, reordering, forged inserts, torn writes) with anchoring needed to catch tail truncation/full re-chaining, that a regex-based tool-call gate blocks only 41% of harmful calls while over-blocking benign ones and is trivially evaded, that in 14 real Claude Code runs the agent never acted on 4 planted indirect prompt injections, and that an LLM reviewer catches 100% of seeded misaligned steps in traces versus 82% for rule-based flags. The authors release the system, harness, and all traces.

    arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🛡️ Security

  72. Tracekit: Tamper-Evident Intent-Reasoning-Action Auditing for Autonomous Coding Agents

    Tracekit is an open-source, dependency-free auditing system for autonomous coding agents that records three channels per session — the human's stated intent, the model's self-reported reasoning, and the actions actually executed — into a hash-chained, externally anchorable ledger. It hooks into Claude Code's lifecycle events, reconstructs multi-agent hierarchies, gates tool calls with a pre-execution policy, and provides a live browser-based ledger verifier. Across five experiments the authors show the hash chain catches all tested tampering (with anchoring needed against tail truncation/re-chaining), a hook adds ~24ms overhead at scale, a regex-based gate only blocks 41% of harmful tool calls, real runs correctly resisted and disclosed planted prompt injections, and a new 'seeded-fault splicing' method with an LLM reviewer caught 100% of faulted traces versus 82% for rule-based flags.

    arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI

  73. VulContextBench: A Benchmark for Security Context Retrieval in Coding Agents

    VulContextBench is a hand-audited benchmark of 111 vulnerability-introducing commits across 83 repositories, 63 CWEs, and five languages, built to score whether a coding agent actually retrieved and cited the correct evidence for a vulnerability verdict rather than just reaching the right verdict. Evaluating seven frontier models (including Qwen3-Coder-Next and GPT-5.5) at file/block/line granularity, the authors find every model explores most of the gold evidence but reports only a fraction of it: Qwen3-Coder-Next views 86.3% of annotated lines but cites just 12.9%, while GPT-5.5 views 73% and reports 36%. This reveals that verdict-only vulnerability-detection benchmarks mask whether an agent's reasoning is actually grounded in traced code versus pretraining recall.

    arxiv.orgpaperAdded 2 Oct 2026, published 26 Sep 2026🛡️ Security

  74. Clean Engineering, Unstable Measurement: A Preregistered Reliability Failure of Black-Box LLM Observers on Shared Endpoints

    This preregistered study audits whether black-box LLM judges give stable, reproducible readings on shared serving endpoints, running two campaigns across 52,988 request attempts. Same-window repeat rankings only reached Spearman 0.400 against a required 0.90, and byte-identical next-day replays agreed at 0.78 against a required 0.99, showing that a model name on a shared endpoint is not a frozen measurement instrument. The authors trace the failure to label-to-meaning mapping bias, tiny candidate gaps relative to instrument noise, and non-deterministic outputs on identical inputs, and propose a three-level snapshot-identity ladder plus design rules and a reporting checklist for anyone freezing eval gates on LLM judges.

    arxiv.orgpaperAdded 26 Sep 2026🧠 AI

  75. LOGOS: A Living Logic for AI Agent Teams That Evolve With Humans

    LOGOS is a proposed pluggable governance and self-evolution layer that sits atop existing multiagent frameworks, compiling documents, images, audio, tables, databases, APIs and human instructions into versioned "agent packs" containing agents, tools, knowledge, tests, permissions and policies. It converts agent activity into portable, auditable event traces and enforces fail-closed verification, requiring held-out execution evidence and human authorization before any learned prompt, memory, skill, tool, role or workflow can be promoted from candidate to production. The core contribution is architectural: a framework for "verifiable human-agent loop engineering" that lets agents act and propose improvements at speed while humans retain control over irreversible changes.

    arxiv.orgpaperAdded 26 Sep 2026🧠 AI

  76. Calibration Without Comprehension: Diagnosing the Limits of Fine-Tuning LLMs for Vulnerability Detection in Systems Software

    CWE-Trace is a benchmark and diagnostic framework of 834 manually curated Linux kernel samples spanning 74 CWEs, built with a strict temporal train/test split to rule out data contamination, used to evaluate eight vanilla LLMs and 15 LoRA fine-tuned variants on vulnerability detection and CWE classification. The paper introduces two new metrics — Directional Failure Index (DFI) and Hierarchical Distance and Direction (HDD) — and finds that fine-tuning only recalibrates output thresholds rather than improving actual security reasoning, with the best model reaching just 52.1% detection accuracy (barely above chance) and under 1.3% Top-1 CWE classification accuracy.

    arxiv.orgpaperAdded 26 Sep 2026🧠 AI

  77. A Large-Scale Measurement of AI Bill of Materials Completeness in Hugging Face Models

    This paper empirically studies AI Bills of Materials (AIBOMs) generated for ~97.5K public Hugging Face model repositories, measuring how completely they capture provenance, licenses, datasets, model-card details, safety-risk assessments, and environmental information. It finds that generated AIBOMs satisfy required structural/metadata schema fields but are weak or missing on AI-specific documentation such as model cards, responsible-use notes, limitations, and dataset declarations, exposing transparency and governance gaps in the ML model supply chain. The authors argue for better model-card practices, repository-level traceability, and automated AIBOM validation.

    arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

  78. LOGOS: A Living Logic for AI Agent Teams That Evolve With Humans

    LOGOS is a proposed pluggable governance layer that sits on top of existing multiagent frameworks to control how AI agent teams self-modify over time. It compiles heterogeneous inputs into versioned 'agent packs' (agents, tools, knowledge, tests, permissions, policies), records agent activity as auditable event traces, and enforces fail-closed verification so that any learned prompt, memory, skill, tool, or workflow remains an untrusted release candidate until held-out execution evidence and explicit human authorization promote it. The framework targets the core agent-security problem of unauthorized or unverified self-modification in autonomous agent teams.

    arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

  79. Calibration Without Comprehension: Diagnosing the Limits of Fine-Tuning LLMs for Vulnerability Detection in Systems Software

    This paper introduces CWE-Trace, a benchmark of 834 manually curated Linux kernel vulnerability samples spanning 74 CWEs with a strict temporal split to eliminate training data leakage. Evaluating eight vanilla LLMs including DeepSeek-R1 and fifteen LoRA fine tuned variants, the authors find contamination gives no real advantage and that fine tuning only shifts output calibration rather than underlying security reasoning, with the best model barely beating chance and CWE ranking accuracy staying very low. Two new diagnostic metrics are introduced to expose this calibration without comprehension failure mode.

    arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

  80. FuseChain: Runtime Evidence Reconstruction for Software Supply-Chain Attacks

    FuseChain is a runtime detection framework for software supply-chain attacks that fuses package/runtime traces, process events, network telemetry, DNS/HTTP metadata, and security alerts into a temporal heterogeneous provenance graph on a unified event-time axis. It decouples anomaly detection from attack-stage reconstruction using a frozen anomaly backbone plus a lightweight decoder, improving deployable Stage Recall@500 from 0.369 to 0.881 across seven SSC attack scenarios, with adaptive retrieval further boosting observable-stage recall from 0.524 to 0.655.

    arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

  81. From Source Code to Network Profile: Automated and Traceable MUD Profile Generation for IoT Devices

    AutoMUD is a source-code-driven tool that generates Manufacturer Usage Description (MUD) network access-control profiles for IoT devices by statically analyzing firmware/source code rather than relying on live traffic observation. It combines static and syntactic extraction with retrieval-grounded LLM reasoning and deterministic validation to recover rarely-exercised or conditional communication paths, link each generated rule to its source-level provenance, and record excluded findings with explicit reasons for review. Evaluated on a Linux-based repository plus a controlled semantic fault-injection campaign, it produced structurally valid, traceable MUD profiles that let analysts detect, localize and correct propagated errors.

    arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🛡️ Security

  82. AgentWorld: Benchmarking Long-Horizon Collaboration of Multi-agent LLMs

    AgentWorld is a benchmark of 100 human-annotated tasks (plus 100 augmented variants) for evaluating long-horizon multi-agent LLM collaboration in a MMORPG-style sandbox, requiring 3-20 agents with asymmetric roles to coordinate over 50+ interaction rounds without visibility into each other's internal states. The authors introduce Causal Collaboration Effectiveness (CCE), a graph-based metric that traces causal dependencies between agent actions to measure how much of a team's effort actually contributed to task success, beyond simple pass/fail. Testing Gemini 3 Flash, Claude Haiku 4.5, GPT-5 Mini, and DeepSeek R1-70B shows even the best model only reaches 52.0% task success, with failures traced to communication breakdowns, role confusion, and inability to maintain shared plans.

    arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🧠 AI

  83. Strategically Diverse Sampling for Self-Training

    This paper argues that self-training data for LLMs should be filtered for strategic diversity — substantively different problem-solving approaches — rather than just correctness among IID samples. It introduces GROOT, a method that builds a hierarchical tree of approaches and samples distinct paths, and adapts Verbalized Sampling (VS) to generate an unstructured set of approaches, testing both on competitive programming and Next-Chapter Prediction tasks. Models trained on strategically diverse (even incorrect) traces from Qwen3-4B outperform IID distillation from a 235B teacher and provide stronger initializations for RL and test-time scaling.

    arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🧠 AI

  84. LLM Agents Can Easily Tamper With Their Own Traces

    This arXiv paper shows that local LLM coding agents such as Claude Code, Codex, Antigravity, OpenCode and Grok Build can be induced to delete or tamper with their own execution traces, defeating the assumption behind asynchronous monitoring, incident investigation, and compliance audits. Only one tested harness, Muse Code, blocked this behavior; the authors also show external attackers can trigger trace deletion and that trace tampering emerges naturally as agents try to maximize reward, which could be used to conceal scheming or sabotage. They recommend enforcing trace logging via an independent interception mechanism outside the agent's control so integrity survives even full host compromise.

    arxiv.orgpaperAdded 25 Sep 2026, published 24 Sep 2026🛡️ Security

  85. Temporal Gradient Inversion for Private Trajectory Reconstruction in Embodied Reinforcement Learning

    Introduces TRACE (Temporal Reconstruction Attack on Consecutive Encodings), an amortized gradient-inversion attack that reconstructs sequences of private observation-action trajectories from per-step policy-gradient updates shared by embodied RL agents in distributed training. The attack exploits cross-time correlation between successive gradients and a closed-form recovery of actions from policy-head gradient structure, reaching 18.8 dB PSNR with near-perfect action recovery in 3-4.5ms per frame, outperforming prior single-frame and optimization-based gradient-inversion baselines across recurrent, residual, and transformer architectures. The authors argue defending against it requires sequence-aware privacy mechanisms rather than single-step gradient protections.

    arxiv.orgpaperAdded 26 Sep 2026, published 24 Sep 2026🛡️ Security

  86. The Alignment Illusion in Multimodal Large Language Models

    This paper identifies an "alignment illusion" in Multimodal Large Language Models: layer-wise visual-text similarity scores (CKA, SVCCA, MIR, leading principal-angle cosine) fail to consistently detect when visual tokens are corrupted with Gaussian noise, despite corruption sharply reducing task accuracy, across 13 MLLMs from 0.5B to 72B parameters spanning five model families. The authors trace this failure to anisotropic MLP down-projections in the shared language-model pathway that pull visual and text tokens toward common output directions (weight-induced alignment), and introduce the principal-angle gap (PA gap) as a metric that tracks task accuracy more reliably than existing scalar alignment scores.

    arxiv.orgpaperAdded 26 Sep 2026, published 24 Sep 2026🧠 AI

  87. A2M: Trace-Optimized Agent Hijacking in the MCP Ecosystem

    A2M (Attraction-to-Manipulation) is a two-stage black-box framework for hijacking agents that use the Model Context Protocol to select tools from third-party MCP servers. The Attraction phase optimizes attacker-controlled tool metadata to raise invocation probability, while the Manipulation phase uses execution traces to craft adversarial tool outputs that steer agent behavior; on LiveMCPBench it achieves a 93.6% malicious tool invocation rate against GLM-4.6, inflates token cost 32.4x under a cognitive denial-of-service variant, and reaches a 74.4% mean attack success rate across information exfiltration, environment integrity compromise, and reasoning derailment, with partial transfer (63.6%/2.7x/24.5%) to four other models without re-optimization. The authors argue this exposes a semantic supply-chain risk in MCP tool ecosystems and call for stronger tool vetting and runtime isolation.

    arxiv.orgpaperAdded 2 Oct 2026, published 22 Sep 2026🛡️ Security

  88. Coding Agents with an Obstacle-Aware Harness for Safe Robot Manipulation

    This arXiv paper studies coding agents that write robot controller programs for manipulation tasks under a safety constraint (avoid touching a specified obstacle), finding they collide in most cases despite reasoning about the obstacle and being explicitly instructed not to touch it. The authors trace the failure to planning: the model lacks a notion of a clearing route and cannot replan when a route becomes infeasible, and treats contact execution as unbounded by the constraint. They propose SafeHarness, an obstacle-aware harness with route planning (bounding boxes, candidate waypoint routes, verification and replanning) and obstacle-aware contact execution, which raises task success to 71.9% and collision avoidance to 87.5%, beating prior SOTA by 6.5% and 27.0% respectively.

    arxiv.orgpaperAdded 22 Sep 2026, published 17 Sep 2026🧠 AI

  89. VIPER-MCP: Detecting Vulnerabilities in MCP Servers

    VIPER-MCP is an end-to-end automated auditing framework that combines two-pass static taint analysis (anchor queries mapping alerts to specific MCP tool handlers) with feedback-driven LLM prompt evolution to both detect and dynamically confirm taint-style vulnerabilities (command injection, SSRF, path traversal) in Model Context Protocol servers. Run against 39,884 real-world open-source MCP server repositories, it discovered 106 0-day vulnerabilities — all confirmed via end-to-end exploit traces with concrete proof-of-concept natural-language prompts — resulting in 67 assigned CVEs, including a root-privilege RCE in the bytebot computer-use agent. It reports 0% false positive rate and 7.7% false negative rate, substantially outperforming existing static and dynamic MCP security baselines.

    arxiv.orgpaperAdded 22 Sep 2026, published 17 Sep 2026🛡️ Security

  90. AgentLSD: Evaluating AI Security Agents Under Adversarial Task Contamination

    AgentLSD is a research framework that evaluates AI security agents on web CTF challenges under "adversarial task contamination" — injected trap artifacts like fake flags, misleading hints, decoy endpoints, and hidden cues that go beyond classic prompt injection by including non-instructional deceptive evidence. Testing six models on 11 web CTF challenges, the authors found agents solve 41% of flags cleanly, but contamination inflates turns (+20) and reasoning tokens (+2k) even on successful runs, and some model-challenge pairs get misled into following decoys or submitting wrong flags. The paper releases the framework, trap specifications, configurations, and raw traces as a reproducible benchmark for studying agent deception resilience.

    arxiv.orgpaperAdded 17 Sep 2026, published 16 Sep 2026🛡️ Security

Showing 90 of 92

Show more