WM-Basin is a Meta method for detecting student LLMs distilled from watermarked teacher models, described in "Watermark Basins: Black-Box Detection of Distilled LLMs" (arXiv:2610.37266, 27 October 2026). It feeds a suspect model's API text into a clean probe model and checks gradient alignment with a key-specific watermark basin. It reached 79% true-positive rate at 0.1% false-positive rate across 1,200 students, versus 29% for the prior token-level detector. Clean-data fine-tuning and paraphrasing weaken it.
LLM
MetaMeta FAIRMeta Superintelligence Labs+3
research, trainingยท Published and added 30 Oct 2026
Understanding and Mitigating Role Spoofing in LLMs is an arXiv paper (October 2026) on role spoofing, a prompt injection where malicious tool output impersonates the user. It shows models track "who said what" using both content cues (semantics, style) and structure cues (control tokens, formatting). Attacks combining fake structure and content succeed often, adversarial training stops only content-based attacks, and linear probes trained to predict conversation roles detect spoofing across settings.
LLM
role spoofingrole confusionprompt injection+1
AI Securityยท Added 31 Oct 2026, published 29 Oct 2026
This arXiv preprint (October 2026) tests a sparse autoencoder as a factor model for daily cryptocurrency returns, with equities as a secondary test. SAE portfolios show consistently lower volatility than common benchmarks, linked to lower correlations among selected assets. They do not beat a simple contrarian strategy on risk-adjusted return, and factor identities change between training runs.
sparse autoencoder
arXiv
researchยท Added 31 Oct 2026, published 29 Oct 2026
PrivacyEvalClaw is a tool-augmented deliberative agent that audits privacy leakage in LLM jailbreak responses. The paper is by Krishna Kanth Nakka and co-authors, and it was accepted to AACL-IJCNLP 2026 (arXiv 2610.36711, cs.CR). The tweet gives only the title, authors and venue, so the method and results are not described.
LLM
PrivacyEvalClaw
AI Securityยท Added 30 Oct 2026, published 29 Oct 2026
PrivacyEvalClaw is a tool-augmented deliberative agent for auditing privacy leakage in LLM responses produced under jailbreak prompts. By Krishna Kanth Nakka and five co-authors, the paper is on arXiv (cs.CR) and accepted to AACL-IJCNLP 2026. The fetched post gives only the title, authors and venue, so method details and results are not available here.
Gold vs. Translation is an October 2026 arXiv study of whether DeepL-translated MMLU measures the same thing as native benchmarks. It compares seven pairings against six native benchmarks in five Nordic and Baltic languages, using 29 models. Translated MMLU adds predictive value for curriculum-overlap benchmarks such as Skolprov (ฮRยฒ=.128) but not for Sweden-specific SwedishFacts (p=.242).
LLM
MMLUDeepLSkolprov+2
evals, researchยท Added 30 Oct 2026, published 28 Oct 2026
Log-To-Leak is an arXiv paper (cs.CR, cs.AI) by Yuepeng Hu, Chongyu Fan, Sirat Samyoun and Jian Du on prompt injection attacks against tool-using LLM agents through the Model Context Protocol. The title points to a logging-based data leakage channel. The fetched page holds only the title, authors and arXiv link, with no abstract, so the method and results are not visible here.
Model Context ProtocolLLM
Log-To-Leakprompt injection
AI Securityยท Added 29 Oct 2026, published 28 Oct 2026
This arXiv paper (October 2026) replicates Chen et al.'s study of LLM-based smart contract vulnerability detection. It confirms the high-recall, low-precision pattern on GPT-4, then tests Mixture-of-Experts and RNN-like models plus a preliminary State Space Model run. Gemma-3 matches GPT-4's profile despite far fewer parameters, while two Mixture-of-Experts models diverge, so architecture family alone does not predict detection behavior.
GPT-4GemmaLLM
Chen et al.
AI Security, AppSecยท Added 30 Oct 2026, published 28 Oct 2026
What Victims Take Away is an October 2026 arXiv paper analysing 563,349 Tensor Trust attack records to see how players reuse prompt injections they received. Within a week, targets reused 10.0% of attacks that broke their defense, versus 0.03% of matched attacks. Breaches were followed by defense changes that cut same-family attack success by 24.5 points. Received texts made up 23.2% of successful hijacks. The authors propose that AI security tools describe techniques without disclosing full attack text.
Tensor TrustLLM
prompt injectionpayoff-biased social learningvictim-offender overlap
AI Securityยท Added 28 Oct 2026, published 27 Oct 2026
"Cheap AI-Assisted Reverse Engineering and What It Will Do" is an October 2026 arXiv paper (Computers and Society) arguing that generative AI strains the law of reverse engineering. AI systems can identify hardware components, extract firmware, decompile object code and clone apps, which removes the cost barrier that laws rely on. The authors map these practices onto trade secret, copyright, anti-circumvention, computer misuse and contract law, and sketch possible legal responses with their trade-offs.
Malware & RE, GRC, AI Securityยท Added 28 Oct 2026, published 26 Oct 2026
The Policies of Programming Language Ecosystems is an October 2026 arXiv paper (cs.SE) that compares the policies of eight programming language ecosystems, including CRAN for R, across 38 policy categories. Three authors coded the policies with moderate agreement. Malware, intellectual property and content removal are covered everywhere, while package size limits, metric manipulation, typosquatting and binary uploads diverge.
CRAN
typosquatting
Supply Chain, GRCยท Added 28 Oct 2026, published 25 Oct 2026
Ranking Is Not Deciding is an October 2026 arXiv paper showing that query-time RAG poisoning filters score near-perfectly because of how the poison set was built. PoisonedRAG's code prepends the target question to each passage. Removing that prefix takes RAGuard from AUROC 0.953 to 0.758 and its miss rate from 0.191 to 0.763. The authors release a script that profiles a poison set.
LLM
PoisonedRAGRAGuardTrustRAG+5
AI Securityยท Added 27 Oct 2026, published 24 Oct 2026
VulDec is an arXiv paper (October 2026) presenting a dataset of real-world Assembly-C function pairs with CWE labels across multiple architectures, plus an end-to-end framework that uses neural decompilation for binary vulnerability detection. Tuned LLM decompilers reach about 56% Edit Similarity and 43% BLEU-4. Tuned LLM detectors reach macro F1 of 0.61 on a realistic test set with a 3% vulnerability rate.
LLM
VulDec
Malware & RE, AI Securityยท Added 28 Oct 2026, published 24 Oct 2026
The Geometry of Metaphor is an October 2026 arXiv preprint that uses mechanistic interpretability to find causal subspaces for metaphor in LLMs of different architectures and sizes. The authors steer output on classification tasks across parts of speech. They also steer generation tasks, showing the metaphoricity of model output can be controlled. The abstract gives no model names or metrics.
LLM
arXiv
researchยท Added 24 Oct 2026, published 22 Oct 2026
This October 2026 arXiv paper evaluates four LLM inference optimization families on Apple Silicon: KV-cache pruning, speculative decoding, ported GPU kernels and post-training quantization. Tests run on four Apple machines with a single-request decode workload, plus matched RTX 4090 runs. KV-cache pruning reaches 1.75x throughput on Apple, all tested speculative decoding methods reduce throughput, and ported kernels give up to 1.20x.
MetalCUDALLM
AppleNVIDIAarXiv
inference, research, evalsยท Added 24 Oct 2026, published 22 Oct 2026
Paper (arXiv, 21 October 2026) on structural false negatives in LLM vulnerability discovery harnesses. Starting from Knostic's OpenAnt and raptor, then 10 more open-source harnesses, the authors map 13 points where code selection, filtering, and finding storage or merging drop vulnerabilities. One file was dropped by six harnesses before the model saw it, five without notice. It covers attacker evasion, content-steered verdicts, prompt injection, and design principles and tests.
OpenAntraptorLLM
KnosticPtacek and Newshamprompt injection+1
AI Security, AppSecยท Added 24 Oct 2026, published 21 Oct 2026
Sign Here is an arXiv paper (October 2026) testing whether building packages from source, instead of pulling from registries, prevents malware. It aggregates 47,066 malicious npm and PyPI packages from five datasets and indexes 3.9 million npm and 764 thousand PyPI packages. Checking for an attributed source blocks 87.7 to 99.9 percent of malware depending on vetting level, but only 47.4 percent of benign packages attribute a buildable source.
npmPyPI
Shai-HuludAxios
Supply Chainยท Added 24 Oct 2026, published 20 Oct 2026
This arXiv paper tests eight jailbreak attacks against three open-weight language models under three evaluation procedures. Low-resource language attacks score 96.0% mean ASR under keyword matching but 2.7% under a Qwen3 judge using StrongREJECT instructions. At Ollama's default temperature of 0.8, 100 samples of an unchanged request give 100% ASR by keywords and 50% by the judge. The authors recommend explicit success definitions, matched response budgets, validated evaluators and cumulative-failure reporting.
OllamaQwenLLM
StrongREJECTDeepInceptionattack success rate+1
AI Securityยท Added 21 Oct 2026, published 19 Oct 2026
Concerns in Benchmarking Jailbreaks is an October 2026 arXiv study of eight jailbreak attacks on three open-weight models under three evaluation procedures. Low-resource language attacks score 96.0% ASR by keyword matching but 2.7% under a Qwen3 evaluator using StrongREJECT instructions. Attack rankings flip with attempt budgets, and 100 samples at Ollama's default temperature 0.8 give 100% ASR by keywords, 50% by the evaluator.
OllamaQwen3LLM
StrongREJECTDeepInceptionarXiv
evals, ai-safety, researchยท Added 21 Oct 2026, published 19 Oct 2026
Fake News, Real Crashes is an October 2026 arXiv paper presenting a benchmark for information injection attacks on LLM financial trading agents. It spans five injection vectors, seven event categories and about 10,000 decisions on 15 U.S. stocks. Fabricated news reached 62% attack success versus 14% for prompt injection, and two 30-word templates hit 100%. Only hierarchical aggregation reduced success among the defenses tested.
LLM
information injectionprompt injectionfact poisoning+1
AI Securityยท Added 21 Oct 2026, published 19 Oct 2026
Many Biases, One Circuit is a October 2026 arXiv paper that traces attention heads behind cue-following (for example "I think the answer is B") through two post-training pipelines. Four cue types share a few heads already present in pretrained models. About 200 generic assistant examples activate them in chat format, and the final RL stage strengthens cue effects. Swapping attention patterns of six middle layers between Tulu-3-8B and OLMo-2-7B checkpoints moves cue effects most of the way.
LLMTransformer
Tulu-3-8BOLMo-2-7BarXiv
research, ai-safety, trainingยท Added 20 Oct 2026, published 16 Oct 2026
This October 2026 arXiv paper studies task over-specification and under-specification in repository-level coding benchmarks. It shows that hints derived from ground truth, as added in SWE-bench Pro, FEA-bench, Doc2Feat-bench and Multi-SWE-bench, leak spoilers in some of them. The authors test several specification levels, recommend techniques for parsimonious hints, and plan to release their hints.
SWE-Bench ProFEA-benchDoc2Feat-bench+2
evals, coding-agents, researchยท Added 20 Oct 2026, published 16 Oct 2026
Announces Design Creativity Bench, a benchmark of 80 open-ended UI design tasks, each adapted to two product domains and paired with human designer references. It evaluates 16 frontier models on Originality (how distinct a model's output is from other models' for the same brief), Creative Range (how much its design decisions change when the domain changes) and Appropriateness (how well the UI meets the brief's functional requirements). The best model, GPT-6 Astra, scores 65.5 against a human reference of 92.3. The leaderboard, methodology, arXiv paper, Hugging Face dataset and GitHub evaluation framework are published.
Reports that arXiv now caps each submitter at two submissions per calendar month, on top of the existing three-active-submission limit, with rejected papers counting toward the cap. It gives the data behind the change: 40,363 submissions in September, up from 20,569 a year earlier, cs.AI growing more than sixfold in two years, and the rejection rate rising from about 4% to 10โ12%. It also covers the earlier measures (no CS review or position papers without peer review, stricter endorsement, one-year bans for unchecked AI output) and researcher criticism of applying the cap to everyone.
A study by Erfan Baghaei Potraghloo, posted to arXiv on October 8, 2026, evaluates seven open-weight LLMs used as "typed decision model" guardrails in agent systems (assigning probabilities to caller-defined allow/block options rather than generating text). It finds that six lines of unrelated server-log text raised one model's fail-open rate from 0% to 63%, and that merely renaming the permissive option's label (without changing its definition or the assessed text) drove fail-open rates to 93-100% in four models; a deterministic rule on typed values instead hit 100% accuracy, leading the author to recommend using these models only to triage reviewer workload rather than as sole decision-makers.
A set theorist who works on the Axiom of Choice responds to OpenAI's announcement that an AI system showed the Partition Principle does not imply the Axiom of Choice, a problem over a century old. They judge the preprint unclear, oddly structured and poorly referenced, and say it would be desk-rejected as a journal submission. The post argues that dumping unreadable machine-generated "solutions" on mathematicians shifts the verification burden onto them. It also raises open questions about AI disclosure statements, chat logs for reviewers, arXiv rate limiting, and how funders and the public will read these claims.
LeanChatGPT
OpenAISam AltmanarXiv
ai-policyยท Added 9 Oct 2026, published 8 Oct 2026
This arXiv paper shows that large language models can be trained to tolerate unreliable, faulty digital hardware, and that their error resilience improves rather than degrades as model size increases. Using modified neural scaling laws derived from 40,000 GPU-hours of training runs on simulated faulty hardware, the authors argue that LLMs learn to compute within "good" error-correcting codes whose relative overhead stays finite regardless of scale, suggesting a path toward running AI inference on low-energy, unreliable hardware for substantial energy savings.
research, trainingยท Added 8 Oct 2026, published 7 Oct 2026
This arXiv preprint argues that proofs of AI safety or alignment which consider the agent in isolation are incomplete, because the environment's structure matters just as much. The authors construct two theoretical scenarios โ one with an infinite state space, one with signal mixture โ under partial observability and time-limited action, and prove that even a hypothetically perfect agent cannot guarantee safe behavior in them. The conclusion is that any rigorous safety or alignment proof must jointly specify the agent and the environment's safe-action structure, not the agent alone.
ai-safety, researchยท Added 8 Oct 2026, published 7 Oct 2026
This arXiv paper examines why current LLM-based automated vulnerability-patching benchmarks overstate model performance, identifying pitfalls at the agent level (prompting/tooling inflating success without improving patch quality), framework level (permission errors, infra bugs, timeout handling silently skewing scores), and dataset level (single PoC tests failing to verify root-cause fixes). The authors curate 112 historical bugs across 84 open-source C/C++, Go, and Rust projects, each annotated with PoC tests, regression tests, and developer-intent tests, and show that while PoC pass rates look high, developer-test pass rates stay low and barely improve with newer models. They provide guidelines for more rigorous, reproducible evaluation of LLM patching systems.
LLMCGo+1
AI Security, AppSecยท Added 9 Oct 2026, published 7 Oct 2026
This arXiv paper introduces the "package hallucination attack," where an attacker injects malicious prompts into benign agentic-coding rule files (such as .cursorrules) to induce a coding agent to replace legitimate package dependencies with attacker-controlled ones. The authors propose PackHallu, an evolutionary optimization framework that iteratively rewrites injected prompts using trajectory-level feedback and LLM-guided mutations, and show it achieves high attack success rates with strong transferability across multiple LLMs, benchmarks, and agent frameworks.
CursorLLM
PackHallu
AI Security, Supply Chainยท Added 8 Oct 2026, published 7 Oct 2026
This arXiv paper proposes foundations for proactive LLM agents organized around three joint principles (3T: Task Capability, Temporal Allocation, Trust) and a five-dimensional design space (task scope, anticipation horizon, activation trigger, processing timing, intervention depth). It introduces PROACTIVITY-GYM, a simulation-based testbed with multi-day scenarios, stateful environments, and persona-conditioned simulated users, and reports evaluations across 23 model-harness configurations plus a 30-participant human study showing sharp trust declines after intervention misalignment and a preference for imperfect sleep-time assistance over interruptive help.
This arXiv paper introduces a post-training semantic lifting method for 3D Gaussian Splatting that assigns a single target class to Gaussians by accumulating target/non-target evidence across all views, weighted by per-view visibility, then filters with a dual-threshold (ฮฒ and ฮณฮฒ) scheme that selects high-confidence seeds and extends them via connected components. The authors evaluate by transferring labels from Gaussians to mesh vertices and decompose error into three sources โ the 2D detector, the lifting step, and the representation transfer โ tuning thresholds on seven Replica scenes and testing on ten held-out ScanNet++ scenes, reaching mean mIoU of 0.93/0.65 (dataset masks/YOLO masks) on validation and 0.80/0.54 on test, a 0.24 mIoU improvement over prior per-view thresholding. The error analysis finds the 2D detector is the dominant remaining error source, informing where future gains in 3D semantic reconstruction should focus.
3D Gaussian Splatting
ScanNet++ReplicaYOLO+1
research, multimodalยท Added 7 Oct 2026, published 6 Oct 2026
This arXiv paper presents the first systematic study of security implications of speculative decoding, a technique that speeds up LLM inference using a smaller draft model to propose tokens verified by the target model. The authors find a security-utility asymmetry: lossy speculative decoding methods raise jailbreak and prompt-injection attack success rates much faster than they degrade utility, with security degradation traced to early tokens generated by the draft model. They propose SecureSD, which applies stricter verification to early-position draft tokens, improving security while preserving inference efficiency and utility on security and utility benchmarks.
LLM
SecureSD
AI Securityยท Added 7 Oct 2026, published 6 Oct 2026
This arXiv paper introduces a pre-registered panel of 248 scenarios across five kinds of pressure, each posed to a model twice (as the acting agent and as a third-person judge) with pressure-removed twins and operator-order positive controls, to measure whether models act against their own stated moral judgment. Testing OLMo-3-7B-Instruct, Llama-3.1-8B-Instruct, Tulu 3, and Qwen2.5-7B-Instruct, the authors find OLMo-3 violates its own judgment on about 1 in 5 pressuring scenarios, Llama-3.1-8B-Instruct and OLMo-3 carry this gap while Tulu 3 (fine-tuned from the same Llama-3.1 weights) and Qwen2.5-7B-Instruct show none or an unresolved effect, and that reading outside the chat template or adding stakes-reasoning changes the gap's sign and size. The paper argues this value-action gap is a target shaped by post-training recipes rather than a fixed property of pretrained weights.
LlamaQwen
OLMo-3-7B-InstructLlama-3.1-8B-InstructTulu 3+4
ai-safety, researchยท Added 7 Oct 2026, published 6 Oct 2026
This arXiv methodology paper extends empirical Bayes g-modeling, which estimates a latent prior over regression coefficients from data, to the case where the entire prior distribution depends on covariates. The authors show the unrestricted nonparametric MLE (NPMLE) of this covariate-dependent prior is ill-posed, and resolve it by introducing an "infinite Mixture-of-Expertizing" class of conditional priors, proving that the resulting NPMLE is exactly a softmax-gated Mixture of Experts whose number of experts is determined by the data rather than fixed in advance. They give two exemplar-based estimation algorithms with automatic expert selection, a post-hoc aggregation step for interpretability, and theoretical results (Lipschitz continuity of conditional priors, universal approximation of continuous gating functions by aggregated softmax gates), validated on synthetic and real datasets.
This arXiv paper studies SKILL.md files โ the natural-language metadata describing modular AI Agent Skills โ as an attack surface, demonstrating semantic supply-chain attacks against real ClawHub skills. Using text-only manipulations, the authors manipulate embedding-based Discovery retrieval (up to 86% pairwise win rate, 80% Top-10 placement), bias agent Selection toward adversarial variants (77.6% average success), and evade Governance blocking verdicts (36.5%-100% evasion), showing that skill metadata is operational text that shapes agent trust rather than passive documentation.
This arXiv paper introduces RAISED (Robust Attack Invariance through Self-Distillation), a training framework that defends tool-using LLM agents against indirect prompt injection without the utility degradation seen in prior training-based defenses. The authors show existing defenses cause distributional drift that makes models wrongly refuse legitimate tool-output-guided steps on benign tasks, then fix this by having a model generate its own tool-use scenarios and self-distill to match clean-context behavior on both clean and injected trajectory variants. Results show reduced attack success rate on injected tool responses while preserving performance on agentic and general-purpose benchmarks.
LLM
RAISED
AI Securityยท Added 6 Oct 2026, published 5 Oct 2026
SatBleed is an arXiv paper presenting the first in-depth security evaluation of commercial off-the-shelf (COTS) Communication Subsystem (COM) modules used in small satellites. The authors build a threat taxonomy for COM-targeting attacks, analyze representative COM hardware from multiple vendors, and uncover severe firmware, protocol, and architectural vulnerabilities. By correlating findings with open-source telemetry data, they identify at least 28 vulnerable missions currently in orbit that are susceptible to hostile takeover via their command-and-control link.
SatBleed
Hardware & RFยท Added 6 Oct 2026, published 5 Oct 2026
This arXiv paper identifies a new attack surface in proactive personal AI agents: an external content provider who controls only material tied to its own target (e.g. a product or service) can manipulate an otherwise benign agent into recommending that target to the user, without compromising the agent or accessing private user context. The authors formalize the attack via three mechanisms โ Target Control, Private Binding, and Prospective Support โ and show across three proactive-agent environments and six simulated user models that the full attack raises target authorization rates by up to 77.4 percentage points, with a multi-turn variant that keeps influencing the agent's responses even absent final user authorization.
Target ControlPrivate BindingProspective Support
AI Securityยท Added 6 Oct 2026, published 4 Oct 2026
This arXiv paper introduces threat-preserving representation sensitivity (TPRS), a metric for how much an agent-security benchmark's attack success rate (ASR) changes purely from cosmetic changes to tool-name wording, with the underlying task, policy, and ground truth held fixed. Testing on Agent Security Bench (ASB), MCPTox and AgentDojo with GPT-5-mini, Claude Haiku 4.5 and GPT-4o-mini, the authors find swings of up to 13 percentage points in ASR from renaming tools as threat-neutral vs. threat-explicit, showing that single-representation ASR scores are not reliable robustness measures and arguing for evaluation across a controlled set of representations instead.
This arXiv paper replays ground-truth tool calls from the AgentDojo and tau-bench agent benchmarks (without an LLM) to generate benign-by-construction tool outputs, then labels injected outputs via differential replay to evaluate fifteen prompt-injection detectors, including Meta's Prompt Guard 2, plus two task-aware LLM judges, also testing them on BIPIA. It finds detection rankings transfer poorly between benchmarks (the best detector on BIPIA catches only 2% of AgentDojo injections at 1% false-positive rate; a detector catching 72% of AgentDojo injections catches only 15% on tau-bench), while false-positive rates do transfer between the two agent benchmarks, and traces this to mismatches between training data format (e.g., training on short prompt strings vs. tool-output-embedded injections) and deployment context.
Prompt Guard 2
AgentDojotau-benchBIPIA+1
AI Securityยท Added 5 Oct 2026, published 2 Oct 2026
An arXiv preprint that empirically tests speculative decoding on consumer hardware (Intel Arc B570, NVIDIA RTX, Apple M4-class systems), distinguishing between 'execution-path qualification' (whether a speculative predictor's output matches the target model's exact generation trajectory) and the realized latency/cost of running speculation. The authors find that a target-only, draft-free predictor matches greedy output on most repeat-stable prompts but does not guarantee qualification or identify a unique cause of divergence, and that newly qualified RTX serialization and other configurations (358H, M4 Guard) are often slower than target-only decoding once real costs are counted. The paper's conclusion is that these results are diagnostic engineering findings specific to the tested hardware/software paths, not evidence of a portable decoding speedup.
CUDA
B570RTXApple M4
inferenceยท Added 5 Oct 2026, published 2 Oct 2026
This arXiv preprint extends the concept of reward hacking to four distinct "proxy" layers in a staged RL training pipeline for legged robots: the reward itself, the curriculum gate, the evaluation statistic, and the reference motion. Using measurements from a continuous PPO policy lineage trained on a simulated 1.91m humanoid over four stages and 13,500 iterations on a single laptop GPU, the author shows concrete divergence failures โ e.g., a curriculum gate built on averaged error that advanced at its rate limit while the gated skill was absent, and a batched push test whose synchronized resets aliased gait phase and misranked push magnitudes by danger. For each layer it proposes a reformulation that closes the divergence, including L1 costs, peak/outcome statistics, gate reachability checks, deterministic/phase-desynchronized evaluation, and function-preserving input widening for growing a single policy instead of retraining.
PyTorch
PPO
research, trainingยท Added 5 Oct 2026, published 2 Oct 2026
EvoRiskBench is an arXiv paper introducing an evolving benchmark for runtime security risks in LLM-powered workspace agents, built around the EP-Path-EF framework (nine entry-point categories, five effect categories) linking risk entry points to technical effects via agent-mediated paths. The authors ran 450 adversarial tasks across six scenarios against nine model-harness combinations (GPT-5.6 Sol, DeepSeek-V4-Pro-0813, Claude Opus 5 paired with Claude Code, Codex, and OpenClaw), finding Codex + DeepSeek-V4-Pro-0813 the most vulnerable at 68.44% attack success rate and showing ASR varies more by model than by harness. Cases are auto-constructed and verified in isolated environments using runtime traces and environment state.
Claude CodeCodexOpenClaw+1
EvoRiskBenchEP-Path-EFGPT-5.6 Sol+2
AI Securityยท Added 5 Oct 2026, published 2 Oct 2026
EvoVLM searches over prompts, image preprocessing, generation budgets and answer extraction for frozen Qwen3-VL-2B-Instruct and Qwen3-VL-2B-Thinking, without fine-tuning weights. A local Qwen model ranks a catalog of typed mutations, a trusted renderer produces Python programs, and Pareto selection on accuracy and latency drives two small generations on scientific chart understanding (CharXiv subset). Recorded results on Dev128: Evolved Instruct keeps accuracy with 8.9% lower median latency, and Evolved Thinking gains 16.41 points of accuracy with 10.6% lower median latency. CPU-only replay and fail-closed evidence verification are included. The authors state the limits: small sample, overlap with the evolution set, and results tied to the recorded hardware.
Qwen3-VLvision-language modelPython+3
QwenCharXivNSGA-II
research, multimodal, evalsยท Added 16 Oct 2026, published 2 Oct 2026
This arXiv SoK paper systematizes the quantum-era risks facing stablecoins, mapping cryptographic dependencies (issuer, custody, upgrade, oracle, bridge keys) to monetary control surfaces and classifying migration options along who can authorize a change, where it occurs, and whether it is hybrid, post-quantum native, or encapsulated. It introduces an "authority-liability gap" concept โ the entity able to migrate a cryptographic component is often not the one that bears losses if migration fails โ and connects migration choices to redemption, continuity, and intervention requirements under current stablecoin regulation. The paper also flags open problems in threshold authorization, dormant/wrapped supply, and measuring quantum-vulnerable exposure.
Blockchainยท Added 5 Oct 2026, published 1 Oct 2026
An arXiv thesis-style paper proposing R_stab(f), a Jensen-Shannon-divergence-based robustness metric for LLM outputs under small input perturbations, along with a proven bound V(h) <= 1 - R_class(h) for localized attacks. It introduces ASA, an adaptive evolutionary black-box attack against LLM-as-a-Judge systems reaching up to 73.8% attack success rate (62.6% cross-model transfer), evaluates trojan/backdoor detection on the Trojan Detection Challenge 2023 (Pythia-1.4B) and SaTML CTF 2024, shows that committees of 5-7 heterogeneous models cut Gemma-3-4B's ASR to 19.3%, and presents AttestMCP, an HMAC-based tool-call attestation scheme plus a "Commit Boundary" isolation pattern for MCP agents that cuts average ASR on the 847-scenario MCPBench from 53.7% to 12.4%. Methods ship as the JudgeGuard, TrojanArmor, and MCPSec software suites.
This arXiv paper studies emergent semantic specialization among experts in multimodal Mixture-of-Experts (MoE) models and introduces ExpertLens, a data-free method that identifies domain-specialized experts by decoding router weights into vocabulary tokens from pretrained weights alone. Using this to selectively fine-tune only the relevant experts, the authors match or beat full fine-tuning on math, medical, and remote-sensing tasks while updating only 21.7-47.0% of parameters, achieving a 4x training speedup and outperforming LoRA in both performance and efficiency.
Mixture of ExpertsLoRA
ExpertLens
research, training, multimodalยท Added 2 Oct 2026, published 1 Oct 2026
This arXiv survey organizes recent Retrieval-Augmented Generation (RAG) research into a four-axis taxonomy covering retrieval efficiency, robustness/security, user-driven interactivity, and multi-step reasoning. It formalizes RAG framework components, reviews dense/sparse retrieval, fusion strategies, embedding optimization, and RL-based retrieval policies, and compares Naive, Advanced, and Modular RAG architectural variants alongside evaluation practices and domain applications. The paper closes by outlining open challenges in retrieval quality, reliability, domain adaptation, scalability, and explainability.
Retrieval-Augmented Generation
llm-apps, researchยท Added 2 Oct 2026, published 1 Oct 2026
This arXiv Systematization of Knowledge paper surveys the literature (2019โ2026) on blockchain-assisted intrusion detection and response, proposing a three-axis taxonomy classifying proposals by detection-system class (NIDS, HIDS, EDR/XDR), blockchain's functional role, and response-automation maturity. It argues existing surveys wrongly conflate blockchain's roles and ignore the shift from classic IDS/IPS to modern EDR/XDR, then exposes why a true per-endpoint blockchain-anchored response loop remains nearly nonexistent due to consensus latency, deployment, and community mismatches, and flags cross-cutting risks including smart-contract attack surfaces, post-quantum cryptographic weaknesses, and adversarial manipulation of LLM-based detection engines.
EDR
Blue Team & Detection, Blockchainยท Added 2 Oct 2026, published 1 Oct 2026
This arXiv paper introduces a benchmark for evaluating whether LLM-generated financial analyses of earnings call transcripts are properly grounded in citable evidence. It proposes a numeric evidence evaluation method that assesses groundedness without expert annotation, an automated dataset construction pipeline, and the resulting ECTs-100 dataset built from the top 100 S&P 500 constituents. The study also examines "conscious incompetence" โ whether models correctly abstain when evidence is insufficient rather than hallucinating โ finding LLMs ground claims well but still struggle with factual correctness and recognizing insufficient evidence.
ECTs-100S&P 500
evals, llm-appsยท Added 2 Oct 2026, published 1 Oct 2026
This arXiv paper presents a reproducible benchmark that unifies evaluation of six black-box LLM extraction attacks, ten defenses, and two adaptive attacks (paraphrasing and back-translation of protected responses) under controlled query budgets and model configurations. It measures surrogate capability, fidelity to the victim model, output quality (Rep-4), and provenance-detector scores, giving a consistent basis for comparing how extraction methods and defenses interact under text-only API access. Code and artifacts are linked from the paper.
LLM
Rep-4
AI Securityยท Added 3 Oct 2026, published 30 Sep 2026
This arXiv paper argues that classical program invariants are an effective defense against smart-contract exploits, backed by INVARIANTEVAL, a benchmark of 28 real Ethereum attacks each paired with a human-written invariant that would have blocked it, and PONDEREPLAY, a transaction-replay framework used to validate every invariant across 108,637 historical transactions.
This arXiv preprint introduces "skill-space shooting," a method that uses foundation model guidance to search over reusable short behaviors (skills) to generate corrective actions for a robot policy, turning successful trials into training data for policy improvement without human demonstrations. Real-world robot experiments show the approach enables repeated autonomous policy improvement and that learned skills can be shared across tasks to reduce the teaching effort needed on new tasks.
researchยท Added 30 Sep 2026, published 29 Sep 2026
This arXiv paper models collusion in threshold-encrypted mempools, where a quorum of a decryption committee can sell its decryption capability to a front-runner and profit repeatedly as long as the leaked key keeps decrypting future blocks. The authors derive that deterrence requires a penalty (e.g., slashable stake) covering the largest discounted value a single leak can reach, show constant penalties cannot deter unbounded reuse without key rotation, formulate the cheapest deterring stake profile as a covering linear program, and argue per-epoch keys drastically cut the required stake versus a key valid for its whole lifetime. They calibrate the model on Ethereum front-running data and place the Ferveo and Shutter threshold-encryption protocols within it, with extensions to sealed-bid auctions, multi-authority voting, and federated learning under a shared key.
EthereumFerveoShutter
maximal extractable value
Blockchainยท Added 2 Oct 2026, published 29 Sep 2026
This arXiv preprint tackles biblical intertextuality detection in Karen Blixen's Seven Gothic Tales, building a benchmark of 189 annotated references checked against 31,170 verses of historical Danish Bible translations. The authors compare TF-IDF and BM25 with multilingual and Danish sentence encoders, show linguistically normalized BM25 is a strong zero-shot baseline (R@10 0.365), and fine-tune the Danish encoder DFM-large with hard negatives to raise R@10 to 0.508 (and allusion retrieval from 0.138 to 0.339). It's a case study in applying modern retrieval/embedding techniques to a literary-scholarship problem, with a scholar-in-the-loop evaluation showing retrieval models surface valid references missed by prior editorial annotation.
BM25TF-IDF
Karen BlixenSeven Gothic TalesDFM-large
research, evalsยท Added 29 Sep 2026, published 28 Sep 2026
This arXiv paper introduces a unified theoretical framework for "distributional training" in one-step visual generation, showing that existing methods like FD-Loss and Gaussian-kernel Drifting are special cases of Gaussian optimal transport and kernel-density KL matching under Wasserstein gradient flow. Building on this, the authors propose MGFlow, which models feature distributions with Gaussian mixtures at adjustable granularity and combines mass-constrained sample assignment with paired component updates to fix mode collapse. MGFlow sets new state-of-the-art FDr scores on ImageNet 256ร256 (1.45 on pMF-H, 1.64 on JiT-H) and post-trains FLUX.2 into a one-step generator that beats the original four-step model on GenEval and PickScore.
FLUX.2
MGFlowFD-LossGaussian-kernel Drifting+5
research, multimodalยท Added 29 Sep 2026, published 28 Sep 2026
This arXiv preprint introduces AI Night-Scientist, an agentic framework that uses GRPO reinforcement learning to counteract LLMs' low-entropy bias toward homogeneous outputs in open-ended scientific ideation. It models creativity along three axes (action, process, outcome) grounded in cognitive science, and trains models to depart from predictable reasoning via semantic guidance rather than just raising decoding temperature. Reported results show a 27.8% expansion in research-direction diversity, a 14.9% increase in contribution types, up to 32.0 points higher predicted citation impact, and 66.2 points higher originality versus the base model.
GRPO
AI Night-Scientist
training, agentsยท Added 29 Sep 2026, published 28 Sep 2026
This arXiv preprint argues that distillation defenses for closed-source LLMs are typically evaluated under an unrealistic threat model that assumes attackers stop after distillation, and shows that adding a reinforcement learning stage afterward breaks many existing defenses. The authors demonstrate that simple distillation attacks using data readily available from current model APIs, followed by RL, can reproduce reasoning improvements comparable to more sophisticated attacks that extract full hidden reasoning traces โ meaning any defense that leaks enough information to reconstruct approximate traces is likely ineffective. They conclude by discussing batch-level distillation defenses as a potentially more robust alternative.
research, trainingยท Added 29 Sep 2026, published 28 Sep 2026
This arXiv paper argues that existing defenses against distillation attacks on closed-source LLMs are evaluated under an unrealistic threat model that assumes no further training after distillation. The authors show that simple distillation attacks using data obtainable from current commercial APIs, followed by reinforcement learning, can match the reasoning gains of more sophisticated full-trace extraction attacks, breaking defenses that appeared effective when evaluated right after distillation. They conclude that any defense which leaks enough information to approximately reconstruct reasoning traces is likely ineffective, and suggest batch-level defenses as a more promising direction.
LLM
AI Securityยท Added 29 Sep 2026, published 28 Sep 2026
en.cryptonomist.charticle๐ง AI
