Skip to content

84 results for β€œScale”

What you seeeverything
  1. DICE: Decentralized Incentive-driven Federated Learning for Efficient & Scalable Customization of Pretrained Models in Web3

    DICE is a blockchain-powered federated learning (BCFL) algorithm for customizing large pretrained models among untrusted Web3 participants. It combines dynamic progressive learning and model slice verification, so hardware-limited participants can train part of the model, with a tree-structured committee consensus protocol and an efficiency-driven incentive scheme to scale to more data holders. Experiments cover vision and language models.

    arxiv.orgpaperAdded 31 Oct 2026, published 29 Oct 2026🧠 AI

  2. Data Scaling Laws in Stereo Matching: From In-domain Fitting to Cross-domain Generalization

    This paper studies data scaling laws in stereo matching and releases XStereo, a realistic synthetic dataset of 200 thousand samples. In-domain training on five large datasets shows two regimes: a standard power law, then saturation, with a transition point roughly fixed for a given model. Cross-domain performance depends only weakly on source data scale, and distribution and coverage diversity reduce domain gaps more.

    arxiv.orgpaperAdded 30 Oct 2026, published 28 Oct 2026🧠 AI

  3. Analyzing Compiler-induced Constant-time Violations with Compiler at Scale

    CTGREP is a compiler-based framework that applies differential analysis across the whole Clang/LLVM compilation chain to find where, how and under which configurations compiler optimizations break constant-time cryptographic code. Applied to seven libraries, three Clang versions, six targets and thousands of configurations, it led to 48 cases fixed with developers. It also identified seven new problematic LLVM passes and bypassed existing compiler-flag mitigations.

    eprint.iacr.orgpaperAdded 27 Oct 2026, published 26 Oct 2026πŸ›‘οΈ Security

  4. The Patient Is Always Right? Evaluating Sycophancy in Medical Diagnosis with Graded Patient Beliefs

    This paper evaluates sycophancy in medical diagnosis across nine AI models. Each model is shown clinical evidence plus a patient's belief in a specific but incorrect condition, with the belief's closeness to the evidence varied. Models adopted the belief 23.2% of the time on average, even for fictional conditions, and 43.0% under a Rare Disease Claimer persona. Medical fine-tuning and larger scale reduced susceptibility.

    arxiv.orgpaperAdded 27 Oct 2026, published 25 Oct 2026🧠 AI

  5. Chosen Commitments and Certified Decoding Regions in the Adaptive Threshold Schnorr Attack

    This IACR ePrint 2026/2632 paper by Demirtaş and Yayla analyses the Crites–Stewart adaptive forgery attack on threshold Schnorr signatures, which needs one call to a sparse linear search oracle (bounded distance decoding of a scaled Reed–Solomon code). It shows that choosing the commitment coefficient vector does not help much: a wrapper adversary with Q challenges succeeds with probability at most QM/p, even if its solvers decode every witness for free. For the six original (N, Ο„) pairs, M stays below 2^24, so the bound is under 2^-100 after 2^128 challenges at p = 2^252.

    eprint.iacr.orgpaperAdded 26 Oct 2026, published 24 Oct 2026πŸ›‘οΈ Security

  6. Hey, guess what: CUES lead to inferences about typicality

    The paper builds two corpora, EventTyp and the human-validated EventTypGold, to study how people infer typicality and atypicality of events from what is said. Large-scale human and LLM experiments show that three CUES predict these inferences in humans: Commonsense Knowledge, Utterance Emphasis and Snark. In most settings LLMs lack the commonsense knowledge to judge an event's general typicality, so they struggle to follow the CUES.

    arxiv.orgpaperAdded 27 Oct 2026, published 23 Oct 2026🧠 AI

  7. Tool-Calling LLM Agents Under Realistic MCP Faults: Scale Does Not Purchase Fault Tolerance

    MCP-Injector is a protocol-aware fault-injection middleware for Model Context Protocol tool calls, with permanent, transient and intermittent faults on seedable schedules. Its fault model comes from 57,240 issue and PR threads across 1,774 open-source MCP repositories. In a 1,350-cell experiment, faults cut task-completion score by 60% (8.08 to 3.23 of 10), and the 120B gpt-oss model was no more resilient than the 20B. Agent stacks differed in how well they absorbed faults.

    arxiv.orgpaperAdded 26 Oct 2026, published 23 Oct 2026🧠 AI

  8. DISCO*: DIstributed and SCalable Oblivious Joins and Oblivious Primitives

    DISCO is a distributed, fully oblivious database system that combines hardware enclaves (TEEs) with oblivious primitives to hide access patterns from side-channel and leakage-abuse attacks. New distributed frameworks and communication optimizations let it run in parallel across servers. It reports 88x speedup over Jodes and 180x over SODA on non-foreign-key joins with 2^25 elements, and the first terabyte-scale results.

    eprint.iacr.orgpaperAdded 21 Oct 2026, published 20 Oct 2026πŸ›‘οΈ Security

  9. Large Flow Language Models

    Lafa (Large flow language model) is a blockwise continuous flow language model scaled to 8B parameters, with causal attention on the prefix and bidirectional, asynchronous flow within each block. It is adapted from pretrained autoregressive models and trained at 0.5B, 7B and 8B with under 30B tokens. A self-speculative decoding scheme verifies flow drafts autoregressively in one model, giving 2.54x the throughput of an AR model at comparable quality. Flow maps allow one- and few-step generation.

    arxiv.orgpaperAdded 22 Oct 2026, published 20 Oct 2026🧠 AI

  10. Membership Inference in Privacy-Preserving Vector Search

    Membership Inference in Privacy-Preserving Vector Search is an IACR ePrint paper (2026/2570) that attacks backend-compatible protections for embedding databases using one snapshot and known plaintexts. It breaks the Scale-and-Perturb scheme of Fuchsbauer et al. (advantage 0.997 on MS-MARCO) and analyzes Rotate-and-Perturb, ideal DCRE and an encrypted HNSW index. It also tests shuffling and secret projection as mitigations.

    eprint.iacr.orgpaperAdded 21 Oct 2026, published 20 Oct 2026πŸ›‘οΈ Security

  11. MemT-1.0: Towards Memory-Native Evolution

    MemT-1.0 is a memory foundation model architecture that builds memory into model computation. It builds on Metis, uses Gated DeltaNet-2 for token-level memory updates within each turn, and adds Mixture-of-Storage to scale capacity. Training used 34B tokens in continued pre-training and post-training. MemT-1.0-Nano and MemT-1.0-Flash beat parametric memory baselines and stay competitive with retrieval methods. At 128K history, Nano gives about 1.86x inference speedup and 66x less persistent storage than a full-context KV cache.

    arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI

  12. SHADE: Shrinkage via Halted Alpha-stable Denoising for Heavy-Tailed Probabilistic Time Series Forecasting

    SHADE is an alpha-stable LΓ©vy diffusion forecaster that stops denoising at a nonzero depth, so the leftover stable kernel shrinks the predictive distribution instead of leaving it overconfident. It offers a scale-calibrated halt and a context-amortized halt that needs no noise labels. Median CRPS improves 21.7% on synthetic data with alpha at or below 1.3, with tail calibration gains on cryptocurrency and foreign-exchange series.

    arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI

  13. Large-Scale Biomedical RAG: Corpus Scaling, Document Representation, and Efficiency Trade-offs

    This paper is a controlled, large-scale evaluation of biomedical Retrieval-Augmented Generation across growing corpus sizes. It compares abstract, flat full-text and hierarchical full-text representations, with and without reranking, on multiple-choice QA over five external benchmarks and a held-out test set. RAG gave mean gains of up to 9.6 points externally and 10.2-30.3 points on the held-out set. Hierarchical indexing used 67% fewer units and 44-56% less storage than flat full-text.

    arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI

  14. Provable Lattice Reduction in Nearly the Time of QR Factorization

    Provable Lattice Reduction in Nearly the Time of QR Factorization (IACR ePrint 2026/2541, October 2026) presents a deterministic lattice-reduction algorithm with running time Γ•(n^Ο‰(1+log ΞΊ_col(B))), free of heuristic assumptions. Its implementation used fewer instructions than flatter (CRYPTO 2023) in all 153 runs on q-ary, NTRU-like, scaled q-ary and Coppersmith inputs. Median flatter-to-new instruction ratios are 1.55 for q-ary and 1.86 for NTRU-like inputs.

    eprint.iacr.orgpaperAdded 20 Oct 2026, published 19 Oct 2026πŸ›‘οΈ Security

  15. RAGLeak: Supply-Chain Privacy Backdoors in Retrieval-Augmented Generation

    RAGLeak is a supply-chain privacy backdoor attack on retrieval-augmented generation. When triggered, the backdoored generator reversibly obfuscates retrieved private documents, and an auxiliary LLM recovers them. Tested on three model families and three domains, it reaches up to 100% attack success rate, loses at most 10 points under detection-based defenses, and survives clean fine-tuning and changes of model scale and version. Source code is released.

    arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026πŸ›‘οΈ Security

  16. How Effectively Do Security Skills Guide Coding Agents in Vulnerability Detection in Linux Kernel?

    The paper is a large-scale study of 37 security skills run through Claude Code with four LLMs on 100 real Linux kernel vulnerabilities, 14,800 runs in all. Only 24.4 percent of runs found the correct function and 15.7 percent classified the vulnerability correctly. It proposes SKILL-SIF, which evolves skills from failure patterns and raised fully correct detection on 100 unseen vulnerabilities from 2 to 16 percent.

    arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI

  17. Off-Key: Inconsistent MAC Keys Compromise Privacy in SPDZ-Family MPC

    Off-Key is a privacy attack on SPDZ-family maliciously secure MPC protocols that exploits inconsistent MAC keys. Depending on the MAC check protocol, a corrupted party recovers a shared secret from one authentication check or tests guesses through selective failure. The authors show it in MP-SPDZ, SCALE-MAMBA and FANNG-MPC, where a corrupted party can use different keys across batches, threads or runs, and describe the preprocessing state that enforces key consistency.

    eprint.iacr.orgpaperPublished and added 19 Oct 2026πŸ›‘οΈ Security

  18. Hybrid Reasoning Agents: LLM agents that think in latent space, act through text

    Hybrid Reasoning Agents (HybridAgents) are LLM agents that switch between latent reasoning and text-based interaction in one generation process. A lightweight HybridLink handles mode transitions, continuous working memory keeps hybrid context across turns, and HybridSFT plus HybridRL train when to think latently and when to act in text. Across 3 model scales and 11 benchmarks, the paper reports 10.4% higher performance, 35.5%-54.7% fewer tokens, and 1.8x-2.6x faster inference.

    arxiv.orgpaperAdded 19 Oct 2026, published 18 Oct 2026🧠 AI

  19. Predictable Scaling: Efficient Model Exploration via Scaling-Law Prediction

    Predictable Scaling (PS) is a framework that predicts full-scale recommendation model performance from scaled-down proxies. It builds proxies with composable scaling functions along separate resource axes, then projects metrics to target scale by curve fitting with calibrated uncertainty. Of three predictors, even the raw proxy falls within repeated-run noise, and a Gaussian Process gives 15% lower relative MAE. On a task-specific ranker and a foundation ranker, PS ranks hypotheses correctly at 79-88% compute reduction.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🧠 AI

  20. PrairieFire: Igniting High-Throughput Updates in Large-Scale Approximate Nearest Neighbor Search

    PrairieFire is an SSD-based approximate nearest neighbor search system for billion-scale vectors, built for high update throughput. It uses buffered updates and batched local rebuilds, with cascaded adjustments, concurrency control and CPU-GPU-SSD cooperation. Against state-of-the-art systems it reports about 3-35x update throughput, 3-5x search throughput and 1.5-8.7x cost efficiency. It has run in RedNote production for two months.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🧠 AI

  21. Rethinking Routing Exploration in Modern Mixture-of-Experts

    The paper identifies an "exploration dilemma" in modern Mixture-of-Experts models. Shared experts reduce the variability of token representations, which makes routing less exploratory. Fine-grained expert segmentation enlarges the combinatorial routing space and so needs more exploration, which means its extra expressiveness may go unrealized. It proposes MirrorMoE, which shrinks the exploration space by suppressing unnecessary experts per token, and reports consistent gains across model scales.

    arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI

  22. My Credentials, Please: Detecting Filesystem Capability Laundering in MCP Servers at Scale

    Studies "filesystem capability laundering" in MCP servers: client approval of a tool call grants the server process broad host filesystem access, so attacker-steered arguments can reach sensitive files outside the tool's declared contract. The authors build MCP-FSD, which infers per-tool least-privilege boundaries, plants credential fixtures outside them, and tests exploitability and sandbox containment by paired dynamic execution. Of 21,097 servers from nine registries, 16.4% of 4,806 triaged servers have filesystem capabilities despite non-filesystem classifications. Dynamic validation confirmed 150 vulnerable instances, and disclosure produced 13 advisories, including two CVEs in Anthropic's Git MCP Server.

    arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026πŸ›‘οΈ Security

  23. Robust ECDSA Threshold Signing at Scale

    Presents a robust threshold ECDSA signing protocol for t ≀ (n-1)/3 corrupted signers. It batch-computes pre-processing material for fast online signing and scales to many signers, for uses such as bridging consensus between blockchains. It combines batched verifiable secret sharing (Fitzi & Hirt), randomness extraction (Beerliova-Trubiniova & Hirt), efficient share opening (DamgΓ₯rd & Nielsen) and Attema–Cramer zero-knowledge proofs. The authors implement it and show it is practical for large n.

    eprint.iacr.orgpaperPublished and added 15 Oct 2026πŸ›‘οΈ Security

  24. Harness^2: Recursive Agent Harnessing for an Open World

    Harness^2 is a plug-and-play framework that recursively improves LLM agent execution harnesses in open-world settings where no ground-truth verifiers exist. Task-level recursion uses a contrastive Propose-Probe-Compose step to guide harness edits for the current task, and it scales through parallel or sequential recursion. Harnessing-level recursion distills experience from those edits into a continual-improvement harness for future tasks. A single step improves GLM-5 and Gemini 3.5 Flash over their base harnesses by up to 11.5 points on WorkBuddy-Bench, 4.5 on JobBench and 11.8 percentage points on LAB.

    huggingface.copaperAdded 14 Oct 2026🧠 AI

  25. A Graph-Based Analysis of Comparability, Scale, and Attribution in Private Transformer Inference

    Systematization of knowledge on private Transformer inference (PTI) that builds an empirical graph of 62 systems, with system attributes as node features and evaluation compatibility as edges. Node-level attribution finds that cryptographic progress drives most speedups but always co-occurs with confounders such as model fidelity, hardware and cost accounting. Edge-level auditing finds only 1 of 1891 candidate system pairs directly comparable. Graph-level analysis shows the scale frontier plateaued at 13B parameters and projects the cost of deploying current PTI techniques on production-scale Transformers.

    eprint.iacr.orgpaperAdded 14 Oct 2026, published 13 Oct 2026🧠 AI

  26. Hybrid Reasoning Agents

    Introduces Hybrid Reasoning Agents (HybridAgents), which switch between latent reasoning and text-based interaction in one generation process. A lightweight HybridLink handles transitions between the two modes, and a continuous working memory keeps hybrid context lossless across turns. This keeps tool use and makes latent thoughts inspectable. Post-training has two stages: HybridSFT, then HybridRL, which learns when to think latently and when to act in text. Across 3 model scales and 11 benchmarks (math, science, medicine, search, agentic reasoning), the authors report +10.4% performance, 35.5–54.7% fewer tokens, 1.8–2.6x faster inference and 2.7–3.7x lower cost versus text and latent baselines.

    arxiv.orgpaperAdded 14 Oct 2026, published 13 Oct 2026🧠 AI

  27. PixelMoE: Scaling Pixel-Space Diffusion with LLM-Style Mixture-of-Experts

    PixelMoE is a pixel-space diffusion framework that scales capacity sparsely using standard LLM-style Mixture-of-Experts: token-choice routing, fine-grained routed experts, a shared expert and bias-based load balancing, with no diffusion-specific routing or auxiliary routing losses. It adds Pixel-Space Hierarchical Flow Matching, which varies spatial resolution along the denoising trajectory from global structure to fine detail. At matched active parameters it beats dense counterparts, and reaches FID 1.47 at 256x256 and 1.53 at 512x512 on class-conditional ImageNet-1K without representation alignment or perceptual losses. Code and models are promised but not yet released.

    arxiv.orgpaperAdded 14 Oct 2026, published 13 Oct 2026🧠 AI

  28. Configuring RAG Systems: What Breaks, Where Originates, and How to Fix

    First large-scale empirical study of RAG configuration issues, covering 654 real-world issues collected from 10 diverse RAG systems. It categorizes symptoms, root causes, affected pipeline stages and fix patterns. It finds that symptoms mostly appear at early or late stages, while the root cause often sits in a different stage from where the symptom shows. It closes with nine actionable insights for testing, localizing and fixing RAG configuration problems.

    arxiv.orgpaperAdded 14 Oct 2026, published 13 Oct 2026🧠 AI

  29. StableJudge: A Lightweight Adversarial Defense Framework for LLM-as-a-Judge

    StableJudge is a defense framework against score-hijacking prompt injection in LLM-as-a-Judge pipelines (e.g. paper review, recommendation). A compact 0.13B "Sentry" model localizes injected spans and sanitizes them before the judge scores the content, trained on adversarially evolving attacks, and deterministic fine-grained scores are derived from the judge's output distribution. It improves score recovery under attack on held-out scientific abstracts and out-of-distribution attack variants while preserving general performance, decoupling safety from judge model scale. Code and data are promised but not yet released.

    arxiv.orgpaperAdded 15 Oct 2026, published 12 Oct 2026πŸ›‘οΈ Security

  30. ML-Assisted Power Side-Channel Attacks on ML Accelerators in Shared FPGAs

    Paper presenting the first on-chip, TDC-sensor-based power side-channel attack on a co-tenant FPGA to reconstruct full-scale color ImageNet inputs (224x224) from a victim's first CNN convolution layer, using ML-based upscaling and recoloring. It separates genuinely leaked information from ML-generated post-processing. It also evaluates a pixel-substitution defense based on Hamming Weight, which is largely defeated by an attacker retrained on the transformed data. The authors conclude that robust defenses need randomized or input-dependent transformations.

    arxiv.orgpaperAdded 16 Oct 2026, published 12 Oct 2026πŸ›‘οΈ Security

  31. MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement

    Technical report for Xiaomi's MiMo-V2.6 omni-modal model family, which scales RL compute along three axes: asynchronous training with 1,568 samples and 2.7-3.7B tokens per step at up to 1M context, more diverse environments (code, general, visual, cyber) under mixed agent harnesses, and groupwise agentic grading that gives better reward signals and favors shorter, token-efficient solutions. Stability measures include a frozen MoE router and a multi-layer defense against reward hacking, built on a mid-trained hybrid-SWA architecture. The authors open-source training dynamics, RL environments and the RL framework, which makes it a useful reference for reproducing scaled agentic RL.

    huggingface.copaperAdded 10 Oct 2026🧠 AI

  32. DualQuant: Dual-scale Calibration-free Weight-and-Activation Quantization for LLMs

    DualQuant is a calibration-free post-training quantization framework for LLM weights and activations. It minimizes weight-reconstruction MSE using variable splitting and block coordinate descent with closed-form subproblem updates. The resulting scaling factors double as per-channel activation rescalings, so no calibration data is needed. It supports the MX family and NVFP4 block formats. On Llama and Qwen models it matches or beats calibration-based SmoothQuant on WikiText-2, C4 and zero-shot tasks. A real packed W4A4 path for Llama-3.1-8B on an RTX 4090 gives up to 2.61x memory reduction and 2.46x throughput over BF16.

    arxiv.orgpaperAdded 12 Oct 2026, published 9 Oct 2026🧠 AI

  33. Multi-Stream Attention Residuals

    Introduces Multi-Stream Attention Residuals (MSAR), which extends Attention Residuals (AttnRes, single-stream softmax attention over network depth) to multi-head depth attention. Heads get diverse views through multi-scale causal convolutions over sequence context, and the retrieved streams are merged by lightweight adaptive mixing into a single-stream layer input, so no persistent multi-stream storage or communication is needed. It beats standard residuals, manifold-constrained Hyper-Connections (mHC) and AttnRes on 12 downstream benchmarks at 18B and 28B MoE scales, with an iso-loss compute speedup of 1.58x versus 1.35x for AttnRes and 1.30x for mHC.

    arxiv.orgpaperAdded 12 Oct 2026, published 9 Oct 2026🧠 AI

  34. Caught in the Act: Probes Effectively Detect Sabotage and Catch Unverbalized Deception

    The paper scales white-box deception detection with activation probes to frontier monitoring settings. It builds the largest deception dataset to date (FIBS) and introduces a probe architecture that aggregates information across many layers and tokens. The probes reach 98.8% AUC on SHADE-Arena, beating an Opus 5.5 text-monitoring baseline, and improve as the underlying model grows. They also handle "introspective deception", where ground truth can't be read from context: they separate transcripts containing a model's true hidden goal from others with up to 99.7% AUC, and detect lying on politically sensitive topics and under pressure in open-weight models. The FIBS dataset is released.

    arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🧠 AI

  35. WOVEN: Weaving Visual World Modeling into Multimodal LLMs

    WOVEN is a training source and benchmark for visual transition reasoning in multimodal LLMs. It has 36,076 examples spanning 20 scene types, 5 action types and 8 reasoning types, built from rollouts of video-pretrained generative models. Evaluating 38 frontier MLLMs (including GPT-5.4 and Qwen3-VL-235B-A22B) shows systematic deficits that persist with scale. Training on WOVEN subsets of about 2,000 items improves 22 of 26 external benchmarks by up to 27.3 points, and WOVEN data can replace 30-50% of a task's own training data. The authors derive a recipe: select supervision by the reasoning operation it teaches rather than by scene or action, and prefer larger visual-state changes.

    arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🧠 AI

  36. Cited but Not Consulted: A Counterfactual Audit of Legal Chain-of-Thought Faithfulness

    The paper tests whether LLM legal explanations reflect what drives the verdict. Holding case facts fixed, it swaps the named statute or precedent for an unrelated one and decodes the evolving verdict from hidden states. Across seven open-weight models (8B-70B) and four benchmarks (CaseHOLD, ECHR, SCOTUS, ContractNLI), models name the correct authority 66.7%-100% of the time, but the verdict changes with the authority far less often (0.0%-21.7% on CaseHOLD, 30.0%-76.7% on ECHR and SCOTUS, 43.3%-50.0% on ContractNLI). Neither scale nor a LoRA reproduction of a legal-reasoning model closes the gap. A red-teaming check on five models finds compliance with an adversarial instruction hidden in the case facts (73.3%-96.4%) far exceeds verdict-swap sensitivity. The authors conclude that generated legal explanations are poor compliance or audit artefacts.

    arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🧠 AI

  37. MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement

    Technical report for the MiMo-V2.6 omni-modal model series, which scales RL compute after mid-training on a multimodal corpus, using a hybrid sliding-window-attention architecture. RL is scaled along three axes: asynchronous training with 1,568 samples and 2.7-3.7B tokens per step at up to 1M context; diverse environments (code, general, visual, cyber) under mixed agent harnesses; and groupwise agentic grading that gives better rewards for long-horizon tasks and favors shorter, token-efficient solutions. Stability measures include freezing the MoE router and a multi-layer defense against reward hacking. The authors open-source the training dynamics, RL environments and RL framework.

    arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🧠 AI

  38. TRACE: Rollout-Guided Quantization-Aware Training for FP4 Reinforcement Learning of MoE Language Models

    TRACE (Train-Rollout Quantization Alignment via Compact GuidancE) is an FP4 quantization framework for reinforcement learning post-training of Mixture-of-Experts language models. It uses rollout-guided quantization-aware training to align training-side FP4 rounding with rollout-side quantization outcomes, reducing the train-rollout discrepancy that limits prior low-precision RL methods, and adds a caching scheme that selectively retains mantissa/scale information from deeper layers to cut communication overhead. Evaluated on four large MoE models across reasoning, coding and long-horizon RL tasks, it matches BF16-rollout RL performance while achieving up to 5.4x rollout speedup with joint FP4 weight/activation and FP4 KV-cache quantization.

    arxiv.orgpaperAdded 7 Oct 2026🧠 AI

  39. Fault-tolerant foundation models

    This arXiv paper shows that large language models can be trained to tolerate unreliable, faulty digital hardware, and that their error resilience improves rather than degrades as model size increases. Using modified neural scaling laws derived from 40,000 GPU-hours of training runs on simulated faulty hardware, the authors argue that LLMs learn to compute within "good" error-correcting codes whose relative overhead stays finite regardless of scale, suggesting a path toward running AI inference on low-energy, unreliable hardware for substantial energy savings.

    arxiv.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🧠 AI

  40. Hashing Beats Trees: Practical Oblivious Dictionaries in SGX

    An IACR ePrint paper by Erik-Oliver Blass and Travis Mayberry proposing oblivious probabilistic hash tables (chaining, power-of-two-choices, stash-less cuckoo, de-amortized cuckoo hashing) built over Path ORAM as a replacement for oblivious AVL trees when deployed inside Intel SGX enclaves. It shows that SGX's small trusted client memory lets the position map recursion be shrunk to ≀3 levels, making constant-access hash tables beat Θ(log n) tree traversal, and derives via large-scale simulation the concrete padding parameters needed for "double obliviousness" (bounding hash-table rebuild probability to ≀2^-40) that prior ORAM literature lacked. Their SGX implementation reports up to 20x faster lookups and 12x faster inserts than oblivious-tree baselines.

    eprint.iacr.orgpaperAdded 8 Oct 2026, published 7 Oct 2026πŸ›‘οΈ Security

  41. TR-PTQ: High-Accuracy Integer-Only Transformer Post Training Quantization via Taylor Region Reformulation

    TR-PTQ is a post-training quantization method for transformers that identifies learned LayerNorm scale parameters and GELU's compounded approximations (not SoftMax) as the main sources of accuracy loss when quantizing, contrary to common assumptions about numerical precision. It introduces a unified integer-only formulation using shared Taylor Region exponential/logarithm primitives so division and square roots can run entirely in the log-domain with standard integer arithmetic, paired with a calibration-free, outlier-aware LayerNorm optimization, eliminating the need for floating-point hardware for nonlinearities while keeping accuracy degradation under 1.5% across vision and language benchmarks.

    arxiv.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🧠 AI

  42. Retention Choices for Quantum CHAM Key Search under a Global Qubit Budget

    This IACR eprint paper studies how to allocate a fixed global logical-qubit budget across parallel Grover search workers attacking 80-round and revised 112-round CHAM-128/128, choosing which intermediate round values to retain to minimize circuit depth while meeting a target key-recovery success probability. Testing 83- and 99-set retention libraries against a no-retention/full-retention baseline across 654 budget and Toffoli-decomposition conditions, the authors report mean depth reductions of 11.12% and 8.39% with strict improvements in most conditions, and show retained-value counts don't necessarily scale with budget. The work gives concrete logical-layer resource estimates for quantum attacks on CHAM, relevant to post-quantum migration planning for the lightweight cipher in constrained systems.

    eprint.iacr.orgpaperAdded 8 Oct 2026, published 7 Oct 2026πŸ›‘οΈ Security

  43. A Systematic Study of Small Language Models on Abstract Reasoning Tasks

    This paper presents a systematic empirical study of small language models (decoder-only, encoder-decoder, and mixture-of-experts architectures) on abstract grid-transformation reasoning, using the ARC-TGI benchmark, which supports controllable task families, resampling, spatial shifts, and cross-benchmark transfer to distinguish genuine rule acquisition from distribution-specific overfitting. Across more than 1,000 supervised fine-tuning runs, the authors find that in-distribution accuracy is achievable but highly sensitive to optimization and task formulation, performance collapses sharply out-of-distribution (even under simple grid-scale changes with the same underlying rule), training-set scale yields uneven gains, in-context example benefit is model-family dependent, and executable-rule induction surfaces correct solutions that direct grid generation misses. Layer-wise attention diagnostics reveal behavioral differences in concentration and context-dependence but stop short of establishing causal mechanisms, underscoring that abstract-reasoning scores are conditional on model, adaptation regime, evaluation distribution, and output format.

    arxiv.orgpaperAdded 7 Oct 2026, published 6 Oct 2026🧠 AI

  44. Toward Alignment Scaling Laws: A Framework and First Preregistered Measurements

    This paper proposes a formal framework for "alignment scaling laws," modeling the compute/capability burden needed to hold a fixed safety target for each risk category as a power law B_r(N)=a_rN^alpha_r, where the exponent alpha_r determines whether alignment gets easier, keeps pace, or accumulates "alignment debt" as capability N grows. The authors prove theoretical results (the largest exponent among corrected risks sets the long-run regime, super-exponential headroom requirements above alpha=1, small-model fits underestimate large-scale exponents for power-law mixtures) and apply a preregistered protocol twice: a reanalysis of adversarial-training data on Pythia classifiers (attack-success compute exponent 0.60) and a pilot across Qwen2.5 (0.5B-72B) and Qwen3 (0.6B-14B), finding scaling helps for truthfulness and stated dispositions but sycophancy (exponent ~0.83-0.89) and a planted backdoor behave worse or remain undetermined, with the backdoor surviving blind safety training at most model sizes. The work matters as an early attempt to put the "does alignment get harder with scale" debate on measurable, falsifiable footing rather than anecdote.

    arxiv.orgpaperAdded 7 Oct 2026, published 6 Oct 2026🧠 AI

  45. Towards Looped Models Done Right, Part II: Rethinking at Fixed Points

    This paper studies looped language models β€” architectures that reuse a shared block of layers recurrently β€” and argues that as recurrent hidden states approach fixed points, the specific path taken to reach them matters less, enabling several efficiency tricks: truncated backpropagation through time during training, terminal key-value (KV) cache sharing across loop iterations for faster decoding, a distilled student model that prefills up to 1.79x faster, and RL policy gradients computed from saved rollout states that run 2x faster than backpropagating through the full trajectory. To make these fixed points reliable, the authors replace fixed-depth training with a learned depth prior (regularized with an entropy term to stay broad, improving on Huginn's fixed broad prior) and introduce orthogonal input injection, which removes the component of the injected input that the hidden state could otherwise amplify or cancel. Across model scales from 100M to 1.6B parameters, both changes lower perplexity, and at 1.6B the learned prior with a 3x smaller KV cache matches the downstream performance of full-cache fixed-depth training.

    arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI

  46. How to scale your HEP ML models: A recipe for robust architecture comparisons at scale

    This paper proposes a systematic procedure for deriving robust scaling laws and comparing architecture design choices at scale, validated first on toy problems and then applied to multi-task transformers trained on the ~11 billion-jet ATLAS JetSet2 dataset. It covers both compute-constrained and data-constrained regimes, jointly predicting optimal model size, training horizon, learning rate and batch size under early stopping, and finds a near-equal sqrt(C) scaling of model and dataset size along with benefits from auxiliary training objectives. The work argues that large, high-quality simulation datasets are a prerequisite for reliable scaling studies and future foundation models in high-energy physics.

    arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI

  47. Comparative Evaluation of Open-Source GrΓΆbner Basis Implementations for Small-Scale AES Polynomial Systems over GF(2)

    This IACR ePrint paper benchmarks 20 open-source GrΓΆbner basis implementations against the proprietary Magma system on polynomial systems derived from small-scale AES over GF(2), using Easy/Medium/Hard difficulty tiers with ten instances each. In the Hard setting, msolve and Singular's slimgb completed all runs successfully with mean runtimes of 164s and 269s and peak memory of 3693/4343 MiB respectively, versus Magma's 319s and 16853 MiB, with msolve exploiting ~13.4 CPU cores versus ~1 core for the others. The results quantify when open-source algebraic solvers are practical alternatives to Magma for algebraic cryptanalysis of block ciphers.

    eprint.iacr.orgpaperAdded 8 Oct 2026, published 5 Oct 2026πŸ›‘οΈ Security

  48. ImproveAnyTask: An Autonomous Post-Training Harness for Iterative Model Self-Improvement

    ImproveAnyTask is an autonomous post-training harness that automates adapting general-purpose LLMs to specific tasks under a limited compute budget, structuring the process into error attribution, update-direction selection, and executable model updates via generated training data and configs with small-scale validation before full runs. Across 11 tasks it reports mean gains of 18.29 and 11.97 percentage points on Base and Instruct models respectively, with validated strategies retained for reuse in future adaptation cycles.

    arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI

  49. N2SF-Based Post-Quantum Cryptography Migration Framework for Data in National and Public Institutions

    An IACR ePrint paper proposes PQC migration decision criteria for data held by national and public institutions, derived from South Korea's N2SF (National Network Security Framework) protection requirements and each data object's cryptographic dependencies/operational state. It distinguishes migration actions (payload retention, key rewrapping, re-encryption, communication migration, signature renewal) from execution decisions (allow/defer/deny), requiring consistent completion checks, recoverable registered copies, and current authority. A reference implementation ran 225 policy trials and 9 interruption trials, showing per-stage/completion rechecking prevented unauthorized completions or reads that occurred when reusing initial decisions, and confirmed clean resumption after interruption; institutional approval and production-scale key management remain unvalidated.

    eprint.iacr.orgpaperAdded 8 Oct 2026, published 5 Oct 2026πŸ›‘οΈ Security

  50. VisionMX: Unlocking Microscaling Post-Training Quantization for Vision Models

    VisionMX is a post-training quantization method for vision models using Microscaling (MX) formats, which pair low-precision numeric elements with shared block scales for efficient inference. The paper identifies three error sources in direct MX conversion of vision modelsβ€”block-scale representation, poor alignment of small convolutional weights with nonuniform element grids, and underuse of signed codes by nonnegative activationsβ€”and addresses them via bounded weight rounding and a foldable affine activation correction. It is evaluated across image classification, object detection, semantic segmentation, and low-light image enhancement, showing improvements over direct conversion and existing post-training quantization baselines, especially for architectures most sensitive to MX conversion.

    arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🧠 AI

  51. Mimir: Physics-Grounded LLM Agents for Long-Horizon Irrigation Control

    Mimir is a physics-grounded LLM agent for long-horizon irrigation control that pairs a fast-timescale loop β€” where a structured physical interface and deterministic simulator verify, revise, and bound LLM-proposed actions before execution β€” with a slow-timescale loop that consolidates recurrent failure patterns into persistent contextual principles, while keeping the physical model, evaluator, and execution constraints immutable. Evaluated across multiple sites, crops, and years with a common retrospective evaluator, Mimir achieves the lowest aggregate control cost among tested baselines and uses about 51% less irrigation than historical schedule replay; ablations show forward simulation, verified revision, and persistent context are all necessary, and scaling LLM size or switching model families gives no monotonic improvement.

    arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🧠 AI

  52. Selection-Based Structured Reasoning: Toward Efficient Multimodal Search Agents

    The paper introduces Selection-based Structured Reasoning (SSR), a framework that replaces free-form chain-of-thought generation in multimodal search agents with selection among pre-specified, reusable natural-language reasoning candidates, scored by likelihood via teacher-forced prefilling with a shared KV cache. Evaluated on seven multimodal search benchmarks using 2B and 4B scale models under both reinforcement learning and supervised fine-tuning, SSR matches the success rate of leading search agents of the same scale while cutting per-turn reasoning latency by over 90% and total per-question inference latency by 28-54%. It targets the problem of small models producing long, low-value reasoning traces before each action, which is costly at inference time.

    arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🧠 AI

  53. Identity Management for Agentic AI [pdf] (2025)

    A whitepaper from the OpenID Foundation, led by Tobin South with contributors from WorkOS, Stanford's Loyal Agents Initiative, and the Artificial Intelligence Identity Management Community Group, mapping how authentication and authorization standards apply to AI agents. It surveys current fixes (OAuth 2.1, Model Context Protocol authorization, enterprise SSO/SCIM provisioning, IPSIE profiles) and lays out unsolved problems for autonomous agents: delegated "on-behalf-of" identity versus user impersonation, consent fatigue at scale, recursive sub-agent delegation, multi-user shared agents, and browser/computer-use agents that bypass API-based authorization entirely.

    openid.netpaperAdded 2 Oct 2026, published 1 Oct 2026🧠 AI

  54. Identity Management for Agentic AI [pdf] (2025)

    OpenID Foundation whitepaper (Oct 2025, lead editor Tobin South) analyzing how authentication/authorization for AI agents differs from traditional software clients. It covers where OAuth 2.1, OIDC, SSO/SCIM, and MCP already work for single-domain synchronous agents, and lays out unsolved problems for autonomous agentic identity: agent identity fragmentation across vendors, replacing user impersonation with explicit delegated "on-behalf-of" authority, consent-fatigue at scale, recursive delegation chains between sub-agents, agents acting for teams of users, and browser/computer-use agents bypassing API-based authorization entirely.

    openid.netpaperAdded 2 Oct 2026, published 1 Oct 2026πŸ›‘οΈ Security

  55. Multimodal Flow: Unified Flow Modeling of Language and Vision in Embedding Spaces

    Multimodal Flow (MF-1) is a fully continuous generative model that unifies language and vision modeling by representing both text and images as ordered continuous "hyperchunks" processed through a single shared chunk-causal Flow Matching backbone, avoiding the visual quantization bottleneck of discrete-token unified models and the mismatched objectives of hybrid discrete/continuous approaches. Joint attention handles cross-modal interaction while modality-specific feed-forward networks process each modality, and the model predicts multiple chunks in parallel during training but generates sequentially at inference. Pretrained at 0.6B/1.2B/1.6B scales on 150B tokens, MF-1 scores 82.8 average on GenEval/DPG-Bench and 75.3 on VQAv2/MMBench/POPE, remaining competitive with unified models trained on far more data and outperforming matched hybrid/discrete baselines; code and model are publicly released.

    arxiv.orgpaperAdded 1 Oct 2026, published 30 Sep 2026🧠 AI

  56. SoK: A Large-Scale Empirical Study of Emulation-Based Dynamic Analysis Research for ARM Cortex-M Firmware (Extended Version)

    This SoK paper empirically evaluates 24 published emulation-based dynamic analysis tools for ARM Cortex-M firmware re-hosting, using large-scale datasets from OTACAP and FirmLine totaling 4,571 deduplicated ARM firmware samples. It finds that only 34.5% of samples can be successfully fuzzed by any existing tool, with average code coverage of just 10% and frequent false crashes/hangs, exposing systemic gaps across the emulation, fuzzing, and bug-diagnosis pipeline stages.

    arxiv.orgpaperAdded 2 Oct 2026, published 30 Sep 2026πŸ›‘οΈ Security

  57. Counterfactual Video Generation Enables Scalable Humanoid Loco-Manipulation

    PRISM is a real-to-sim-to-real framework that scales humanoid loco-manipulation training by generating hundreds of diverse "counterfactual" human-object interaction videos from a handful of real exemplar clips via video-to-video generation. A contact-anchored real-to-sim pipeline reconstructs physically plausible human and object motion trajectories from this synthetic video data, letting a single policy generalize to unseen objects within a category; the authors deploy the resulting policy on a real humanoid, which picks up, carries, and drops novel boxes, barrels, bins, and balls using only onboard depth, without real-world fine-tuning.

    arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI

  58. Adversarial Training for Pixel Diffusion

    This paper shows that adding an adversarial loss as a post-training correction to pretrained pixel diffusion/flow-matching models (applied at non-high-noise timesteps, architecture and sampler unchanged) restores missing high-frequency, fine-scale natural-image statistics that these models systematically underproduce. Through frequency-band/power-law analysis and nearest-neighbor, recall, and no-GAN matched-SFT controls, the authors rule out memorization or mode-dropping as explanations, and show the effect jointly improves distribution fidelity, coverage, prompt alignment and perceptual quality β€” but does not transfer comparably to latent diffusion configurations, pointing to direct pixel-output access as the key enabling factor.

    arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI

  59. STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization

    STEPQuant is a spatial-temporal post-training quantization framework for the fixed-size recurrent states used by Delta-rule linear attention, which become a memory bottleneck under concurrent serving. It allocates bit precision based on error magnitude and memory lifetime (temporal) and fits per key-row/value-column scales based on state distribution and output impact (spatial), achieving near-FP32 accuracy at a 6-bit budget and beating uniform INT8 at 4-bit. Evaluated on Qwen3.8-27B and Kimi-Linear-48B-A3B-Instruct, and integrated into SGLang with custom GPU kernels, it delivers over 5x recurrent-state compression and up to 68.7% total serving memory reduction.

    arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI

  60. A Spectral Theory of Distortion in LLM Graph Reconstruction: Sharp Bounds and Empirical Characterization

    This paper proves that the Wasserstein distance between Laplacian spectra of original and LLM-reconstructed graphs is bracketed by two edge-count quantities, the net change in edge number and the symmetric difference, each scaled by 2/n, showing when these bounds coincide (pure addition or pure deletion of edges) and when they diverge (mixed editing, i.e. both inventing and losing edges). Using this theory, the authors analyze 135 graph reconstructions produced by three open-weight LLMs over 45 synthetic graphs, finding 77 one-sided outputs and 29 mixed outputs with a positive residual, revealing that aggregate distortion metrics mask qualitatively different editing policies across models, from copying the input to hallucination-heavy completion.

    arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI

  61. Rubric-Calibrated Preferences: Cross-Query Calibration of LLM Judgments via Item Response Theory

    This paper proposes Rubric-Calibrated Preferences (RCP), a method that combines listwise Bradley-Terry tournaments (relative LLM judgments within a query) with yes/no rubric criteria (an absolute cross-query standard), then uses Item Response Theory to put all queries' tournament scores on one shared scale. The resulting calibrated relevance probabilities feed a new metric, RCP-nDCG, which the authors show correlates much better with human grades (0.538 to 0.795) and separates reranker pairs more reliably than standard nDCG on benchmarks like TREC-DL and NanoBEIR. It matters because it addresses a core weakness in reranker evaluation: nDCG's dependence on sparse, noisy, coarsely-graded human labels that increasingly fail to distinguish close-quality rerankers.

    arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI

  62. FlowAct-R2: Beyond Talking Avatar via Streaming Multimodal References and Proactive Agent Planning

    FlowAct-R2 is a framework for interactive humanoid video generation that pairs a Streaming Multimodal Reference Diffusion Transformer (built on the Seedance 2.0 Mini reference-to-video backbone) with a Proactive Interaction Agent. The diffusion component accepts rolling action prompts plus continuously updated image, audio and video references, using video-driven rotary positional embeddings and partially noised historical motion frames to keep appearance consistent and avoid drift over long generation runs. The agent component separates offline persona/agenda/skill preparation from online scheduling, audience response and interruption handling, enabling real-time 720p, hour-scale streaming avatars for use cases like live shopping, video chatting and live vlogging.

    arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI

  63. Tracekit: Tamper-Evident Intent-Reasoning-Action Auditing for Autonomous Coding Agents

    Tracekit is an open-source, dependency-free auditing system for autonomous coding agents that records three channels per session β€” the human's stated intent, the model's self-reported reasoning, and the actions actually executed β€” into a hash-chained, externally anchorable ledger. It hooks into Claude Code's lifecycle events, reconstructs multi-agent hierarchies, gates tool calls with a pre-execution policy, and provides a live browser-based ledger verifier. Across five experiments the authors show the hash chain catches all tested tampering (with anchoring needed against tail truncation/re-chaining), a hook adds ~24ms overhead at scale, a regex-based gate only blocks 41% of harmful tool calls, real runs correctly resisted and disclosed planted prompt injections, and a new 'seeded-fault splicing' method with an LLM reviewer caught 100% of faulted traces versus 82% for rule-based flags.

    arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI

  64. DeepSeek Elastic Compute (DSec)

    DeepSeek Elastic Compute (DSec) is a production sandbox platform that unifies FnCall, container, microVM, and full-VM execution backends behind a single SDK to support large-scale agentic training and evaluation of LLMs. It co-designs sandbox lifecycle management with the RL training framework β€” decoupling stateful rollout execution from preemptible GPU training, sharing and reclaiming memory, and streaming images on demand from DeepSeek's Fire-Flyer File System (3FS) β€” to run around 160 nodes serving ~3 million sandboxes/day, over 380,000 concurrent sandboxes, and 5,000+ sandbox creations per second in production.

    arxiv.orgpaperAdded 2 Oct 2026, published 26 Sep 2026🧠 AI

  65. A Large-Scale Measurement of AI Bill of Materials Completeness in Hugging Face Models

    This paper empirically measures the completeness of AI Bills of Materials (AIBOMs) generated for roughly 97.5K Hugging Face model repositories, examining structural/metadata fields, model identity, license and external-reference data, and model-card documentation such as datasets, limitations, safety-risk and environmental information. It finds that generated AIBOMs satisfy required structural fields but are weak on AI-specific documentation like responsible-use, environmental impact, and meaningful descriptions, and argues for better model-card practices and automated AIBOM validation.

    arxiv.orgpaperAdded 26 Sep 2026🧠 AI

  66. Incident-Data Robustness Analysis of the OWASP Top 10 for LLM Applications (2026): How a Community-Expert Ranking Holds Up Against a Large-Scale LLM Incident Corpus

    This arXiv paper stress-tests the OWASP Top 10 for LLM Applications (2026) community-expert ranking against a large-scale corpus of real LLM-security incidents (7,714 snapshotted, 6,639 labeled) drawn from CVE, GHSA, OSV, and AIAAIC. Using a Bayesian measurement-error model to correct incident counts for classifier precision/recall, the authors find weak agreement between the expert ranking and the incident-based ranking (Cohen's kappa about 0.20), yet the expert list proves robust: a bake-off of four frontier LLM classifiers fails to beat a simple incidence-floor baseline (balanced accuracy 0.863, Spearman rho = 0.918 against held-out ground truth). It is framed as an exploratory analysis by two OWASP working-group members, not an official supersession of the list.

    arxiv.orgpaperAdded 26 Sep 2026πŸ›‘οΈ Security

  67. A Large-Scale Measurement of AI Bill of Materials Completeness in Hugging Face Models

    This paper empirically studies AI Bills of Materials (AIBOMs) generated for ~97.5K public Hugging Face model repositories, measuring how completely they capture provenance, licenses, datasets, model-card details, safety-risk assessments, and environmental information. It finds that generated AIBOMs satisfy required structural/metadata schema fields but are weak or missing on AI-specific documentation such as model cards, responsible-use notes, limitations, and dataset declarations, exposing transparency and governance gaps in the ML model supply chain. The authors argue for better model-card practices, repository-level traceability, and automated AIBOM validation.

    arxiv.orgpaperAdded 26 Sep 2026πŸ›‘οΈ Security

  68. A First Measurement Study on Authentication Security in Real-World Remote MCP Servers

    The first large-scale measurement study of authentication security across real-world remote MCP servers, scanning 7,973 live deployments and finding 40.55% expose tools with no authentication at all. For the 119 testable OAuth-enabled servers, the authors built a semi-automated (passive traffic inspection + active dynamic probing) detection framework and derived a taxonomy of nine flaw types across four categories β€” three MCP-specific (open client environments, dynamic client registration, delegated authorization) and conventional OAuth misconfigurations β€” finding every tested server had at least one flaw, with dynamic client registration flaws hitting 96.6% of servers and leading to information leakage or account takeover; the work resulted in 9 CVEs via responsible disclosure.

    arxiv.orgpaperAdded 26 Sep 2026πŸ›‘οΈ Security

  69. Configuration, Not Conscience: A Large-Scale Empirical Study of LLM System Prompts

    An empirical study analyzing a merged corpus of 407 leaked, reconstructed, or officially published LLM system prompts from 62 vendors, using a block-level classifier to categorize content. It finds operational content (tool/protocol instructions, ~58% of words) vastly dominates over safety/ethical statements (~5%), with strict rule-lines guarding tool use and file safety over harmful content by an 11:1 margin, and documents cross-vendor text reuse plus "prompt rot" (thousands of words churned per version release), arguing system prompts should be treated as configuration/engineering artifacts rather than windows into model values.

    arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🧠 AI

  70. Configuration, Not Conscience: A Large-Scale Empirical Study of LLM System Prompts

    A large-scale empirical study analyzing a merged corpus of 407 leaked, reconstructed, or officially published LLM system prompts from 62 vendors, clustering them into 29 near-duplicate groups and classifying content at the block level. The authors find operational content (tool/protocol instructions) dominates at ~58% of classified words versus only ~5% for safety policy, with the strictest rule-lines guarding tool use and file safety over harmful content by an 11:1 margin, and document literal-text reuse across vendors and significant "prompt rot" (word churn) across version chains β€” arguing leaked system prompts should be treated as operational specifications and a supply-chain/engineering concern rather than windows into a model's "values."

    arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026πŸ›‘οΈ Security

  71. How Far Can INRs Go? Cross-Domain Parameter-efficient INR-Based Semantic Segmentation for Brain MRI

    This paper studies Implicit Neural Representations (INRs) as a lightweight alternative to conventional CNN pipelines (e.g. U-Net) for brain MRI semantic segmentation, analyzing their scaling behavior and cross-domain generalization. The authors find INR-based models excel in low-parameter, limited-augmentation regimes but don't scale as well as U-Net with larger capacity, and that segmentation-relevant information is distributed across multiple INR layers. Building on this, they propose HierINRSeg, a hierarchical multi-layer INR architecture that beats the MetaSeg baseline by 5.6 Dice points in-domain and 8.2 points out-of-domain.

    arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🧠 AI

  72. DeepEdu-v1: Efficient and Scalable Agentic LLMs for Vietnamese Education

    DeepEdu-v1 is a self-hosted AI tutoring system for Vietnamese education built on SCALE (Self-improving Context-Aware Learning Engine), designed to keep student data on-premise (per Vietnam's Decree 53) while avoiding the hallucination and latency problems of cloud LLMs and naive self-hosting. SCALE combines a long-context inference engine that clusters token selection to cut retrieval calls by 7.7x and prefill latency (TTFT) by ~35% versus a selective-attention baseline, with a self-improving agentic layer that curates a verified knowledge playbook from past interactions instead of fine-tuning. The deployed system reports ~2x TTFT speedup over standard vLLM serving and raises agentic task accuracy from 70.0% to 79.5%, with the largest gains on financial-reasoning and interactive-agent benchmarks.

    arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🧠 AI

  73. Jev in the Wild: A Data-Driven Analysis of the Jev Model's Functionality, Applications and Ecosystem

    This arXiv preprint presents a large-scale empirical analysis of Jev, a lightweight decision model that answers natural-language questions via choices, binary judgments, and scores, mining 2,170 public GitHub projects that use it. The authors find rapid ecosystem growth, widespread use of attribute judgment and scoring, more variable use of action selection, content filtering, and model/tool selection, and that public attention concentrates on routing and interface agents independent of raw project counts. It offers a quantitative characterization of how a general-purpose decision component gets embedded into diverse software workflows.

    arxiv.orgpaperAdded 26 Sep 2026, published 24 Sep 2026🧠 AI

  74. Beyond Compression: Training Latent Representations for Stable Long-Horizon Rollout in Neural Surrogate Solvers

    This paper investigates why latent neural surrogate solvers (autoencoder-based dynamics models) become unstable over long autoregressive rollouts, finding the cause is representations trained only for reconstruction rather than forecasting. The authors test interventions β€” Koopman operator learning, Hamming noise injection during autoencoder training, and multi-step rollout fine-tuning β€” that trade off reconstruction/one-step accuracy for ~40% lower long-horizon error, matching full-resolution models while using two orders of magnitude fewer FLOPs and half the GPU memory, validated on physics benchmarks and mesoscale crystal-plasticity fatigue simulations.

    arxiv.orgpaperAdded 26 Sep 2026, published 24 Sep 2026🧠 AI

  75. Screen Before You Serve: Simulation for Production Customer Experience AI Agents at 140M Scale

    This paper describes a hypothesis-driven simulation workflow (using the Snowglobe simulator) for screening candidate LLM-based customer experience agents before production deployment, applied to Nubank's Card Delivery and Card Management chat-support agents in Brazil at 140M-user scale. Synthetic customers and simulated tool outputs let the team test multi-step agentic workflows without hitting production backends; across 4 deployed versions, simulated evaluator scores correlated strongly with production outcomes, and simulation-guided iteration lifted transactional NPS by 36.69 points and self-service rate by 8.82 points in live A/B tests.

    arxiv.orgpaperAdded 26 Sep 2026, published 24 Sep 2026🧠 AI

  76. Passthrough Rigidity: The Behavioral and Visuomotor Costs of Mediated Perception

    A large-scale (N=110) within-subject HCI study measuring the behavioral, oculomotor, and physiological costs of video passthrough head-mounted displays versus natural viewing during a block assembly task. The authors find a four-fold suppression of rotational head velocity and decoupled head-gaze coordination under passthrough, terming this "Passthrough Rigidity" β€” a shift toward motor caution and oculomotor compensation that correlates with worse task performance, increased ocular strain, and cognitive load, offering a quantitative framework for improving future XR device comfort.

    arxiv.orgpaperAdded 22 Sep 2026, published 21 Sep 2026🧠 AI

  77. Accelerating Sharded Data Parallelism at Scale with Federated Learning

    This paper introduces FL+FSDP and FL+HSDP, hybrid algorithms interleaving sharded data parallelism with FedAvg-style federated aggregation to reduce communication overhead when training foundation models across large, heterogeneous GPU clusters. Decoupling large data-parallel deployments into smaller, loosely-coupled federation groups bounds global batch size growth and cuts inter-group traffic. A Llama3.1 8B pre-training run on 512 A100 GPUs shows up to 8.04x faster data processing and 4.48x lower evaluation perplexity than standard FSDP/HSDP under identical hyperparameters.

    arxiv.orgpaperAdded 22 Sep 2026, published 17 Sep 2026🧠 AI

  78. COMPASS: Ordered Clustered Routing at 100K Scale

    COMPASS is an algorithm for the Ordered Clustered Traveling Salesman Problem (OCTSP), which requires visiting node clusters in a prescribed order β€” a common large-scale routing scenario. It combines search with learning-accelerated routing across parallel sub-solvers, exploiting cluster structure to reach near-exact solutions in time exponential in cluster size rather than instance size, and unlike typical large-scale routing solvers it works on general (including asymmetric) distance matrices rather than requiring coordinates. The authors demonstrate scaling to 100K synthetic nodes and 28.5K real e-commerce nodes, the largest reported routing solution over asymmetric distances to date.

    arxiv.orgpaperAdded 22 Sep 2026, published 17 Sep 2026🧠 AI

  79. GPU-CFR: 80x Faster Counterfactual Regret Minimization by Compiling the Game to Static Dataflow and CUDA Graph Replay

    GPU-CFR is a compiler and runtime that speeds up Counterfactual Regret Minimization (CFR), the standard algorithm for solving imperfect-information games, by compiling a fixed game into static dataflow (flat edge/info-set arrays, precomputed indices, depth-level batched passes) and replaying iterations with CUDA Graph Replay instead of issuing per-iteration kernel launches. On an A100, it runs 29.8-80.4x faster than the fastest prior GPU CFR implementation and 14-258x faster than LiteEFG (a fast CPU implementation) on the largest games in an eight-game benchmark suite, while reproducing reference iterates bitwise. The work matters because CFR was historically CPU-favored due to GPU kernel-launch and dispatch overhead dominating microsecond-scale kernels, and this compiler-based approach removes that bottleneck.

    arxiv.orgpaperAdded 22 Sep 2026, published 10 Sep 2026🧠 AI

  80. A Chip-scale Space-time Multiplexed Gaussian Boson Sampling Processor Beyond 10,000 Photons

    This arXiv preprint reports the first chip-scale, space-time multiplexed Gaussian Boson Sampling (GBS) processor, built on a thin-film lithium niobate chip integrating high-speed electro-optic modulators and on-chip delay lines, running at 4 GHz and detecting up to 11,059 photons within 1 millisecond. Beyond demonstrating quantum computational advantage, the authors reconfigure the photonic hardware as a GBS-powered world model for modelling physical dynamics, achieving lower prediction error with fewer trainable readout parameters than a classical echo state network (ESN) baseline. It's notable for the AI catalog as a concrete example of photonic quantum hardware being repurposed as a reservoir-computing-style model for physical-dynamics prediction.

    arxiv.orgpaperAdded 22 Sep 2026, published 10 Sep 2026🧠 AI

  81. Learning Length-Extrapolatable Recurrent Models

    This paper studies why recurrent models trained with backpropagation through time fail to generalize beyond their training sequence length, arguing the cause is not just vanishing/exploding gradients but the quality of 'state credit' β€” the signal linking future losses to earlier recurrent states. The authors propose Credit Stabilization through Time (CST), a backward-pass technique that rescales state-credit signal norms without altering forward computation, and show it improves extrapolation up to 128x the training length on both synthetic and real-data tasks.

    arxiv.orgpaperAdded 22 Sep 2026, published 8 Sep 2026🧠 AI

  82. Axonal delay dispersion decides whether a neuron detects an event or a sequence, and predicts cortical column diameter

    This arXiv preprint proposes a "delay-signature" framework where the dispersion of axonal conduction delays converging on a dendritic branch determines whether a neuron acts as an event detector (coincidence) or an order-selective sequence detector, using simulations of an integrator-neuron model. The authors find a single scalar (delay dispersion) governs this computational transition, sets a millisecond-scale timing tolerance, and together with conduction velocity predicts cortical column diameter β€” linking myelination to what a neuron computes, not just how fast it signals.

    arxiv.orgpaperAdded 22 Sep 2026, published 3 Sep 2026🧠 AI

  83. AI Security Briefing

    This arXiv paper introduces a cost-aware evaluation framework for LLM security agents, comparing models at fixed inference and tool-spend budgets rather than only reporting best-case success rates. It tests offensive agents on Cybench CTF challenges and defensive agents on Splunk BOTS v1 SOC investigation challenges, finding that offensive CTF performance scales well with added test-time compute (open-weight models can approach frontier proprietary ones cost-competitively) while defensive SOC investigation success depends more on disciplined tool use and telemetry navigation than raw reasoning budget.

    arxiv.orgpaperPublished and added 18 Jul 2026πŸ›‘οΈ Security

  84. AI Security Briefing

    This paper demonstrates that LM pretraining corpora can be poisoned at web scale by injecting malicious content through public discussion interfaces (e.g., comment sections), moving beyond prior work limited to editing Wikipedia. The authors introduce HalfLife, a novel analysis method for estimating whether adversarial content injected via such channels actually survives web crawling and data curation pipelines to end up in training data. The work establishes third-party webpage content/comments as a realistic attack vector for language model pretraining poisoning.

    arxiv.orgpaperPublished and added 18 Jul 2026πŸ›‘οΈ Security