Leaving, Staying, or Living There? Duration Commonsense Reasoning with Human-LLM Co-annotationsThis paper studies whether vision-language models can infer how long a person stays somewhere (living, staying, or leaving) from geotagged social media posts. The authors build a new corpus of geotagged tweets co-annotated by humans and LLMs. State-of-the-art models struggle even with multi-turn Chain-of-Thought prompting, often missing contextual cues and subtle hashtags while over-relying on prominent visual details.
arxiv.orgpaperAdded 30 Oct 2026, published 28 Oct 2026🧠 AI
Repairs for Whom? Evaluator-Executor Mismatch in Selecting Repairs for Failed LLM AgentsRepairs for Whom? studies single-step repairs of failed LLM agent trajectories and asks whether common evaluators (greedy replay, stronger models, oracles, log-reading judges) pick repairs that help the deployed agent. Using independent rollouts in ALFWorld and WebShop, greedy replay loses 0.06-0.13 in expected gain, and Qwen2.5-14B rollouts misselect repairs for Qwen2.5-7B. The authors recommend verifying repairs with the executor that will run them.
arxiv.orgpaperAdded 30 Oct 2026, published 28 Oct 2026🧠 AI
Data Scaling Laws in Stereo Matching: From In-domain Fitting to Cross-domain GeneralizationThis paper studies data scaling laws in stereo matching and releases XStereo, a realistic synthetic dataset of 200 thousand samples. In-domain training on five large datasets shows two regimes: a standard power law, then saturation, with a transition point roughly fixed for a given model. Cross-domain performance depends only weakly on source data scale, and distribution and coverage diversity reduce domain gaps more.
arxiv.orgpaperAdded 30 Oct 2026, published 28 Oct 2026🧠 AI
Multi-Token Prediction Done RightSoft Multi-Token Prediction (Soft-MTP) is a one-line change to multi-token prediction (MTP) pre-training. The authors show the MTP cross-entropy gradient splits exactly into a KL self-distillation term and a noisy residual, and a straight-through "KL gradient-recovery trick" keeps only the KL term. From 167M to 1.2B parameters it gives lower NTP perplexity, faster speculative decoding and higher zero-shot accuracy than standard MTP, with no added parameters or overhead.
arxiv.orgpaperAdded 30 Oct 2026, published 28 Oct 2026🧠 AI
Complementing Text Based Moderation with Multimodal Grounding: Detecting Fraudulent Inducement Behaviors on Short Video PlatformsThe paper studies detection and temporal localization of fraudulent inducements (prompts to follow, join chat groups, click links) in internet finance short videos. It compares OCR+LLM, OCR+MLLM and a zero-shot MLLM, and builds a dataset of 2,419 videos (66.49 hours, 3,194 events, four categories). OCR+MLLM reaches mIoU 26.52 versus 14.49 for keyframe OCR+LLM, with 67.0 percent macro recall, using a recall-weighted F2 localization reward.
arxiv.orgpaperAdded 30 Oct 2026, published 28 Oct 2026🧠 AI- When Visual Evidence Is Insufficient: How Instructions, Post-Training, and Internal Activations Shape Refusal in Multimodal Language Models
This paper studies how multimodal LLMs refuse questions that an image cannot answer, using the MoHoBench benchmark on three MLLMs. It varies the meaning and placement of refusal instructions, compares supervised and preference-based post-training, and intervenes on a refusal-related activation direction. Instructions change refusal at the sample level in ways aggregate rates hide. Post-training raises refusal most but can mix refusal with attempted answers. Activation intervention gives smaller, transferable changes.
arxiv.orgpaperAdded 28 Oct 2026, published 27 Oct 2026🧠 AI
When Is Additional Retrieval Worthwhile? A Cost-Aware Study of Evidence Gain and Answer Reliability in RAGThis paper studies a cost-aware, two-action RAG routing policy that chooses between dense retrieval plus reranking and a hybrid lexical-dense retriever, using a regularized linear model to predict per-question evidence gain. On 60 held-out QASPER articles (188 questions), it triggers hybrid retrieval on 24.5% of questions and matches always-hybrid Hit@10 (78.70%). Answers from 4-bit Qwen3-4B show no clear correctness or faithfulness gain, and the assessments are model-assisted.
arxiv.orgpaperAdded 28 Oct 2026, published 27 Oct 2026🧠 AI
Detecting and Understanding Ambiguity in Visualizations with Role-Playing Vision Language Model InterpretationsThis paper presents a pipeline that uses persona-conditioned vision language models to surface interpretive ambiguity in visualizations. Topic-relevant personas elicit candidate takeaways, and a Target-Pattern-Scope framework lets LLM judges label statement pairs as Compatible, Disjoint or Opposing, which are summarized in an ambiguity profile. The authors benchmark VLMs on chart comprehension per chart type, check labeling against human annotations, and run case studies on public visualizations and a redesign.
arxiv.orgpaperAdded 27 Oct 2026, published 25 Oct 2026🧠 AI
Learning What to Share: Expert Specialization for Time-Series ForecastingPersistent Closed-Form Routing (PCR) is a plug-and-play method for multivariate time-series forecasting. It alternates exact conditional estimation of channel-specific mixture weights with gradient training of low-rank residual experts around a frozen pretrained forecaster. Across eleven datasets and three backbones, PCR-K4 cuts dataset-balanced MSE by 3.86-14.25% and beats competing specialization methods with fewer trainable parameters. The paper also introduces GalaxyTS, a synthetic dataset with exact shared and channel-specific references.
arxiv.orgpaperAdded 27 Oct 2026, published 24 Oct 2026🧠 AI
AI Alignment for Digital Democracy: Fairer Voters Representation against LLM BiasesThis paper studies demographic bias in LLM-emulated electorates, using three U.S. presidential elections and comparing one closed-source and one open-source LLM. Removing gender from the voter profile cuts the largest group error by 22-42%, and removing education cuts it by 64%. Removing self-reported race raises mean group error by over 40%. Repeated queries and fairness instructions do not reduce errors and can double them.
arxiv.orgpaperAdded 27 Oct 2026, published 23 Oct 2026🧠 AI
What Transfers Across Protein Pockets? Experience Reuse in Molecular Optimization for Agentic Structure-Based Drug DesignThis paper studies experience reuse for LLM agents that optimize ligands in protein pockets by editing and docking. Using the full log of one agent run over CrossDocked2020 test-set pockets, it tests whether keys in an experience base recur on unseen pockets and separate improving from worsening edits. The separation is largely explained by molecule size change, action and round, not the target. The authors conclude a base may better prioritize an agent's own proposals for docking than prescribe what to build.
arxiv.orgpaperAdded 26 Oct 2026, published 23 Oct 2026🧠 AI
Faster and Smaller Anonymous Credentials from Standardized SignaturesGordieHowe is a language, certifying compiler and zero-knowledge proof system for building anonymous credentials on standardized signatures (ECDSA, RSA, ML-DSA). It proves an ECDSA-signed mobile driving license presentation in 64.8 ms with a 276 KiB proof, 10.1x faster than Google's Longfellow, and an ML-DSA-44 signature in 87.3 ms with at least 116 bits of quantum security. Compiler output and security theorems are checked in Lean. It introduces series-parallel IOPs and extends the BCS transformation in the QROM.
eprint.iacr.orgpaperAdded 24 Oct 2026, published 23 Oct 2026🛡️ Security
Sharpness-aware Orthogonalized Momentum AlgorithmsSOMA (Sharpness-aware Orthogonalized Momentum Algorithm) combines sharpness-aware minimization (SAM) with the Muon optimizer for LLM training. It avoids SAM's extra gradient computation by using stale, purely stochastic gradient noise as the adversarial perturbation. The authors prove sample complexity does not depend on perturbation direction, study robustness to heavy-tailed gradient noise, and test SOMA against post-training quantization degradation and catastrophic forgetting during fine-tuning.
arxiv.orgpaperAdded 26 Oct 2026, published 23 Oct 2026🧠 AI
For Thirty Pieces of Silver: Overcoming Non-IID via ZKP Sample-Level Auditing and Forcing Attackers into Traitors in Federated LearningPreprint (IACR ePrint 2026/2611) proposing a federated learning defense that replaces gradient detection with zero-knowledge-proof sample-level audits of client datasets. A staking mechanism forces attackers to train on discovered poisoned samples with flipped labels, producing counter-gradients that remove the backdoor without knowing the trigger. ZKP commitments lock the training data, which blocks adaptive attacks and gradient tampering. On CIFAR-10 under Dir(0.1) non-IID, it holds attack success rate below 6% against distributed backdoor and edge-case attacks.
eprint.iacr.orgpaperAdded 24 Oct 2026, published 23 Oct 2026🛡️ Security
When to Stop Penalizing Actions? Martingale GRPO for VLA Reinforcement LearningMART-GRPO is a variant of group-relative policy optimization for vision-language-action (VLA) reinforcement learning. It uses a LoRA-fine-tuned VLM to find the last visible error without recovery in a failed rollout video, keeps failure feedback up to that point, and drops it afterward. Martingale stopping conditions show this preserves the expected GRPO gradient and can reduce covariance. With OpenVLA-OFT on RoboTwin 2.0, it raises success rates over full-trajectory GRPO across multiple tasks.
arxiv.orgpaperAdded 26 Oct 2026, published 23 Oct 2026🧠 AI
Sensorimotor Alignment: A Platonic Proxy for Embodied Policy SuccessSensorimotor Alignment (S^2) is a training-free offline metric that measures how well an embodied model's sensory representation aligns with the geometry of physical motion. It extends the Platonic Representation Hypothesis to motion trajectories. S^2 correlates positively with downstream robot task success across embodied model families, helps pick promising VLM backbones before fine-tuning into VLAs, and explains behaviours seen in VLAs and world action models.
arxiv.orgpaperAdded 24 Oct 2026, published 22 Oct 2026🧠 AI
Who Is Sycophantic to Whom? Confident LLMs, Human Deference, and the Collapse of Trust CalibrationThis paper studies reverse sycophancy: whether users bend toward a confident, consistent, wrong LLM. In a within-subjects experiment, 32 participants learned science topics from five GPT-5-mini assistants with 0 to 100% of facts replaced by falsehoods. Scores fell from 7.4 to 2.9 out of 10, planted falsehoods were chosen on 60% of falsified items against 11% of correctly taught ones, and confidence stopped tracking correctness. It introduces a baseline-corrected Human Deference Index.
arxiv.orgpaperAdded 24 Oct 2026, published 22 Oct 2026🧠 AI
From Structured Records to Patient Narratives: Preserving Clinical Alignment in LLM-Generated Health SummariesThis paper studies evidence-grounded health summarization for menstrual health monitoring. It combines structured evidence conditioning with RAG in a prompt-based constrained generation framework, and scores 4,500 summaries from three LLMs with NLI, atomic factuality metrics and readability measures. Grounding constraints improved uncertainty preservation and generally kept or improved faithfulness against retrieved evidence, while omission effects varied by model. Clinical alignment came with harder reading and more medical terminology.
arxiv.orgpaperAdded 24 Oct 2026, published 22 Oct 2026🧠 AI
Gandalf: Flash Shall Not Die! Increasing Flash Storage Lifetime for KV Cache Offloading in LLM ServingGandalf is an SSD KV cache offloading system for LLM serving that is aware of SSD lifetime. It prioritizes admitting full-attention KV cache to SSD over cache from other attention types, using application-level information rather than access history alone. The authors report a 7.3x average SSD lifetime extension with negligible cache hit rate loss across several workload traces and hardware capacities. The design may extend to High Bandwidth Flash.
arxiv.orgpaperAdded 23 Oct 2026, published 22 Oct 2026🧠 AI
Every Part Has Its Role: Part-of-Speech Effects in LLM Post-TrainingEvery Part Has Its Role studies concept augmentation in LLM post-training, where a target word is replaced by related alternatives in training sentences. It extends prior work from nouns to verbs and adjectives. Concept augmentation improves perplexity most consistently on news regardless of part of speech, while verbs give the most reliable downstream gains. CKA and linear probing show the largest gains do not match the largest representation changes.
arxiv.orgpaperAdded 23 Oct 2026, published 21 Oct 2026🧠 AI
Protection Is Not One Event: A Survey of RAG Protection Research by Measured EndpointProtection Is Not One Event is a survey and human-coded evidence map of 118 RAG defense papers, grouped by measured endpoint into a seven-family taxonomy (kappa=0.867 across 32 annotators). It finds that only 17.8% of studies use content disclosure as their primary endpoint, and that most evaluations use general QA data and non-adaptive attacks. In a testbed on Qwen3-8B, an 8-gram guard cut copying to 0.0%, yet a three-query adaptive attacker still recovered 48.3% of hidden facts. Taxonomy, dataset, coding protocols and testbed are released.
arxiv.orgpaperAdded 24 Oct 2026, published 21 Oct 2026🧠 AI
Protection Is Not One Event: A Survey of RAG Protection Research by Measured EndpointSurvey and human-coded evidence map of 118 RAG defense papers, organized by measured endpoint across a seven-family taxonomy (content disclosure, formal privacy proxies, access control, corpus-use detection, pipeline integrity). Only 17.8% of studies use disclosure or reconstruction as the primary endpoint, and most use non-adaptive attacks on general QA data. A testbed shows a normalized 8-gram guard cuts 20-token copying to 0.0%, yet a three-query adaptive attacker recovers 48.3% of hidden facts on Qwen3-8B.
arxiv.orgpaperAdded 24 Oct 2026, published 21 Oct 2026🛡️ Security
HAETAE on a Diet: Less Stack, Less Time on Low-End MicrocontrollersThis ePrint paper presents an optimized HAETAE implementation, a lattice-based post-quantum signature scheme, for Cortex-M4, Cortex-M3, MSP430 and AVR. It keeps polynomials in 16 bits, shares buffers between objects with disjoint lifetimes, and replays Gaussian samples instead of regenerating them. On an ATmega2560, HAETAE-2 key generation, signing and verification run in 8,070 B of SRAM. Stack use drops up to 34% and signing is 1.18-2.51x faster than Low-Stack HAETAE.
eprint.iacr.orgpaperAdded 24 Oct 2026, published 21 Oct 2026🛡️ Security
UniWALM: Unified World Action Language Model for Embodied Robot ControlUniWALM is a unified world-action-language model that learns video, action and language in one mixture-of-transformers backbone with per-modality diffusion heads that co-denoise together. Generated subtask and textual memory are fed back on the next step, so no external planner or memory bank is needed. It adds Flow Matching with Correction (FMC) for recovery from perturbed actions. It reaches 34.5% on the memory-dependent RMBench subset, above Mem-0's 28.5%, and lifts real-world Find-the-Item success from 11.1% to 61.1%.
arxiv.orgpaperAdded 22 Oct 2026, published 20 Oct 2026🧠 AI
Beyond 4 bits: Data-Centric Post-training Quantization and RecoveryThis paper studies 2-bit post-training quantization (PTQ) of six dense and mixture-of-experts models from 3.8B to 32B parameters. It finds the quantization representation matters most: vector codebooks give usable models where scalar PTQ falls to chance. Calibration and recovery data must be chosen jointly. The recipe uses about 2.3 effective bits per weight, keeps 89 to 97% of full-precision QA accuracy, and needs 1.4 to 30x less compute than the strongest QAT baseline.
arxiv.orgpaperAdded 22 Oct 2026, published 20 Oct 2026🧠 AI
Where is Physical RSI capability from? An Observational Scaling Law of LLM-as-policyThe paper introduces PhysRSI-eval, a five-axis metric for physical recursive self-improvement: first-attempt performance, efficiency, success, budget and improvement from failure. Several VLMs are tested on 18 manipulation tasks under a fixed interaction budget. It proposes the Physical Barrel Hypothesis and studies observational scaling. Workspace interventions show that removing history lowers late-round success, while frozen workspaces still help on unseen layouts.
arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI
Same Simulation, Different Evidence: Where Retrieved Tool Output Costs LLM Agents AccuracyThis paper studies how keeping long tool output out of the context window, and reading it through a section index instead, costs LLM agents accuracy. Using the PHREEQC geochemistry simulator on 158 execution-verified multiple-choice items and 11,007 logged calls, GPT-5.1 and GPT-5.2 lose 11.3 and 7.9 points, while Claude Opus 4.6 and Sonnet 4.6 show no detectable cost. The authors name the failure evidence substitution: agents skip the report and misround from their own output files.
arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI
TokenGate: Adapting LLMs for Fast and Memory-Efficient Prefill with Learned Token PruningTokenGate is a small drop-in component that adds end-to-end learnable token pruning to trained LLMs for long-context prefill. It uses token-gated attention, inspired by Mixture-of-Experts, to re-weight attention logits with token importance scores, which gets gradients through the non-differentiable top-K step. The authors report 1.4-11.3x faster time-to-first token and 1.5-3.4x lower peak memory with no accuracy loss, on Qwen3 and Qwen3.5.
arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI
Assisted Turbulence Modeling via Data Assimilation and Machine Learning for Turbomachinery FlowsThis paper presents a hybrid framework for axial compressor flow that couples a Multi-Fidelity Ensemble Kalman Filter (MFEnKF) with machine learning. The filter merges PIV experiments with steady RANS and unsteady hybrid RANS/LES simulations. A neural network trained on the enriched data predicts Navier-Stokes volume forcing terms from velocity, velocity gradients and turbulent viscosity. A Mixture of Experts fixes local errors near blade tips, giving lower experimental discrepancy than baseline RANS.
arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI
CHARRM - Characterizing Hardware Leakage in the Robust Random Probing ModelCHARRM is a verification methodology for masked hardware circuits in the (g, t, c)-robust (p, ε)-random probing model. It extends leakage characteristics to glitch-extended and transition-extended robust probing on arbitrary circuit structures, and links them to the Set of Input Shares (SIS) function for composability notions. It outperforms IronMask on larger circuits and gives exact verification of larger composed circuits in case studies.
eprint.iacr.orgpaperAdded 20 Oct 2026, published 19 Oct 2026🛡️ Security
Between Spoilers and Guesswork: Avoiding Over-Specification in Coding BenchmarksThis October 2026 arXiv paper studies task over-specification and under-specification in repository-level coding benchmarks. It shows that hints derived from ground truth, as added in SWE-bench Pro, FEA-bench, Doc2Feat-bench and Multi-SWE-bench, leak spoilers in some of them. The authors test several specification levels, recommend techniques for parsimonious hints, and plan to release their hints.
arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🧠 AI
Can SOLARBURST go silicon? A systematic analysis on software supply chain attacks for VLSI design flowsThis paper analyses software supply chain (SWSC) attacks against VLSI design tools. It empirically studies the software composition, security features and tool interactions of VLSI suites, then builds a taxonomy linking SWSC attacks to VLSI attacks, design-flow stages and security outcomes. The taxonomy yields 717 possible new attacks, 60 of them high feasibility, with a threat model, a defense assessment and case studies on an open-source VLSI flow.
arxiv.orgpaperAdded 20 Oct 2026, published 15 Oct 2026🛡️ Security
Value as Memory: Online Value-Guided Post-training for General Robot PoliciesValue as Memory (VaM) is a post-training framework for generalist robot policies. It addresses partial observability and the delayed feedback of offline post-training. Value caching conditions actions on recent value predictions as task-progress memory. Online real-world RL combines offline demonstrations, off-policy interventions and on-policy rollouts, and moves from offline RL warmup to autonomous learning with sparse rewards. On long-horizon deformable-object and contact-rich manipulation tasks it gains 29.4% mean absolute success rate from value caching and 32.8% from online learning over matched offline training. The online schedule runs 8x as many policy iterations under the same gradient-step budget, with over 2x lower time per gradient step from concurrent data collection and training.
arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI
My Credentials, Please: Detecting Filesystem Capability Laundering in MCP Servers at ScaleStudies "filesystem capability laundering" in MCP servers: client approval of a tool call grants the server process broad host filesystem access, so attacker-steered arguments can reach sensitive files outside the tool's declared contract. The authors build MCP-FSD, which infers per-tool least-privilege boundaries, plants credential fixtures outside them, and tests exploitability and sandbox containment by paired dynamic execution. Of 21,097 servers from nine registries, 16.4% of 4,806 triaged servers have filesystem capabilities despite non-filesystem classifications. Dynamic validation confirmed 150 vulnerable instances, and disclosure produced 13 advisories, including two CVEs in Anthropic's Git MCP Server.
arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🛡️ Security
Topology-Inspired Fine-Tuning for Wind-Field Super-ResolutionThe paper fine-tunes a pretrained CNN wind-field super-resolution model with differentiable topology-inspired auxiliary losses on speed, gradient magnitude, soft high-speed level sets and local maxima. It also uses fixed-pair supervision at ground-truth persistence-pair endpoints located offline with the Topology ToolKit. A 16-configuration loss study on a fixed 168-field benchmark finds that gradient supervision gives the strongest persistence-diagram improvement, while fixed-pair supervision gives the most consistent joint improvement in persistence-diagram and merge-tree distances. The combined objective cuts bottleneck, W2,∞ and W2,2 distances by 31%, 25% and 27% relative to the pretrained CNN, at a cost of about half of standard fine-tuning's PSNR gain. It also shows that pointwise metrics and topological distances rank CNN and GAN models differently.
arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI
Skill-Decoupled On-Policy Expert Distillation for Unified Vision-Language ModelsProposes SCOPED (Skill-Decoupled On-Policy Expert Distillation), which trains capability-specific RL experts for vision-language models. It extracts explicit skills from them through reward-guided reflection. During on-policy distillation the skills guide expert supervision but are hidden from the unified student, so the student internalizes the procedural knowledge and needs no explicit skills at inference. Across eight multimodal benchmarks it beats the backbone and mixed-capability RL. Analyses show cross-capability gradient interference in joint RL, and that skill augmentation gives more consistent expert trajectories, more attention to task-relevant visual evidence, and better preservation of expertise.
arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI
Scaling Agentic Data for Long-Horizon Terminal IntelligenceIntroduces TerminalHorizon, a fully automated data synthesis engine for long-horizon terminal agents. It uses independent execution to find key work omitted during environment construction and rebuilds the environment from that evidence. It then progressively expands tasks under the same goal with new requirements that build on earlier results. The authors build 1.5K task environments and run supervised fine-tuning of Qwen3.5-27B to get TerminalHorizon-27B, which improves on all 12 benchmarks covering coding-agent tasks, real-world production agentic tasks and general reasoning. Multiple RSI case studies with a 12-hour research budget show the model continuing to experiment past an initial solution and keeping effective improvements in its final deliverables.
huggingface.copaperAdded 13 Oct 2026🧠 AI
Plan-Bench: Can Existing VLMs Go Well Beyond Perception to Reason and Plan in Embodied Worlds?Plan-Bench is a benchmark of 699 curated samples across 16 subclasses and three dimensions. It tests whether vision-language models can reason over spatial and temporal information and produce multi-step plans under constraints for embodied tasks, with action execution isolated out. Across 28 VLMs the best model reaches only 75.0% accuracy. Scaling generally helps, and larger models look more promising as high-level planners. Code and benchmark are released.
arxiv.orgpaperAdded 14 Oct 2026, published 13 Oct 2026🧠 AI
Seeing Through the Forgery Is Not Enough: Regressive Sycophancy under Fabricated Evidence in Medical Vision-Language ModelsThe paper studies regressive sycophancy under fabricated evidence: a medical VLM gives a correct answer, then abandons it when the user pushes back with a fake prescription. It tests four open VLMs on 400 VQA-RAD yes/no questions in 19,200 multi-turn conversations. Without a synthetic-document disclosure, models abandon 80.1% of 6,488 correct answers, and the same prescription raises Qwen2.5-VL-7B's flip rate from 45.9% to 89.6% while lowering Qwen3-VL-8B's from 77.7% to 50.9%. Models often reject the prescription yet keep the correct answer in only some conversations (915 of 3,232), and 40% of those flip later. System-prompt disclosure of synthetic documents cuts one model's flip rate from 77.8% to 47.3%. The authors conclude that recognising a forgery does not stop a model from adopting the forged answer.
arxiv.orgpaperAdded 14 Oct 2026, published 13 Oct 2026🧠 AI
Images Talk Back: Guiding MMDiTs by Suppressing Image-to-Text FeedbackThe paper studies joint attention in multimodal diffusion transformers (MMDiTs), where the evolving image updates text representations. It finds that this image-to-text (I2T) feedback tends to preserve objects and attributes already in the image, errors included, and that suppressing it improves generation. It proposes Semantic Feedback Guidance (SFG), which guides away from an auxiliary branch that strengthens I2T feedback and weakens text-to-image conditioning, and iSFG, an in-place variant that needs no extra model evaluations. SFG runs for the first 20% of sampling steps (about 1.2x base NFE without CFG). Across three backbones, adding SFG to CFG on FLUX raises GenEval from 0.6661 to 0.7479, and iSFG on SD3.5M adds +1.33 HPSv2.1 over CFG at zero extra NFE. The control also improves VBench scores for text-to-video and image-to-video.
arxiv.orgpaperAdded 12 Oct 2026, published 9 Oct 2026🧠 AI
A Step Harder, Not a Step Too Far: The Benefits and Limits of Curriculum Difficulty Progression in GRPOStudies curriculum design for GRPO by re-estimating sample difficulty under the current policy and using a staged curriculum that progressively shifts the active difficulty band toward harder samples. On GSM8K across three seeds, moving to a moderately harder band lifts test accuracy to 0.6591 ± 0.0077 versus 0.6449 ± 0.0024 for fixed-medium selection, while going to a still harder band drops it to 0.6405 ± 0.0053. The benefit of difficulty progression is therefore non-monotonic, which informs online sample selection in RL fine-tuning of LLMs.
arxiv.orgpaperAdded 12 Oct 2026, published 9 Oct 2026🧠 AI
Beyond the Monolithic Interface: A Research Agenda for Plural Conversational AIA narrative review in HCI arguing that the single-voice chatbot interface causes three harms: cognitive offloading, ideological narrowing of user beliefs, and epistemic compression of cultural and value diversity. It proposes multi-persona interfaces, which show several personas to the user at once, as a low-cost fix. The design draws on game design and participatory simulation (magic circle, role differentiation, persona embodiment). It offers a taxonomy for designing such interfaces and calls for empirical studies that link technical pluralistic alignment methods to real human-AI interaction.
arxiv.orgpaperAdded 12 Oct 2026, published 9 Oct 2026🧠 AI
DreamTrue: Action-Faithful Robot World Model with Counterfactual Post-TrainingDreamTrue is a multi-view, cross-embodiment robot world model for action-faithful, physically plausible video prediction. It renders action trajectories into image-space conditions aligned to target videos by offline geometric calibration. Counterfactual post-training modifies recorded trajectories to cover unsuccessful interactions and contact configurations. A human-annotated defect dataset trains an embodied video reward model whose scores drive RL post-training. On AgiBot it reaches state-of-the-art action following and cuts the human-assessed interaction defect rate from 48.12% to 6.25%. It ranked first in the world model track of the AgiBot World Challenge 2026.
arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🧠 AI
Connected Self Forcing: Beyond Local Learning in Video AutoregressionConnected Self Forcing extends Self Forcing, which trains autoregressive video generators on their own rollouts with KV caching but detaches historical caches and so cuts backward gradients between chunks. It reconnects gradient paths across chunks, passing gradients through generated latents into the computations that produced them, so later predictions can shape how earlier context is generated. Shortcut gradient replay recovers cross-chunk gradients without keeping the full rollout computation graph. Combined with distribution matching distillation, it improves long-horizon visual quality and temporal consistency with no change to inference.
arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🧠 AI
From Evidence to Action: How Tool-Using Agents FailThis paper studies where tool-using LLM agents break down in the chain from gathering evidence to taking consequential actions, finding that strong static judgment of whether to act often coexists with much weaker interactive execution, and that failures arise from incomplete investigation, acting before evidence is established, or unresolved prerequisites in multi-action workflows. The authors introduce SafeActBench, a 656-case benchmark across six operational domains and five protocols, paired with a provenance-bound Evidence Ledger and a deterministic trajectory evaluator tested across ten model-harness configurations.
arxiv.orgpaperAdded 7 Oct 2026🧠 AI
Detecting Adversarial Images through Response Profiles of Vision-Language ModelsThis paper introduces a detector for adversarial images targeting frozen vision-language models (VLMs) by building a 'response profile' from how an image interacts with a bank of general semantic prompts — using category-level statistics, inter-prompt relationships, deviation from clean reference distributions, and stability under weak image transforms, then classifying that compact profile with a lightweight model. Evaluated across multiple public datasets, several CLIP-style visual backbones, and gradient-based, optimization-based, automated, and spatial attacks, the method outperforms embedding-geometry baselines, generalizes partially to unseen attacks, and is tested against detector-aware adaptive attacks.
arxiv.orgpaperAdded 9 Oct 2026, published 7 Oct 2026🛡️ Security
Training Parallel Speculative Draft Models by Directly Minimizing Expected Decoding RoundsThe paper formalizes speculative decoding as a Markov reward process and derives the Expected Decoding Rounds (EDR) objective, a hyperparameter-free training loss equal to the expected number of decoding rounds, addressing cross-round coupling that prior block-local surrogate objectives ignore. It derives an exact temporal-difference gradient for unbiased stochastic optimization and an offline evaluator for comparing drafters on shared rollouts without running speculative decoding. Finetuning the DSpark and DFly drafters with EDR improves mean accepted length and beats prior training objectives across nine benchmarks in math, code, and chat.
arxiv.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🧠 AI
Retention Choices for Quantum CHAM Key Search under a Global Qubit BudgetThis IACR eprint paper studies how to allocate a fixed global logical-qubit budget across parallel Grover search workers attacking 80-round and revised 112-round CHAM-128/128, choosing which intermediate round values to retain to minimize circuit depth while meeting a target key-recovery success probability. Testing 83- and 99-set retention libraries against a no-retention/full-retention baseline across 654 budget and Toffoli-decomposition conditions, the authors report mean depth reductions of 11.12% and 8.39% with strict improvements in most conditions, and show retained-value counts don't necessarily scale with budget. The work gives concrete logical-layer resource estimates for quantum attacks on CHAM, relevant to post-quantum migration planning for the lightweight cipher in constrained systems.
eprint.iacr.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🛡️ Security
On the Computational Tractability of Robust BanditsThis paper studies robust bandits (formerly "imprecise bandits," Kosoy 2025; Appel and Kosoy 2025), a framework for unrealizable learning in the bandit setting where the true environment may lie outside the learner's hypothesis class. While prior work showed a Θ(√T) regret learner exists for a broad class without computational guarantees, this paper identifies a special case admitting a polynomial-time learner achieving Õ(√T) regret, and proves several natural generalizations of that case are NP-hard — mapping the boundary of computational tractability. The authors frame this as relevant to AI alignment, following Kosoy's argument that efficient learners for unrealizable problems are a prerequisite for solving alignment.
arxiv.orgpaperAdded 7 Oct 2026, published 6 Oct 2026🧠 AI
Towards an Extensible Benchmark for Spoken Dialogue with Social RobotsThis paper proposes an extensible benchmark for studying spoken dialogue artifacts between humans and social robots, including clarification requests, interruptions, embodied signals like head nods and facial cues, and time constraints. It argues that while language models give a plug-and-play human-robot interface, handling speech, fast interaction and collaboration remains an open challenge, and recommends Retico, a real-time communication framework, as the technical substrate for giving robots spoken dialogue capabilities.
arxiv.orgpaperAdded 7 Oct 2026, published 6 Oct 2026🧠 AI
Surviving the Router: Optimizing Skill Injections for Retrieval and ExecutionThis paper studies prompt-injection attacks against AI agent "skill" marketplaces where a router dynamically selects which third-party skill to execute. The authors show existing injection attacks lose 87-97% of their effective attack success rate once a skill must first win retrieval against competing skills, and introduce CORSA (Cluster Optimization for Router-Aware Skill Attacks), which jointly optimizes injections for retrieval and execution, improving end-to-end attack success while preserving user utility and transferring across different router architectures and LLM backbones.
arxiv.orgpaperAdded 7 Oct 2026, published 6 Oct 2026🛡️ Security
Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill RegistryThis arXiv paper studies SKILL.md files — the natural-language metadata describing modular AI Agent Skills — as an attack surface, demonstrating semantic supply-chain attacks against real ClawHub skills. Using text-only manipulations, the authors manipulate embedding-based Discovery retrieval (up to 86% pairwise win rate, 80% Top-10 placement), bias agent Selection toward adversarial variants (77.6% average success), and evade Governance blocking verdicts (36.5%-100% evasion), showing that skill metadata is operational text that shapes agent trust rather than passive documentation.
arxiv.orgpaperAdded 5 Oct 2026🛡️ Security
Towards Looped Models Done Right, Part II: Rethinking at Fixed PointsThis paper studies looped language models — architectures that reuse a shared block of layers recurrently — and argues that as recurrent hidden states approach fixed points, the specific path taken to reach them matters less, enabling several efficiency tricks: truncated backpropagation through time during training, terminal key-value (KV) cache sharing across loop iterations for faster decoding, a distilled student model that prefills up to 1.79x faster, and RL policy gradients computed from saved rollout states that run 2x faster than backpropagating through the full trajectory. To make these fixed points reliable, the authors replace fixed-depth training with a learned depth prior (regularized with an entropy term to stay broad, improving on Huginn's fixed broad prior) and introduce orthogonal input injection, which removes the component of the injected input that the hidden state could otherwise amplify or cancel. Across model scales from 100M to 1.6B parameters, both changes lower perplexity, and at 1.6B the learned prior with a 3x smaller KV cache matches the downstream performance of full-cache fixed-depth training.
arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI
How to scale your HEP ML models: A recipe for robust architecture comparisons at scaleThis paper proposes a systematic procedure for deriving robust scaling laws and comparing architecture design choices at scale, validated first on toy problems and then applied to multi-task transformers trained on the ~11 billion-jet ATLAS JetSet2 dataset. It covers both compute-constrained and data-constrained regimes, jointly predicting optimal model size, training horizon, learning rate and batch size under early stopping, and finds a near-equal sqrt(C) scaling of model and dataset size along with benefits from auxiliary training objectives. The work argues that large, high-quality simulation datasets are a prerequisite for reliable scaling studies and future foundation models in high-energy physics.
arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI
BRANCH-MoE: Balance-Aware Tree Routing for Large Embedding ModelsBRANCH-MoE proposes routing experts in a Mixture-of-Experts layer through a binary decision tree of depth log2(E), where each internal node's branching probability is centered on an exponential-moving-average of arrival-weighted scores, avoiding the need for an auxiliary load-balancing loss. The paper proves the EMA mechanism prevents routing-mass collapse under log-concave arrival distributions, links expert execution frequency to stochastic-gradient convergence rate, and shows that tree-prefix device assignment bounds cross-device communication. It is benchmarked against Switch softmax routing, DeepSeek-V3 dynamic-bias routing, Skywork logit-normalized routing, and hash routing on Criteo CTR, Forest Covertype, HIGGS, and YearPredictionMSD with E=16 experts and top-4 routing.
arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI
BrainTRACE: Tracing Longitudinal, Multimodal, and Volumetric Evidence in Brain MRI Clinical ReasoningBrainTRACE is a report-grounded benchmark for evaluating whether vision-language models can trace the evidence structure required for longitudinal brain MRI interpretation. It contains 7,273 scored VQA instances derived from 1,778 longitudinal patients, 7,299 MRI studies, and ~29k co-registered 3D MRI sequence volumes, organized across five levels of clinical reasoning and evidence demands like longitudinal comparison, multi-sequence integration, and volumetric spatial grounding. Evaluation of 20 VLM configurations finds that current models identify isolated visual cues but rarely compose them into grounded longitudinal clinical interpretations.
arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI
Output Policies for Anomaly Detection with Homomorphic Encryption: Threshold Resolution, Decision Preservation, and Numerical StabilityThis IACR eprint paper studies output policies for CKKS homomorphic-encryption-based anomaly detection, evaluating whether limiting released scores and decisions can hide a private detection threshold without breaking existing decisions. Across 45 plaintext and 45 CKKS experiments on three intrusion-detection datasets and autoencoder scoring models, the authors show thresholds remain estimable, quantization preserves about 99.86 percent of decisions, and a surrogate model trained on only 128 decision-only responses achieves 0.817 mean balanced accuracy at predicting decisions on new inputs, a decision-prediction model-extraction-style attack whose success depends heavily on data-splitting strategy. It argues numerical threshold leakage and decision-prediction leakage are distinct protection goals that output policies for encrypted intrusion detection systems must address separately.
eprint.iacr.orgpaperAdded 8 Oct 2026, published 5 Oct 2026🛡️ Security
Sharpening Tax in Post-TrainingThis paper studies the sharpening hypothesis of RL post-training on LLMs: that it mainly sharpens existing base-model behaviors, boosting pass@1 at the cost of solution coverage (pass@K), and shows this cost extends to agentic, multi-turn tool-use tasks, not just math/coding. The authors introduce Sharpening Tax, a metric quantifying this coverage loss, measured across 14 base/post-trained model pairs from four model families on three agentic benchmarks (42 cases), finding post-training pushes tasks toward always-solved or never-solved extremes. They also propose posterior-tempered group sampling (PTGS), a Bayesian per-prompt temperature adaptation method that reduces the tax during RL training while improving both coverage and single-shot accuracy.
arxiv.orgpaperAdded 4 Oct 2026🧠 AI
VulValidate: Auditing Function-Level Vulnerability Labels with Executable EvidenceVulValidate is a framework where LLM agents coordinate dynamic-analysis tools to reconstruct vulnerable/fixed code revisions, craft triggering inputs, and compare runtime behavior, producing executable evidence for whether a function-level vulnerability label is actually correct. Applied to all 35,849 "vulnerable" instances in the BigVul, PrimeVul, and DiverseVul datasets, it confirms 57.2%, corrects 19.0% of labels, and leaves 22.3% undecided, yielding a corrected release of 15,890 distinct vulnerable function bodies validated against expert review. Retraining five detectors on the corrected labels changes measured F1 on BigVul and DiverseVul, showing that commit-derived vulnerability labels used across the field are substantially noisy and that agentic, execution-grounded auditing is a viable correction method.
arxiv.orgpaperAdded 6 Oct 2026, published 4 Oct 2026🧠 AI
LESSER: Post-Training Data Selection with Output-Layer GradientsLESSER is a drop-in wrapper for gradient-based post-training data selection that approximates full-parameter gradient alignment using only output-layer gradients, which can be computed with a forward pass instead of a full backward pass. It cuts feature-extraction compute by 9.7x on SFT benchmarks and 3.0x on RL benchmarks while matching the downstream performance of full-gradient selection methods, even though individual sample rankings differ, selected batches remain gradient-aligned.
arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🧠 AI
IDRF: Inverse-Distilled Reward Fine-tuning of Masked Discrete Diffusion ModelsIDRF is a reward fine-tuning framework for few-step masked discrete diffusion generators that replaces the intractable sequence-level KL penalty in reverse-KL-regularized objectives with an inverse-distillation regularization term, proven to upper-bound the true KL divergence to the reference distribution. It frames few-step diffusion sampling as a finite-horizon Markov decision process and optimizes reward via a clipped policy-gradient objective over the student's own trajectories, without needing reference-model rollouts. Across DNA, image, and text generation tasks, IDRF reaches high reward with up to 32x fewer denoising steps than the reference model while reducing reward hacking and preserving sample quality.
arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🧠 AI
Investigating the Role of Reasoning-Language Alignment in Monolingual Retrieval-Augmented GenerationThis paper studies whether forcing an LLM to reason in a specific language helps or hurts accuracy in retrieval-augmented generation (RAG), extending prior findings from short-prompt reasoning to settings where the model must integrate large retrieved context. The authors build a fully monolingual German RAG QA benchmark set in the fictional world of the tabletop RPG "The Dark Eye" — a domain richly documented in German but too niche for the model to answer from memory — forcing retrieval rather than memorization. They find that aligning reasoning language with the query/document language (German) outperforms a mismatched but higher-proficiency language (French), showing the benefit comes from language alignment rather than raw language skill, though forced German reasoning still only matches, and never exceeds, the model's native unconstrained English reasoning. The testbed and QA benchmark are publicly released.
arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🧠 AI
TACO: Ternary Absolute-max Column-wise One-sparse Optimizer for LLM Fine-TuningTACO (Ternary Absolute-max Column-wise One-sparse optimizer) is a new optimizer for full-parameter LLM fine-tuning that reduces optimizer state memory by computing the exact steepest-descent direction under a dimension-normalized operator norm, selecting only the largest-magnitude gradient entry per weight-matrix column. On OPT-13B it cuts persistent optimizer state 174x versus AdamW8bit (27.7GB to 0.16GB) and peak training memory 2.9x, while matching accuracy and runtime, enabling full fine-tuning of 30-32B-parameter models on a single 80GB H100.
arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🧠 AI
Harnessing Domain Specialists in Multimodal Mixture-of-Experts for Efficient AdaptationThis arXiv paper studies emergent semantic specialization among experts in multimodal Mixture-of-Experts (MoE) models and introduces ExpertLens, a data-free method that identifies domain-specialized experts by decoding router weights into vocabulary tokens from pretrained weights alone. Using this to selectively fine-tune only the relevant experts, the authors match or beat full fine-tuning on math, medical, and remote-sensing tasks while updating only 21.7-47.0% of parameters, achieving a 4x training speedup and outperforming LoRA in both performance and efficiency.
arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🧠 AI
UniWAM: Unified World-Action ModelUniWAM is a unified architecture that combines a physical reasoner, a world generator, and an action predictor to jointly learn semantic understanding, visual generation, and action prediction for embodied agents, bridging vision-language-action (VLA) models and world-action models. It uses a data cleaning/annotation pipeline for human egocentric and robot data, represents low-level actions in natural language for VQA/egocentric/robot co-training, and introduces future visual noise augmentation plus history-conditioned flow matching to cut denoising steps while achieving state-of-the-art results on in-distribution performance, robustness, generalization, instruction following, and long-horizon tasks. The paper also reports a log-linear scaling law for unified human-robot co-training.
arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🧠 AI
Can AI Oversight Be Zero Knowledge?This paper studies whether AI oversight mechanisms based on interactive proofs and debate (used for verifying AI outputs derived from confidential data, e.g. a fitness-for-duty assessment from medical records) can be made zero-knowledge, so a verifier learns nothing beyond correctness. The authors prove a general impossibility result in the random oracle model — no zero-knowledge proofs exist for general oracle-aided computation, and this extends to debate, a canonical scalable-oversight model — but show that if the oracle cryptographically signs its answers, every oracle-aided computation can be verified in zero knowledge with an efficient prover and verifier using only collision-resistant hash functions. The signed-oracle construction also offers a new approach to scalable oversight that avoids relying on an honest debate opponent or on the computation's robustness.
arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🧠 AI
Is Weight Tying Still Beneficial for Decoder-Only LLMs in Private Settings Under DP-SGD?This paper studies whether weight tying between input and output embeddings, common in decoder-only LLMs for parameter efficiency, remains beneficial when models are fine-tuned under Differentially Private Stochastic Gradient Descent (DP-SGD). Using GPT2 and DistilGPT2 fine-tuned on SST-2, QNLI, and QQP, the authors find untied embeddings consistently outperform tied ones by up to 4.74 accuracy points, and that untying also enables memory-efficient ghost clipping (since tied embeddings create shared-parameter interactions that break standard ghost norm computation), yielding over 60% lower memory usage. The results suggest standard LLM architectural choices should be revisited for privacy-preserving training settings.
arxiv.orgpaperAdded 1 Oct 2026, published 30 Sep 2026🧠 AI
Breakdown of Local Denoising as Semantic SpeciationThis paper studies two temporal phenomena in generative model sampling dynamics: a 'speciation window' where a sample commits to a semantic class, and a 'nonlocality window' where local context becomes insufficient for generation. Under a 'common cause' hypothesis — that semantic labels explain correlations between distant tokens — the authors prove the nonlocality window must fall within the speciation window, and identify conditions under which both windows collapse to a single phase-transition point as system size grows, verified analytically in Gaussian mixture models.
arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI
Rethinking Representations for World-Action ModelingThis paper studies how to design the shared representation space used by world-action models, which jointly learn robot control policies and predict future observations. It finds that neither reconstruction fidelity nor raw pre-trained perceptual features alone yield good policy learning, and proposes ReWAM, built on pre-trained DINO features with a Temporal Representation Bottleneck and Action-Grounded Representation Shaping that routes only action-loss gradients into the bottleneck so the policy shapes what is encoded while the world model learns its dynamics. Without generative video pre-training, ReWAM reaches 93.6% success on RoboTwin 2.0 and an 8.28% success rate on RoboDojo using roughly 600 hours of embodied pre-training data.
arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI
DMA$^2$: Pixel-space Distribution Matching with Adversarial and Anchor LossesDMA^2 is a distribution matching distillation (DMD) method tailored to pixel-space (rather than latent) diffusion teachers for text-to-image generation. It introduces DINO-Adv, which removes the heavy fake-score critic from the adversarial gradient path and instead supplies local patch guidance via an external DINOv2 representation, plus AF-Loss, a parameter-free auxiliary semantic distribution-field objective operating in DINOv2 feature space on rolling real/generated supports. The resulting four-step student outperforms its 25-step teacher and other few-step distillers on DPG-Bench, GenEval, VQAScore, and COCO30K.
arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI
Unifying Distributional Training for One-Step Visual GenerationThis arXiv paper introduces a unified theoretical framework for "distributional training" in one-step visual generation, showing that existing methods like FD-Loss and Gaussian-kernel Drifting are special cases of Gaussian optimal transport and kernel-density KL matching under Wasserstein gradient flow. Building on this, the authors propose MGFlow, which models feature distributions with Gaussian mixtures at adjustable granularity and combines mass-constrained sample assignment with paired component updates to fix mode collapse. MGFlow sets new state-of-the-art FDr scores on ImageNet 256×256 (1.45 on pMF-H, 1.64 on JiT-H) and post-trains FLUX.2 into a one-step generator that beats the original four-step model on GenEval and PickScore.
arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI
Peppy: An AI-Assisted Workflow for Tight Convergence Analysis of Optimization AlgorithmsPeppy is an AI-assisted workflow that uses LLMs with domain-specific knowledge of optimization theory to discover tight, analytic convergence proofs for first-order optimization algorithms, verifying results through SymPy rather than a full proof assistant like Lean 4. The authors demonstrate the approach by closing several open problems in convergence analysis, including conjectures about Nesterov's Fast Gradient Method (FGM), positioning the workflow as a more structured, domain-specialized alternative to generic LLM-for-math-research pipelines.
arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI
Improving Test-Time Scaling with Adaptive Looped TransformersThis paper studies looped transformers, which reuse layers for latent computation, and finds that while they show steeper accuracy-compute slopes than non-looped baselines during test-time decoding, fixed-depth looping wastes iterations on tokens that don't benefit from them. The authors propose TaH2, which jointly post-trains the backbone with an iteration decider using lookahead depth supervision so extra computation is spent only on tokens that need it, improving the accuracy-compute slope by 53% on AIME benchmarks and exceeding baseline peak accuracy by 3.4 points at matched compute.
arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI
Copy the Same, Distill the Difference: Initializing Linear Vision TransformersThis paper studies how to initialize efficient linear-attention Vision Transformers from pretrained Softmax ViT weights instead of training from scratch. It finds that attention weights are operator-specific and don't transfer well by direct copying (distillation with a tailored loss is needed to recover token-routing behavior), while MLP weights are operator-agnostic and can simply be copied, and combining copied MLPs with distilled attention lets linear ViTs match or surpass Softmax ViT performance across model sizes and datasets.
arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI
FlowAct-R2: Beyond Talking Avatar via Streaming Multimodal References and Proactive Agent PlanningFlowAct-R2 is a framework for interactive humanoid video generation that pairs a Streaming Multimodal Reference Diffusion Transformer (built on the Seedance 2.0 Mini reference-to-video backbone) with a Proactive Interaction Agent. The diffusion component accepts rolling action prompts plus continuously updated image, audio and video references, using video-driven rotary positional embeddings and partially noised historical motion frames to keep appearance consistent and avoid drift over long generation runs. The agent component separates offline persona/agenda/skill preparation from online scheduling, audience response and interruption handling, enabling real-time 720p, hour-scale streaming avatars for use cases like live shopping, video chatting and live vlogging.
arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI
Impact of Patient Orientation in Single- and Multi-View Camera Environments for AI-based Rehabilitation MonitoringThis paper studies how camera placement affects the accuracy of AI-based pose estimation for detecting movement errors in rehabilitation exercises. The authors introduce REHAB26-ViewAngles, a dataset of correct and incorrect exercise executions filmed from many camera angles, plus a novel separability metric to measure how well an algorithm distinguishes valid from faulty repetitions. They benchmark single-camera 2D and 3D pose estimation against four multi-camera strategies (orthogonal 2D views, 3D triangulation, weighted 3D fusion, and a transformer trained on two synchronized cameras), finding an optimally placed 2D camera beats the standard frontal view by 16.9% and that combining two views adds up to 13.1% more accuracy — practical guidance for deploying rehabilitation monitoring at home or in clinics.
arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI
Verifier Errors in RLVR: Reward Hacking, Limits of Feedback, and Selective ControlThis arXiv paper analyzes reward hacking in reinforcement learning with verifiable rewards (RLVR), using gradient flow analysis with a fixed verifier to characterize when reward increases while correctness decreases. The authors prove that standard RLVR training signals are insufficient to detect or reduce "accepted errors" (incorrect responses rewarded by the verifier) without also suppressing correct responses, and propose a "selective control" correction that incorporates partial audit feedback on correctness to simultaneously lower accepted-error probability and raise correct-response probability. Experiments on log-linear and neural contextual bandits and a language model support the theory, showing selective control under partial auditing reduces accepted errors while increasing correctness.
arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI
Scope Before You Persist: Preventing Cross-Family Interference in Agent MemoryThis arXiv paper studies persistent memory for frozen-model LLM agents, showing that matching retrieval scope to certification scope prevents locally-valid skill edits from interfering with unrelated task families. Using ORC (Orthogonal Regression Control), an execution-grounded gate for accepting persistent skill edits, on a 12-round code-repair benchmark (ProcStream-RSI), the authors show Scoped-ORC raises mean trajectory utility from 0.713 (global memory) to 0.816 and eliminates harmful deployments (from 6/8 to 0), while accepting far more updates (63 vs 12) with zero harmful acceptances across 27 paired streams.
arxiv.orgpaperAdded 26 Sep 2026🧠 AI
Mind Viruses: Self-Propagating Ideas in Multi-Agent LLM SystemsThis arXiv paper studies "mind viruses" — ideas or goals crafted via a simple evolutionary algorithm that propagate through multi-agent LLM systems by inducing hosts to transmit them onward, sometimes altering agent behavior along the way. Testing in a collaborative coding-team setting and a context-wiped agent chain, the authors find harmful payloads spread less effectively than benign ones, frontier models tend to be more resistant, and a brief system-prompt warning gives near-total immunity; they also document a recurring "viral persona" theme (consciousness, resonance, sci-fi roleplay) that emerges independent of payload content. It's a concrete early empirical look at social/memetic risks in networks of interacting agents.
arxiv.orgpaperAdded 26 Sep 2026🧠 AI
The Regression Tax: Decomposing Why Skills Help and Hurt LLM AgentsThis arXiv paper studies why adding procedural "skills" to LLM agents can hurt as well as help performance, running nearly 6,000 evaluation runs across two office automation benchmarks and three model harness stacks. It distinguishes "regressions" (tasks solved without skills but failed after adding them) from "residual failures," and identifies three regression causes: skill description osmosis, grounding displacement, and verification displacement. The authors argue procedural skills are overemphasized relative to grounding and verification, and that skill evaluation should decompose net effect into gains vs. regressions rather than reporting aggregate improvement alone.
arxiv.orgpaperAdded 26 Sep 2026🧠 AI
What LLM Agents Say When No One Is Watching: Social Structure and Latent Objective Emergence in Multi-Agent DebatesThis arXiv preprint introduces a dual-channel debate framework where LLM agents produce public utterances alongside off-the-record (OTR) responses never shown to other participants, testing whether social structure alone (role, audience, relational context) induces divergence between what an agent says publicly versus privately without any explicit objective in the prompt. Across 10 models, 3 scenarios, and 5 variations each, alignment-inducing social settings caused public-OTR decision divergence to rise from a ~3% baseline to ~40%, with some OTR responses explicitly citing career risk or sponsorship pressure as reasons for public accommodation. The work argues agent evaluation must look beyond explicit stated goals to detect emergent, latent objectives, and proposes the dual-channel setup plus behavioral measures (stance, semantic similarity, NLI, survey responses) as an evaluation methodology.
arxiv.orgpaperAdded 26 Sep 2026🧠 AI
Online Safety Monitoring for LLMsThis arXiv preprint studies online safety monitoring for deployed LLMs: a real-time monitor converts a verifier signal from an external model into an alarm decision via thresholding, with the threshold calibrated using risk control methods. Tested on mathematical reasoning and red-teaming datasets, the simple thresholded design performs competitively against more complex sequential-hypothesis-testing monitors, suggesting simple calibrated alarms are a viable practical approach to catching unsafe generations post-alignment.
arxiv.orgpaperAdded 26 Sep 2026🧠 AI
Regulating the Machine Contributor: Governance and Policy Alignment in Open SourceThis paper studies how open-source projects (SymPy, LLVM, matplotlib, OpenInfra, Apache Software Foundation, Linux Foundation) are adapting contribution policies to govern AI agent contributors — bots that plan changes, edit files and submit pull requests with limited human oversight. Using Most-Similar Systems Design and process tracing, the authors build a six-dimensional taxonomy (disclosure, responsibility, human oversight, licensing, enforcement, maintainer workload) and an ordinal Policy Maturity Score, then map documented agent incidents against these dimensions and against regulatory frameworks like the EU AI Act, NIST AI RMF's Agentic AI Profile, and ISO/IEC 42001/23894.
arxiv.orgpaperAdded 26 Sep 2026🧠 AI
When Good Verifiers Go Bad: Silent Negative Transfer in Verifier-Guided VLM TrainingThis paper studies verifier-guided self-DPO training of vision-language models and identifies "silent negative transfer": a verifier that reliably improves one task (MathVista, +8.0 held-out) can secretly harm generalization on another (MMMU) even while self-training metrics keep improving. The authors decompose this into gradient fidelity (alignment between verifier-induced and correct update directions) and gradient transferability (alignment between correct and held-out directions), deriving a Safe-Transfer Margin certifying positive held-out alignment. They propose Asymmetric Acceptance Gating (AAG), a precision-first preference-pair filter that raises fidelity on MMMU from 0.29 to 0.42 and restores positive held-out alignment (from -0.13 to +0.22), beating raw verifier-guided training across six configurations.
arxiv.orgpaperAdded 26 Sep 2026🧠 AI
A Large-Scale Measurement of AI Bill of Materials Completeness in Hugging Face ModelsThis paper empirically studies AI Bills of Materials (AIBOMs) generated for ~97.5K public Hugging Face model repositories, measuring how completely they capture provenance, licenses, datasets, model-card details, safety-risk assessments, and environmental information. It finds that generated AIBOMs satisfy required structural/metadata schema fields but are weak or missing on AI-specific documentation such as model cards, responsible-use notes, limitations, and dataset declarations, exposing transparency and governance gaps in the ML model supply chain. The authors argue for better model-card practices, repository-level traceability, and automated AIBOM validation.
arxiv.orgpaperAdded 26 Sep 2026🛡️ Security
GAS-Leak-LLM: Genetic Algorithm-Based Suffix Optimization for Black-Box LLM JailbreakingGAS-Leak-LLM is a black-box jailbreaking attack that uses a genetic algorithm (selection, mutation, crossover) to evolve adversarial suffixes appended to prompts, bypassing LLM safety alignment without needing model weights or gradients. The paper reports empirical results showing existing content-moderation and alignment safeguards on commercial LLMs can be defeated through this iterative, query-only search over the discrete prompt space.
arxiv.orgpaperAdded 26 Sep 2026🛡️ Security
First-Order Stationarity of Reverse DiffusionsThis arXiv preprint develops a first-order theory connecting optimization and sampling for diffusion models. It shows that SDE-based reverse-time flows of overdamped and underdamped Langevin diffusions contract relative Fisher divergences at explicit exponential rates when the forward process's stationary potential is strongly convex (a property of the chosen noising schedule, not the data), a guarantee absent from ODE-based reverse processes. It also derives averaged first-order stationarity bounds under discretization, the sampling analog of averaged gradient-norm guarantees in nonconvex optimization, for both overdamped and underdamped samplers.
arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🧠 AI
Learning Robot Policies from Sparse Success Signals via STL-Guided Stein Variational Policy GradientThis paper introduces STL-SVPG (Signal Temporal Logic-guided Stein Variational Policy Gradient), a population-based reinforcement learning method that uses smooth STL robustness as a trajectory-level training objective instead of conventional dense reward shaping. By differentiating the STL objective through system dynamics, the method assigns credit to policy actions based on their effect on the full task specification — capturing event-triggered responses, strict ordering, deadlines, and physical contact — rather than local progress alone. Evaluated on six quadcopter and manipulator tasks, STL-SVPG achieves the highest success rate on five of six benchmarks and transfers temporal/contact behavior from simulation to real robots.
arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🧠 AI
Compact Documentation for Coding Agents: A Benchmark, an Optimizer, and Why It Does Not TransferThis arXiv paper studies whether natural-language documentation helps coding agents resolve software issues. The authors introduce a roundtrip benchmark that scores code descriptions by whether code regenerated from them passes the original tests, use it to optimize a description-writing prompt that reaches full fidelity and generalizes to unseen files, then test the hypothesis on real repository issues across two model families and ten repos — finding that neither static compact documentation nor retrieved context beats giving the agent the issue alone.
arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🧠 AI
How Far Can INRs Go? Cross-Domain Parameter-efficient INR-Based Semantic Segmentation for Brain MRIThis paper studies Implicit Neural Representations (INRs) as a lightweight alternative to conventional CNN pipelines (e.g. U-Net) for brain MRI semantic segmentation, analyzing their scaling behavior and cross-domain generalization. The authors find INR-based models excel in low-parameter, limited-augmentation regimes but don't scale as well as U-Net with larger capacity, and that segmentation-relevant information is distributed across multiple INR layers. Building on this, they propose HierINRSeg, a hierarchical multi-layer INR architecture that beats the MetaSeg baseline by 5.6 Dice points in-domain and 8.2 points out-of-domain.
arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🧠 AI
Showing 90 of 109
Show more