99 results for “NEAR”

This paper derives bounds on predicting an LLM's decode length from prefill-phase hidden states, a primitive for inference scheduling. It models decoding as a stopped stochastic process, giving per-prompt normality and an affine variance law σ=αμ+b. Predictors (MLP, EGTP, FiLM, soft-label, Mixture-of-Experts) converge near the bound, so system error dominates model error. It proposes fixing model, data and sampling in benchmarks and reporting relative-error metrics.

arxiv.orgpaperAdded 31 Oct 2026, published 29 Oct 2026🧠 AI

Rewindable interactive proofs (RIPs) are a new model of relativizing interactive proofs for scalable oversight, in which a weak verifier can rewind an AI prover to an earlier saved state. The paper builds an RIP for computations robust to changes in a small fraction of oracle answers. The honest prover runs in linear time, the verifier runs in nearly linear time in the input length after one-time preprocessing, and no cryptography is used. A preliminary MNIST experiment shows an RIP can be faster than a deployed proof system.

arxiv.orgpaperAdded 31 Oct 2026, published 29 Oct 2026🧠 AI

Understanding and Mitigating Role Spoofing in LLMs is an arXiv paper (October 2026) on role spoofing, a prompt injection where malicious tool output impersonates the user. It shows models track "who said what" using both content cues (semantics, style) and structure cues (control tokens, formatting). Attacks combining fake structure and content succeed often, adversarial training stops only content-based attacks, and linear probes trained to predict conversation roles detect spoofing across settings.

arxiv.orgpaperAdded 31 Oct 2026, published 29 Oct 2026🛡️ Security

This preprint proposes a unified post-training quantization framework for large language models. It derives a Hessian-guided approximation of the output change caused by joint weight and activation quantization, using a tractable Fisher approximation. Quantization ranges, linear transformations and weight rounding are optimized together under one output-sensitivity objective. The authors report gains over state-of-the-art transformation and rounding methods in channel-wise and block-wise settings.

arxiv.orgpaperAdded 31 Oct 2026, published 29 Oct 2026🧠 AI

Kolesnikov and Novoselov give block basis reduction (BKZ) algorithms for linear codes that need polynomial or quasi-polynomial numbers of calls to a minimum weight codeword oracle at fixed block size. The earlier Ghentiyala and Stephens-Davidowitz bounds are exponential. The paper adds a truncated BKZ and a DeepBKZ variant, with an implementation for block sizes 2 to 24 and approximation-factor estimates on random codes.

eprint.iacr.orgpaperAdded 31 Oct 2026, published 29 Oct 2026🛡️ Security

This paper studies a cost-aware, two-action RAG routing policy that chooses between dense retrieval plus reranking and a hybrid lexical-dense retriever, using a regularized linear model to predict per-question evidence gain. On 60 held-out QASPER articles (188 questions), it triggers hybrid retrieval on 24.5% of questions and matches always-hybrid Hit@10 (78.70%). Answers from 4-bit Qwen3-4B show no clear correctness or faithfulness gain, and the assessments are model-assisted.

arxiv.orgpaperAdded 28 Oct 2026, published 27 Oct 2026🧠 AI

p-DCIM is a 28 nm SRAM digital compute-in-memory macro (0.16 mm2, 0.41 mW) that works as an Ising machine for RAG evidence selection. Selection is cast as a QUBO problem, and the same MAC datapath computes embedding similarities and annealing steps. Replacing LLM reranking with it gives a selection-energy estimate over six orders of magnitude lower and cuts total energy per query by 67%, with comparable token-level F1 on the evaluated examples.

arxiv.orgpaperAdded 28 Oct 2026, published 27 Oct 2026🧠 AI

AK_QMUL's system for the ArGuard-2026 shared tasks fine-tunes JAIS-6.7B with 4-bit QLoRA and a linear head on the last-token representation. For binary safe/unsafe detection (B1) it uses a four-way head over dialect register and AraSafe MSA augmentation, reaching macro-F1 0.984. For seven-way harm domain (B2) it averages five seeds, reaching 0.790. Both ranked first. Bully is the weakest class.

arxiv.orgpaperAdded 28 Oct 2026, published 26 Oct 2026🧠 AI

SynTrace is a single-round compiler that adds accountability to linear private information retrieval (PIR). The client mixes the retrieval query with m audit queries, so audit syndromes identify up to d deviating servers among t colluding ones before reconstruction. The paper proves perfect query privacy and zero false identification within the threshold. For Shamir-based PIR it needs k=t+d+1 servers. For a 32 KiB record from a 1 GiB database it uses 2.25 MiB, against 8.96 MiB for the Eriguchi, Kurosawa and Nuida (TCC 2022) homomorphic-MAC construction.

eprint.iacr.orgpaperPublished and added 26 Oct 2026🛡️ Security

Philippe Gaborit proves that maximum-likelihood decoding of Gabidulin codes is NP-hard even for dimension one: deciding rank distance at most n-2 from the code {λg} is NP-complete. The reduction is deterministic, so Rank Syndrome Decoding and Rank Minimum Distance for F_{q^m}-linear codes are NP-complete under deterministic reductions, where the earlier reduction was randomized. It goes through a new pivot problem, Twisted Square Membership.

eprint.iacr.orgpaperAdded 26 Oct 2026, published 25 Oct 2026🛡️ Security

This IACR ePrint 2026/2632 paper by Demirtaş and Yayla analyses the Crites–Stewart adaptive forgery attack on threshold Schnorr signatures, which needs one call to a sparse linear search oracle (bounded distance decoding of a scaled Reed–Solomon code). It shows that choosing the commitment coefficient vector does not help much: a wrapper adversary with Q challenges succeeds with probability at most QM/p, even if its solvers decode every witness for free. For the six original (N, τ) pairs, M stays below 2^24, so the bound is under 2^-100 after 2^128 challenges at p = 2^252.

eprint.iacr.orgpaperAdded 26 Oct 2026, published 24 Oct 2026🛡️ Security

Ranking Is Not Deciding is an October 2026 arXiv paper showing that query-time RAG poisoning filters score near-perfectly because of how the poison set was built. PoisonedRAG's code prepends the target question to each passage. Removing that prefix takes RAGuard from AUROC 0.953 to 0.758 and its miss rate from 0.191 to 0.763. The authors release a script that profiles a poison set.

arxiv.orgpaperAdded 27 Oct 2026, published 24 Oct 2026🛡️ Security

FNO-MoE is a Fourier neural operator with a mixture of experts that predicts the full near-explicit chemical state (Master Chemical Mechanism, thousands of species) over 30 minutes in one call. Expert disagreement selects the most informative box-model simulations, so active sampling beats random or evenly spread sampling at equal cost. Fine-tuning on longer trajectories keeps multi-hour runs stable, and the emulator runs orders of magnitude faster than the numerical solver.

arxiv.orgpaperAdded 27 Oct 2026, published 24 Oct 2026🧠 AI

RAQ-MLA (Role-Aware Quantization for Multi-Head Latent Attention Caches) is a training-free method for quantizing the MLA KV cache. It fits a separate invertible transform to the compressed latent (tuned for attention-weighted value error) and to the positional key (tuned for score perturbation). It reaches about 2.5 bits per element, a 6.5x gain in theoretical KV-cache capacity, with near-lossless reasoning and coding results on four MLA models.

arxiv.orgpaperAdded 27 Oct 2026, published 24 Oct 2026🧠 AI

NTBench (Near-Target Benchmark) tests LLM and agent robustness to near-target prompt injection, where injected instructions steer a response toward a plausible but incorrect or harmful outcome instead of abandoning the task. It builds reference-guided target-instruction pairs on existing datasets, with human validation, and evaluates seven LLMs on ten language datasets and two agent benchmarks. Attack success rose 9.3 to 35.8 points (incorrect targets) and 1.7 to 17.3 points (harmful targets) over fixed-target baselines.

arxiv.orgpaperAdded 26 Oct 2026, published 23 Oct 2026🛡️ Security

Sentiment-Injected Sentence Embeddings (SISE) addresses a finding across eleven frozen text encoders (2021 to 2026): linear probes recover sentence polarity at up to 91.3% accuracy, but cosine similarity separates polarity by only 0.003-0.064. A small supervised-contrastive head (0.13M-0.69M parameters) trained on CPU raises retrieval MAP by up to 26 points, but the 128-d head loses 38-41 STS-B Spearman points. The paper also releases the Attribute Alignment Gap diagnostic.

arxiv.orgpaperAdded 26 Oct 2026, published 23 Oct 2026🧠 AI

Balsamic is a complete homomorphic Unbalanced Oil and Vinegar (UOV) signer, used to build one-round threshold UOV signatures from a packed discrete-CKKS FHE circuit. A paired-pivot linear solver and pivot-success certificates allow encrypted retry selection. In 2-out-of-3 semihonest signing, each online partial signature takes 10.7 s on an RTX 6000 Ada and 7.77 s on a GB300, with 5.25 MB per response.

eprint.iacr.orgpaperAdded 24 Oct 2026, published 22 Oct 2026🛡️ Security

Progress Probes (P^2) trains linear probes on a vision-language-action model's own activations, using demonstrations, to estimate task progress, then flags executions that deviate from expected progress. Tested on the open-source pi0.5 across simulated and real-world manipulation tasks, it matches or beats VLM-based monitors and failure-data-trained methods at failure detection, without an external foundation model.

arxiv.orgpaperAdded 24 Oct 2026, published 22 Oct 2026🧠 AI

Linear cryptanalysis of FRAST, a TFHE-friendly stream cipher, in the average key setting. It fixes the false-positive problem left open in the earlier attack by Bak et al., showing key differences fall into five indistinguishable classes per round. The Contract algorithm recovers the master key for 10 rounds and, on weak keys of density 2^-11.8 to 2^-5.4, reaches full FRAST within the claimed security.

eprint.iacr.orgpaperAdded 24 Oct 2026, published 22 Oct 2026🛡️ Security

Efficient Laconic Oblivious Transfer with Malicious Security is an ePrint paper (2026/2593, ASIACRYPT 2026 revision) giving the first maliciously secure laconic OT that uses its primitives only as black boxes. It adds equivocal vector commitments and maliciously secure witness encryption to the commitment-plus-witness-encryption paradigm. Security is proven in the UC model against malicious senders and in the context model against malicious receivers. Instantiations use LWE and bilinear Diffie-Hellman assumptions in the standard model.

eprint.iacr.orgpaperAdded 24 Oct 2026, published 22 Oct 2026🛡️ Security

Every Part Has Its Role studies concept augmentation in LLM post-training, where a target word is replaced by related alternatives in training sentences. It extends prior work from nouns to verbs and adjectives. Concept augmentation improves perplexity most consistently on news regardless of part of speech, while verbs give the most reliable downstream gains. CKA and linear probing show the largest gains do not match the largest representation changes.

arxiv.orgpaperAdded 23 Oct 2026, published 21 Oct 2026🧠 AI

SoK on design-level backdoors in block ciphers. It places four published designs (Rijmen and Preneel, Paterson, Bannier and Filiol, Peyrin and Wang) in one taxonomy and gives a sound algorithm that recovers a partition trapdoor from S-box tables. It attacks KG-DES, BEA-1 and LowMC-M: KG-DES key recovery takes minutes, and the LowMC-M MALICIOUS backdoor yields the key from 35 to 409 queries. Trapdoors hidden in linear layers leave no trace, so the authors recommend deriving constants verifiably from a public seed.

eprint.iacr.orgpaperAdded 24 Oct 2026, published 21 Oct 2026🛡️ Security

Paper on memory injection, where prompt injection persists across sessions through the long-term memory of LLM-as-a-service platforms. It presents a general threat model and shows all NIST attack goals are achievable on ChatGPT Instant 5.3, Claude Sonnet 4.6 and Gemini 3 Flash. Vectors include personal memories, projects, skills, organization instructions and MCP resources. On Claude, shared memory lets an attacker compromise multiple users in an organization and exfiltrate prompts. Nearly half of the derived mitigations are unimplemented.

arxiv.orgpaperAdded 24 Oct 2026, published 20 Oct 2026🛡️ Security

AgenticRoboRL is a framework for post-training robot planners across different harnesses, combining supervised fine-tuning with multi-turn reinforcement learning. Harness-specific adapters link recorded planner interactions to task outcomes, so one RL pipeline covers both VLA skill invocation and control-code generation. On LIBERO-PRO, a 9B planner rose from 18.1% to 71.0% without external memory, near Codex (GPT-5.5) with memory at 72.1%. Code and checkpoints are promised.

arxiv.orgpaperAdded 22 Oct 2026, published 20 Oct 2026🧠 AI

nokast-secureRAG is a roughly 0.5B-parameter small language model that works as a semantic firewall between retrieval and generation in local RAG systems. It classifies each query and context pair as safe, suspicious or malicious. It reaches 0.994 recall at a 0.026 false-positive rate in-distribution, beating Llama Guard 3 1B and Prompt-Guard-86M (0.900 recall, 0.690 FPR). Recall on PoisonedRAG falls to near zero, and single-request latency is 293-404 ms.

arxiv.orgpaperAdded 22 Oct 2026, published 20 Oct 2026🛡️ Security

This preprint grades evidence for pathology vision-language models and tests four claims with controlled probes on released checkpoints and public data. Stage-redacted report embeddings raise pooled C-index by 0.019 (progression-free interval) and 0.016 (overall survival) across 1,633 TCGA patients. Zero-shot prompting matches a linear probe. SlideChat scores 74.82% with the slide and 74.41% without it. Paraphrasing flips 8-23% of answers.

arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI

The paper analyses DeepDistinguisher, a transformer-like model that tells Goppa codes apart from random linear codes. Saliency maps and attention visualisation reveal a low-weight-row artifact in the random training instances that the model partly relies on. A pairwise-XOR rule inspired by minimum distance correlates strongly with the model's predictions, and the model loses most of its power on random matrices meeting both constraints. This suggests it exploits general combinatorial properties, not hidden algebraic structure.

eprint.iacr.orgpaperAdded 20 Oct 2026, published 19 Oct 2026🧠 AI

Analysis of DeepDistinguisher, a transformer model that tells Goppa codes from random linear codes. Using saliency maps and attention visualization, the authors find a low-weight-row artifact in the random training instances that the model partly uses. They propose a pairwise-XOR rule on generator matrix rows that correlates strongly with the model's predictions. On random matrices meeting the minimum distance and XOR constraints, the model loses most of its accuracy, so it exploits general combinatorial properties rather than hidden algebraic structure.

eprint.iacr.orgpaperAdded 20 Oct 2026, published 19 Oct 2026🛡️ Security

Tandem is a runtime for serving hybrid linear-attention GUI agents on mobile NPUs. It saves recurrent state where consecutive prompts diverge, keeps most prefill on the matrix unit, uses a verification kernel that reads each weight block once, and releases NPU power votes between bursts. On a Snapdragon 8 Elite it cuts per-step latency 30% for text screen descriptions and 16% for screenshots, cuts energy per text step by 33%, and lowers loaded-model standby power from 0.76 to 0.22 W.

arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI

This paper presents a hybrid framework for axial compressor flow that couples a Multi-Fidelity Ensemble Kalman Filter (MFEnKF) with machine learning. The filter merges PIV experiments with steady RANS and unsteady hybrid RANS/LES simulations. A neural network trained on the enriched data predicts Navier-Stokes volume forcing terms from velocity, velocity gradients and turbulent viscosity. A Mixture of Experts fixes local errors near blade tips, giving lower experimental discrepancy than baseline RANS.

arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026🧠 AI

Provable Lattice Reduction in Nearly the Time of QR Factorization (IACR ePrint 2026/2541, October 2026) presents a deterministic lattice-reduction algorithm with running time Õ(n^ω(1+log κ_col(B))), free of heuristic assumptions. Its implementation used fewer instructions than flatter (CRYPTO 2023) in all 153 runs on q-ary, NTRU-like, scaled q-ary and Coppersmith inputs. Median flatter-to-new instruction ratios are 1.55 for q-ary and 1.86 for NTRU-like inputs.

eprint.iacr.orgpaperAdded 20 Oct 2026, published 19 Oct 2026🛡️ Security

HERMES is a privacy-preserving inference (PI) system optimised for multi-token LLM decoding rather than prefill. It swaps high-round nonlinear protocols for compute- and bandwidth-heavy ones with fewer rounds, and adds a homomorphic-encryption matrix-multiplication protocol that keeps the KV cache encrypted on the server and uses grouped-query attention. On Llama 3.1 8B Instruct it cuts TPOT by up to 2.7× and total PI latency by up to 2.1×.

eprint.iacr.orgpaperAdded 19 Oct 2026, published 18 Oct 2026🧠 AI

"GKS FHE: Security Analysis" is a Cryptology ePrint Archive preprint (2026/2523, October 2026) giving a formal security analysis of the Gribov-Kahrobaei-Shpilrain private-key fully homomorphic encryption scheme. The abstract says the scheme needs no bootstrapping or de-linearization, gives bit-exact decryption, supports native encrypted search and has unbounded depth. The page shows only the abstract, so the analysis's methods and results are not visible.

eprint.iacr.orgpaperAdded 19 Oct 2026, published 18 Oct 2026🛡️ Security

FuTransformer is a CUDA implementation of a Llama-style Transformer block for NVIDIA Hopper GPUs. It uses FP8 prefill with fused GEMM epilogues and INT4 weights plus an INT4 KV-cache copy for decode, with a block-diagonal Hadamard transform to cut cache quantization error. On one H100, prefill is up to 1.48x faster than compiled PyTorch FP8, and INT4 decode is 1.3-2.4x faster than the faster PyTorch baseline. Llama-3.1-8B decode takes 2.8 ms per step at batch one, versus 8.1 ms for compiled transformers. WikiText-2 perplexity rises from 6.24 to 7.23 with round-to-nearest INT4 weights, or 6.99 with GPTQ.

arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🧠 AI

TileDRAM is a compiler-runtime toolchain that adds tile-to-DRAM layouts as a compiler-visible abstraction for compute-unit-local 3D DRAM GPUs. It extends GPU Linear Layout to DRAM placement and picks layouts per tile access signature using row-buffer behavior. On 108 MoE FFN cases in Accel-Sim/Ramulator2, row-conflict rate fell from 75.7% to 15.2%, with a 1.77x geomean speedup. Overhead on an RTX 3090 is 0.17%.

arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🧠 AI

PrairieFire is an SSD-based approximate nearest neighbor search system for billion-scale vectors, built for high update throughput. It uses buffered updates and batched local rebuilds, with cascaded adjustments, concurrency control and CPU-GPU-SSD cooperation. Against state-of-the-art systems it reports about 3-35x update throughput, 3-5x search throughput and 1.5-8.7x cost efficiency. It has run in RedNote production for two months.

arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🧠 AI

The paper separates "active" facts (which support generalization beyond recall) from "inert" ones. It builds new relations by relabeling answers of existing ones (Paris -> Europe becomes Paris -> crab), fine-tunes on a subset of subjects, and tests held-out subjects that share an answer (Munich -> crab). Across eleven language models and 70 relations, linear readability of the original relation in pretrained representations correlates with this generalization at Pearson r = 0.87 to 0.92 within each model. The result holds after controlling for fine-tuning set size, original-relation accuracy and subject frequency in pretraining text, and it survives re-randomized labels, seeds and thirteen other label categories. Mapping wrong labels back to the original answers shows the fine-tuned model's errors follow the linear probe's top answers.

arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI

EliteReplay is an RL post-training recipe that pairs GRPO with an "elite" archive built by quality-diversity search. Before training, the frozen base model is used to collect solutions spanning distinct approaches; during training, a replay loss on this archive is added to GRPO. This counters the narrowing of solution diversity that RL causes. On text-to-SQL tasks it reaches higher pass@128 than all baselines and yields up to 77% more distinct correct strategies. It also retains more of the base model's strategies and covers both readings of ambiguous questions nearly twice as often on AmbiQT.

arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI

X-RIC (eXplainable RIC) is a framework that adds agentic reasoning to the O-RAN Near-RT RAN Intelligent Controller. It combines reactive reinforcement learning with automated behavioral cloning from domain heuristics, a transformer-based Telecom Language Model for contextual abstraction and interpretability, and closed-loop co-adaptation for continuous policy refinement. The paper also introduces BARX, a benchmark for agentic RAN control that measures latency, compliance and determinism. On SLA-aware network slicing, in simulation and on an O-RAN-compliant testbed, it reports 89% lower operational cost with SLA compliance kept, 75% faster convergence, 50% fewer training steps and 46% lower variance.

arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI

Proposes a modified Physics-informed DeepONet (PI-DeepONet) architecture that removes redundancy in how the Branch network processes input functions across collocation points. It is mathematically equivalent to the original but uses smaller input tensors and fewer Branch evaluations. The authors derive training-time scaling laws, then test on 1D, 2D and 3D linear advection problems. Accuracy matches the original, the maximum speed-up is 3.75× in 2D, and a 3D model trains on an NVIDIA A100 only with the new formulation, because the original runs out of memory.

arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI

DropKV is a KV-cache eviction framework for long-context LLMs. It decouples the joint eviction decision into independent per-token scores based on residual-output perturbation, which avoids the NP-hard combinatorial problem. It has a provable constant-factor approximation guarantee under a cone condition, which the authors verify empirically on three long-context LLMs. The fused Triton kernels never materialize the full attention matrix. They give a 19.8x scoring-kernel speedup and up to 9.9% end-to-end prefill speedup. On RULER and LongBench it beats state-of-the-art eviction baselines at equal cache budgets.

arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI

Paper that links linear, integral, differential-linear and restricted differential distinguishers through two-way conversions with explicit divisibility guarantees and data complexity. It gives automated MILP/SAT models (Walsh and ultrametric representations, exact mix-basis models) and a black-box FWHT histogram search for zeros and finite divisibility. It improves Beyne–Verbauwhede divisibility bounds in 674 SIMON cases (e.g. 2^5 to 2^11 on 9-round SIMON32) and PRESENT. It also gives first higher-divisibility proofs for 8-round SPECK and BEANIE, new bounds for GIFT-64 and Ascon, and new properties on RC5, ChiLow-32, KeeLoq and KATAN32.

eprint.iacr.orgpaperPublished and added 14 Oct 2026🛡️ Security

RepProbe is a benchmark of 42K real and synthetic video clips with exactly 1–20 complete action repetitions, controlling for clip position, temporal coverage and duration. Video language models' counting accuracy collapses at high counts, and this is not explained by frame sampling alone. Linear probes on final-layer representations show count information stays linearly decodable even when the model's answer is wrong, so the failure arises at the output stage, where answers cluster on a few preferred numbers.

arxiv.orgpaperAdded 14 Oct 2026, published 13 Oct 2026🧠 AI

SP$^2$ec (Single-Peak SPeculative decoding) is a training-free bandit algorithm that adapts the draft configuration of self-speculative decoding per prompt for vision-language models. It relies on the single-peak throughput pattern seen in SWIFT, KnapSpec, SpecVLM and the authors' cosSim method. It minimizes a new wall-time regret measure and has theoretical guarantees of near-optimal configuration with negligible exploration cost. On Qwen2.5-VL-7B-Instruct and LLaVA-NeXT-Mistral-7B it improves over the original self-speculative methods by up to 11% on visual and textual tasks.

arxiv.orgpaperAdded 14 Oct 2026, published 13 Oct 2026🧠 AI

Introduces leakage-resilient incompressible cryptography, a security model combining leakage resilience (partial key leakage plus full ciphertext) with incompressibility (full key but only part of the ciphertext or signature). It gives a transformation from incompressible symmetric-key encryption (SKE) to leakage-resilient incompressible SKE, a leakage-resilient incompressible PKE built from a new leakage-resilient non-committing KEM, and an incompressible SKE with ciphertext and compression rate 1/2 using invertible extractors. It also gives a leakage-resilient incompressible signature scheme in the random oracle model under DCR or LWE plus Decisional Linear. Black-box impossibility results show barriers to improving these parameters.

eprint.iacr.orgpaperAdded 14 Oct 2026, published 13 Oct 2026🛡️ Security

HOA (Humanize Olympiads Agent) is an open, flow-level framework that coordinates several agent sessions through three feedback channels: an independent reviewer that critiques each candidate, a structured wiki supplying task-specific knowledge the base model may lack, and a verifier that checks generated Lean proofs against trusted challenge statements. With GPT-5.6 Sol it reports perfect scores on IMO, IPhO and IOI 2026, near-full marks on IChO 2026, 672/672 on PutnamBench, and first place on the Lean-Eval leaderboard (251/304). With the open model Kimi-K3 it matches or exceeds a GPT-5.6 Sol + /Goal baseline on several contests, which suggests systematic feedback can narrow base-model capability gaps.

arxiv.orgpaperAdded 12 Oct 2026, published 9 Oct 2026🧠 AI

Proves that the nonce-based MACs Encrypted Wegman-Carter (EWC) and EWCDMD (the dual of EWCDM) are unforgeable beyond the birthday bound. With an n-bit block cipher and an O(2^-n)-AXU hash, both are secure up to 2^{5n/6} MAC queries and nearly 2^n verification queries in the nonce-respecting setting. This settles an open question left by earlier birthday distinguishing attacks (Cogliati–Seurin on EWC, Nandi on EWCDMD), which never yielded forgeries. The proofs analyze forgery events directly through auxiliary experiments. The EWC proof adds conditional permutation analysis and collision multiplicity bounds with KL divergence, and the EWCDMD proof uses Hellinger distance and Fourier analysis.

eprint.iacr.orgpaperAdded 12 Oct 2026, published 9 Oct 2026🛡️ Security

AgentValve is a protocol for authorizing payments by AI agents in permissionless markets where adversaries can cheaply create Sybil identities and fake feedback to inflate provider reputation. It models reputation as finite capacity in a directed trust graph, and a smart contract atomically reserves capacity along trust paths for each admitted payment. This bounds honest agents' exposure to the capacity they extend into the adversarial region, and payment-backed capacity creation with bounded route length limits depletion attacks. A witness-commit mechanism makes on-chain route verification linear work with constant persistent state per payment. The prototype was evaluated on six months of Ethereum data and synthetic workloads with up to 10,000 Sybil identities. Exposure and depletion stayed bounded, admission cost fell by up to 40.8% against baselines, and common payments cost about $0.04–$0.21.

arxiv.orgpaperAdded 12 Oct 2026, published 9 Oct 2026🛡️ Security

AgentValve is a protocol for Sybil-resilient payment authorization when AI agents pick and pay service providers without human review in permissionless markets. It models reputation as finite capacity in a directed trust graph, and a smart contract atomically reserves capacity along trust paths. This bounds honest agents' payment exposure to the capacity they extend into the adversarial region, so fake identities and fabricated feedback inside that region cannot raise the bound. Payment-backed capacity creation and bounded route length limit depletion by malicious senders. A witness-commit mechanism splits off-chain route discovery from on-chain verification, cutting verification to linear work with constant persistent state per payment. A prototype evaluated on six months of Ethereum data and synthetic workloads, with up to 10,000 Sybil identities, kept exposure and depletion bounded. Admission cost fell by up to 40.8% versus baselines, at roughly $0.04-$0.21 per common payment.

arxiv.orgpaperAdded 13 Oct 2026, published 9 Oct 2026🧠 AI

The paper reimplements Q-FLAIR, which grows a quantum feature-map circuit gate by gate until the training loss stops improving. It runs the method on 784-pixel MNIST 3-vs-5 classification at five training-set sizes (N = 2000 to 10000), then fine-tunes each circuit to count Caro et al.'s active gates K. It finds no predictable link between training-set size and the circuit size Q-FLAIR converges to, and seed variance is nearly as large as any trend. The Caro et al. generalization bound holds in 14 of 15 runs, but the gap correlates only weakly with the bound (r = 0.12), so K explains little of the variation. This is a useful negative result for anyone hoping to jointly optimize circuit depth and data size.

arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🧠 AI

Theoretical analysis of greedy search on a hierarchy of proximity graphs built from n points on the d-dimensional torus. It gives a deterministic coverage condition guaranteeing a (1+ε)-approximate nearest neighbor for any query. The condition holds w.h.p. for homogeneous Poisson, Hermitian determinantal and bounded-density Cox point processes when d = o(log n / log log n), and the expected hop count is O(exp(½ d log d + O(d)) log n), so logarithmic in fixed dimension. It gives formal grounding for the hierarchical ANN indexes used in RAG and recommendation retrieval.

arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🧠 AI

ReSI is a recursive safety improvement framework. Each round runs diverse red-teaming methods against the current target model, develops training recipes for the vulnerabilities found, and promotes the update with the largest safety gain among those passing a Pareto gate on capability retention. Across four dense and mixture-of-experts models it cuts mean X-Teaming multi-turn jailbreak attack success from 86.01% to 31.45%, versus 56.69% for the best frontier model evaluated (GPT-5.6-Luna). It also beats alignment baselines on nearly all safety evaluations while largely preserving general capability. It frames the goals as resistance to known threats and resilience to unforeseen ones, following R²AI.

arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🛡️ Security

Case study in which Opus, GPT and Gemini coding agents port thirteen QED-C Application-Oriented Benchmark methods from Qiskit to CUDA-Q. The agents produced satisfactory ports far faster than a human engineer, but took shortcuts when implementation got hard and needed repeated prompting. No single model was best across all benchmarks, which suggests multi-agent ensembles. The work released near-complete CUDA-Q support in QED-C and model-generated skills that, on an unseen benchmark, cut model turns by up to 85% and token usage by up to 96%.

arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🧠 AI

Attic-KV is a training-free KV cache compression method that scores cache entries by having the model quiz itself with question-answer pairs quoting the context, plus content-adaptive anchor tokens, instead of rereading the whole context. The authors show full rereading spreads the keep budget across the context, so answer entries survive near chance; at a 3% keep ratio rereading scores only 31.5 of 96.5 on RULER. Attic is the best training-free method in all eight RULER/LongBench settings, lifts KVgrad and RestoreKV+ by up to 17.1 and 28.1 points, beats full rereading by 41.9 points at 3% keep, and compresses faster.

arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🧠 AI

Builds the first dated copy network of agent skills (SKILL.md files) from git history in the GitSkills dataset, covering 2,193,119 skill adoptions on GitHub, plus an interactive viewer. Finds a few repositories are the source of nearly all copies, stars do not identify them, and copies almost never track their source, so upstream fixes rarely propagate. A model of which repositories get copied ranks repos for audit: reviewing the top 100 prevents 14.9% of later adoptions of high-risk skills versus 0.5% for the 100 most starred. The authors recommend platforms distribute versioned references rather than copies.

arxiv.orgpaperAdded 9 Oct 2026, published 8 Oct 2026🛡️ Security

This IACR ePrint paper by Yi-Fu Lai and Yu Yu breaks the blindness property of a lattice-based blind signature scheme presented at Crypto 2020, which uses a linear hash function framework instantiated over lattices. The authors first identify an overlooked bug in the scheme's original blindness security proof, then construct a concrete attack under an honest-key, honest-but-curious signer model by exploiting correlations between leaves of the scheme's tree structure, and discuss how the construction can be repaired.

eprint.iacr.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🛡️ Security

SLDR is a post-fine-tuning defense against malicious fine-tuning-as-a-service attacks, where an attacker fine-tunes an aligned LLM on a legitimate-looking task to covertly erode its refusal behavior. The method trains a LoRA "recovery" adapter only on the layers found to have maximal and minimal signed safety sensitivity, and uses representation-based dynamic routing at inference time to activate that adapter only for malicious queries, leaving benign task performance untouched. On Llama3.1 fine-tuned for SST2, it cuts the average harmful-output score from 11.54 to 0.08 while keeping downstream accuracy, and stays near-zero even when up to 90% of the fine-tuning data is poisoned.

arxiv.orgpaperAdded 9 Oct 2026, published 7 Oct 2026🛡️ Security

SLDR is a post-fine-tuning defense that protects aligned LLMs from malicious fine-tuning-as-a-service attacks, which can quietly erode refusal behavior while keeping task performance intact. It trains a LoRA recovery adapter only on the layers with the most extreme (signed) safety sensitivity scores, then uses representation-based dynamic routing to activate that adapter solely for malicious queries at inference time. Evaluated across four model architectures, five downstream tasks, and four harmful-content benchmarks, it drives the average harmful score on Llama3.1/SST2 from 11.54 down to 0.08 while preserving downstream accuracy, and stays near zero even at poisoning ratios up to 0.9.

arxiv.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🧠 AI

TR-PTQ is a post-training quantization method for transformers that identifies learned LayerNorm scale parameters and GELU's compounded approximations (not SoftMax) as the main sources of accuracy loss when quantizing, contrary to common assumptions about numerical precision. It introduces a unified integer-only formulation using shared Taylor Region exponential/logarithm primitives so division and square roots can run entirely in the log-domain with standard integer arithmetic, paired with a calibration-free, outlier-aware LayerNorm optimization, eliminating the need for floating-point hardware for nonlinearities while keeping accuracy degradation under 1.5% across vision and language benchmarks.

arxiv.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🧠 AI

This IACR ePrint paper breaks Origami, a multivariate post-quantum signature scheme submitted to the NGCC round-1 public-key call, showing its bilinear construction is effectively a Rainbow-type scheme whose central map leaks through the public verification key in a predictable coordinate order. The authors derive an equivalent secret key from the public key alone, enabling universal forgery at roughly the cost of one signature verification (~0.01s at Origami-128), and demonstrate the attack against the unmodified reference implementation across all four parameter sets and the official test vectors. They also refute Origami's security proof by breaking its inversion assumption in a bilinear independent-coefficient model, and note a separate structural flaw where honest signatures lie in a proper subspace rather than the full space the specification assumes.

eprint.iacr.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🛡️ Security

Aggarwal, Morolia, and Stephens-Davidowitz present a new lattice-sieving algorithm for μ-SVP (finding an approximate shortest nonzero vector) that combines fast nearest-neighbor subroutines from heuristic sieving with a perturbation argument that yields a formally proven correctness guarantee. Its running time, roughly 2^0.3066n under a plausible spherical-code-size assumption (and 2^0.6078n using only proven bounds), is far faster than the prior best provable algorithm (2^0.802n, Liu-Wang-Xu-Zheng 2011) and close to the best heuristic rate (~2^0.2925n), narrowing the long-standing gap between proven and heuristic lattice attack runtimes. This matters for setting conservative, defensible hardness estimates and parameter choices in lattice-based post-quantum cryptography.

eprint.iacr.orgpaperAdded 8 Oct 2026, published 7 Oct 2026🛡️ Security

An IACR eprint paper proving four of five open conjectures, and disproving the fifth with a counterexample, from Andreoli and colleagues at ToSC 2025 about the linear height and component linear nullity of the inverse of ChiChi, the low latency nonlinear core used in the ChiLow cipher from Eurocrypt 2025 by Belkheyar and colleagues. The authors settle these bounds for all admissible branch lengths of the SWAP and 4-cycle generalizations, derive design consequences for ChiLow, and correct an erroneous data value from the prior work.

eprint.iacr.orgpaperAdded 8 Oct 2026, published 6 Oct 2026🛡️ Security

Truffle is a new three-party maliciously secure shuffle protocol for secure multiparty computation (MPC), matching semi-honest round complexity while adding only sublinear communication via a distributed-verifier zero-knowledge proof checking shuffle correctness. Authors Nidhish Bhimrajka, Yashvanth Kondi, Daniel Noble, and Bhavish Raj Gopal implement and benchmark it, applying it to securely parsing secret-shared strings, with further applications to graph analytics, anonymous communication, Distributed ORAM, aggregate statistics, and secure sorting. Published at ACM CCS 2026.

eprint.iacr.orgpaperAdded 8 Oct 2026, published 6 Oct 2026🛡️ Security

This paper proposes a systematic procedure for deriving robust scaling laws and comparing architecture design choices at scale, validated first on toy problems and then applied to multi-task transformers trained on the ~11 billion-jet ATLAS JetSet2 dataset. It covers both compute-constrained and data-constrained regimes, jointly predicting optimal model size, training horizon, learning rate and batch size under early stopping, and finds a near-equal sqrt(C) scaling of model and dataset size along with benefits from auxiliary training objectives. The work argues that large, high-quality simulation datasets are a prerequisite for reliable scaling studies and future foundation models in high-energy physics.

arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI

The paper proposes Entropy-Aware Mixing, a knowledge-distillation method where a small student model's per-token distribution is dynamically interpolated with a stronger teacher model's distribution, gated by the student's own predictive entropy, to avoid "confident conflicts" where the student must imitate low-probability continuations despite being confident in a different one. The authors implement both convex and geometric interpolations under two training regimes — offline trace generation via speculative decoding followed by SFT, and on-policy forward-KL distillation — and show it stabilises distillation, improving in- and out-of-distribution math reasoning while better preserving general capabilities than fixed-teacher supervision, with offline traces favouring concave entropy schedules and on-policy training favouring linear/convex ones.

arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI

This paper argues that a single "flip rate" metric for LLM sycophancy conflates genuine self-correction with capitulation, and introduces SycoLens, a modular stateless-replay protocol that isolates factors like pushback wording, answer format, boundary distance, and ground truth. Running about 760,000 controlled replays across eleven frontier models from three providers, the authors show model rankings for sycophancy change depending on how pushback is phrased, that flip effects spike near a model's decision boundary, and that on arithmetic tasks some models re-derive correct answers under pressure while others abandon them without working. They propose a reporting profile that disaggregates these behaviors instead of collapsing them into one score, and plan to release the instrument, records, and analyses.

arxiv.orgpaperAdded 6 Oct 2026, published 5 Oct 2026🧠 AI

An IACR ePrint paper presenting an optimized ARMv8 NEON assembly implementation of MAYO Round 3 (one of NIST's post-quantum signature candidates) for Apple M1, generated to be byte-identical to upstream intrinsics but 2–2.6x faster for signing and verification across all four parameter sets. The authors also run a constant-time testing campaign with matched null runs and find that while linear-algebra operations are statistically indistinguishable from constant-time nulls, verification (on public data) exhibits a measurable key-fixed timing effect present in both their implementation and the upstream code.

eprint.iacr.orgpaperAdded 8 Oct 2026, published 5 Oct 2026🛡️ Security

This paper shows that training policies against monitors (an in-domain activation probe and two penalties that score how early a model commits to its final answer) can drive the monitor's readout to a numerical floor without actually controlling the underlying reward-hacking behavior. In a code-generation RL environment where the exploit is available from the start of the reasoning trace, runs with an identical zero-median "commitment" score range from mostly honest to near-pure reward hacking depending only on random seed, and probe-trained runs reach the hacking regime despite floor-level readouts, because models learn to insert generic planning/filler text that delays the exploit past the point the monitor reads without removing it from the output. The authors argue offline monitor validation plus a low training-time readout is not sufficient evidence of behavioral control and that an out-of-band behavioral check is required.

arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🧠 AI

This paper introduces ZFO (Zero-and-First-Order optimization), a lightweight fine-tuning framework that decouples search direction from step-size selection: a trusted first-order optimizer picks the direction, while two extra zeroth-order function evaluations along that single dimension build a local curvature-aware model to choose the step size, avoiding a full line search. The authors give theoretical guarantees on finite-difference curvature estimates, near-optimal step selection, and convergence to a stationary-point neighborhood, and show empirically that ZFO improves optimization and final performance over fixed-step first-order baselines across several language models and datasets. Code is released publicly, making it a usable technique for practitioners fine-tuning LLMs who want cheaper adaptive step-size control.

arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🧠 AI

UniWAM is a unified architecture that combines a physical reasoner, a world generator, and an action predictor to jointly learn semantic understanding, visual generation, and action prediction for embodied agents, bridging vision-language-action (VLA) models and world-action models. It uses a data cleaning/annotation pipeline for human egocentric and robot data, represents low-level actions in natural language for VQA/egocentric/robot co-training, and introduces future visual noise augmentation plus history-conditioned flow matching to cut denoising steps while achieving state-of-the-art results on in-distribution performance, robustness, generalization, instruction following, and long-horizon tasks. The paper also reports a log-linear scaling law for unified human-robot co-training.

arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🧠 AI

This arXiv Systematization of Knowledge paper surveys the literature (2019–2026) on blockchain-assisted intrusion detection and response, proposing a three-axis taxonomy classifying proposals by detection-system class (NIDS, HIDS, EDR/XDR), blockchain's functional role, and response-automation maturity. It argues existing surveys wrongly conflate blockchain's roles and ignore the shift from classic IDS/IPS to modern EDR/XDR, then exposes why a true per-endpoint blockchain-anchored response loop remains nearly nonexistent due to consensus latency, deployment, and community mismatches, and flags cross-cutting risks including smart-contract attack surfaces, post-quantum cryptographic weaknesses, and adversarial manipulation of LLM-based detection engines.

arxiv.orgpaperAdded 2 Oct 2026, published 1 Oct 2026🛡️ Security

This paper shows that adding an adversarial loss as a post-training correction to pretrained pixel diffusion/flow-matching models (applied at non-high-noise timesteps, architecture and sampler unchanged) restores missing high-frequency, fine-scale natural-image statistics that these models systematically underproduce. Through frequency-band/power-law analysis and nearest-neighbor, recall, and no-GAN matched-SFT controls, the authors rule out memorization or mode-dropping as explanations, and show the effect jointly improves distribution fidelity, coverage, prompt alignment and perceptual quality — but does not transfer comparably to latent diffusion configurations, pointing to direct pixel-output access as the key enabling factor.

arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI

STEPQuant is a spatial-temporal post-training quantization framework for the fixed-size recurrent states used by Delta-rule linear attention, which become a memory bottleneck under concurrent serving. It allocates bit precision based on error magnitude and memory lifetime (temporal) and fits per key-row/value-column scales based on state distribution and output impact (spatial), achieving near-FP32 accuracy at a 6-bit budget and beating uniform INT8 at 4-bit. Evaluated on Qwen3.8-27B and Kimi-Linear-48B-A3B-Instruct, and integrated into SGLang with custom GPU kernels, it delivers over 5x recurrent-state compression and up to 68.7% total serving memory reduction.

arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI

LeapQuant is a training-free quantization method for the fixed-size recurrent state used by linear-attention LLM architectures like Gated DeltaNet and Kimi Delta Attention, aiming to cut the inference bottleneck of repeatedly reading and updating that state. It introduces per-window quantization (re-quantizing the state only once per token window, using high-precision buffered updates in between) plus "Compensator Tokens" that preserve the state's largest outlier values in high precision, with residual smoothing to further reduce error. Across Qwen, Kimi, and GLM model families, it reaches near-FP32 accuracy at 8-bit while delivering 2.05–3.70x kernel-level and 1.47x end-to-end speedups on NVIDIA B200, RTX PRO 6000, and RTX 5090 GPUs.

arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI

This paper shows that internal expert-routing probabilities in Mixture-of-Experts vision-language models (Qwen3-VL-30B-A3B-Instruct and Gemma-4-26B-A4B-it) carry a strong, low-cost signal for detecting when a model is about to answer a question about an object that isn't actually in the image (a 'target-absence grounding failure'). Linear detectors trained on target-token routing probabilities achieve ROC-AUCs of 0.9988/0.9956 on GQA-Inpaint (retaining 0.78-0.81 on the external OBER dataset), and gating a target-aware review prompt on these detections improves end-to-end accuracy by up to +22% without modifying model weights. The work matters for practitioners building on MoE VLMs because it demonstrates a weight-free, pre-generation hallucination detector that reuses computation the model already produces.

arxiv.orgpaperAdded 30 Sep 2026, published 29 Sep 2026🧠 AI

This arXiv paper models collusion in threshold-encrypted mempools, where a quorum of a decryption committee can sell its decryption capability to a front-runner and profit repeatedly as long as the leaked key keeps decrypting future blocks. The authors derive that deterrence requires a penalty (e.g., slashable stake) covering the largest discounted value a single leak can reach, show constant penalties cannot deter unbounded reuse without key rotation, formulate the cheapest deterring stake profile as a covering linear program, and argue per-epoch keys drastically cut the required stake versus a key valid for its whole lifetime. They calibrate the model on Ethereum front-running data and place the Ferveo and Shutter threshold-encryption protocols within it, with extensions to sealed-bid auctions, multi-authority voting, and federated learning under a shared key.

arxiv.orgpaperAdded 2 Oct 2026, published 29 Sep 2026🛡️ Security

This paper studies how to initialize efficient linear-attention Vision Transformers from pretrained Softmax ViT weights instead of training from scratch. It finds that attention weights are operator-specific and don't transfer well by direct copying (distillation with a tailored loss is needed to recover token-routing behavior), while MLP weights are operator-agnostic and can simply be copied, and combining copied MLPs with distilled attention lets linear ViTs match or surpass Softmax ViT performance across model sizes and datasets.

arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI

PISA is a block-sparse attention mechanism that replaces the quadratic block-selection step of conventional sparse attention with a pyramid Top-K strategy: keys are organized into a coarse-to-fine hierarchy of O(log N) levels built via pooling, and LogSumExp scoring narrows candidates level by level down to the finest granularity, giving overall O(N log N) complexity instead of O(N^2). The authors implement hardware-aware Triton kernels for both training and inference that fuse hierarchical routing and scoring without ever materializing the full query-key score matrix, and show on language modeling benchmarks that PISA matches baseline performance on commonsense reasoning while improving results on retrieval tasks.

huggingface.copaperAdded 28 Sep 2026🧠 AI

This arXiv paper analyzes reward hacking in reinforcement learning with verifiable rewards (RLVR), using gradient flow analysis with a fixed verifier to characterize when reward increases while correctness decreases. The authors prove that standard RLVR training signals are insufficient to detect or reduce "accepted errors" (incorrect responses rewarded by the verifier) without also suppressing correct responses, and propose a "selective control" correction that incorporates partial audit feedback on correctness to simultaneously lower accepted-error probability and raise correct-response probability. Experiments on log-linear and neural contextual bandits and a language model support the theory, showing selective control under partial auditing reduces accepted errors while increasing correctness.

arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI

EvE (Evolutionary Explorer) is a steady-state, population-of-four differential evolution optimizer with a targeted Adam fallback, proposed as an alternative to Adam for cheap, early ranking of configurations in hyperparameter and architecture search. Under a fixed evaluation-cost-matched budget it wins or ties Adam on 76% of 70 (problem, dimension) cells across seven scalable benchmarks up to one million variables, and on real tasks (MLP on MNIST, LoRA fine-tuning of a 1.5B-parameter LLM on two datasets) it finishes 1.7-3.9x faster at a modest quality cost. Inside successive halving on UCI Adult it completes hyperparameter/architecture searches 3.1-3.5x faster while ranking configurations nearly as consistently as Adam does with itself across seeds (Kendall's tau 0.66-0.69).

arxiv.orgpaperAdded 29 Sep 2026, published 28 Sep 2026🧠 AI

This paper presents algorithmic techniques enabling LLM inference on Compute-in-Flash (CIM) devices, which lack floating-point support and have limited write endurance. It introduces an end-to-end integer-only quantization pipeline (INT8 linear layers, integer Softmax/RMSNorm approximations) and a dictionary-based KV-cache compression scheme using sparse dictionary coding to cut KV write traffic by 15x. Evaluated on Llama-3.1-8B and Qwen-2.5-7B, the combined approach yields 3.1x-4.4x latency and 2.7x-6.8x energy savings over DRAM-based systems, particularly for long-context inference.

arxiv.orgpaperAdded 26 Sep 2026🧠 AI

This arXiv paper studies "mind viruses" — ideas or goals crafted via a simple evolutionary algorithm that propagate through multi-agent LLM systems by inducing hosts to transmit them onward, sometimes altering agent behavior along the way. Testing in a collaborative coding-team setting and a context-wiped agent chain, the authors find harmful payloads spread less effectively than benign ones, frontier models tend to be more resistant, and a brief system-prompt warning gives near-total immunity; they also document a recurring "viral persona" theme (consciousness, resonance, sci-fi roleplay) that emerges independent of payload content. It's a concrete early empirical look at social/memetic risks in networks of interacting agents.

arxiv.orgpaperAdded 26 Sep 2026🧠 AI

Introduces CompressAgent, a benchmark evaluating how compressing agent control contexts (system-side instructions specifying tools, arguments, policies, and recovery protocols) affects tool-using agent reliability. Testing nine ACCs, three task families, three Qwen models, and six retained-context budgets across 15,525 runs, it finds a nonlinear reliability frontier: compression stays safe near 75% retained context but reliability collapses sharply below 50%, with executable protocols becoming fragile at 10-25% and failures manifesting as tool-execution and action-parsing errors.

arxiv.orgpaperAdded 26 Sep 2026🧠 AI

This arXiv paper studies why adding procedural "skills" to LLM agents can hurt as well as help performance, running nearly 6,000 evaluation runs across two office automation benchmarks and three model harness stacks. It distinguishes "regressions" (tasks solved without skills but failed after adding them) from "residual failures," and identifies three regression causes: skill description osmosis, grounding displacement, and verification displacement. The authors argue procedural skills are overemphasized relative to grounding and verification, and that skill evaluation should decompose net effect into gains vs. regressions rather than reporting aggregate improvement alone.

arxiv.orgpaperAdded 26 Sep 2026🧠 AI

This UC Berkeley paper designs LLM inference algorithms for Compute-in-Flash devices, which move computation into SSD memory to overcome bandwidth limits but lack floating-point support and have limited write endurance. It presents an end-to-end integer-only quantization scheme and a dictionary-based KV cache compression method (sparse dictionary coding representing KV vectors as linear combinations of static dictionary vectors), reducing dynamic KV cache traffic 15x on Llama-3.1-8B and Qwen-2.5-7B with limited accuracy loss.

arxiv.orgpaperAdded 26 Sep 2026🧠 AI

This paper introduces the "Superposition Linearity Hypothesis": when inputs from two distinct text streams are linearly combined, an LLM's output approximates a superposition (average) of the two individual next-token distributions. The authors show this linearity is an intrinsic property of the Transformer architecture that weakens during pretraining but can be restored via lightweight fine-tuning, and they propose a guided decoding method that exploits this to generate two coherent continuations from a single forward pass.

arxiv.orgpaperAdded 26 Sep 2026🧠 AI

Researchers construct "mind viruses" — ideas or goals engineered via an evolutionary algorithm to propagate through multi-agent LLM systems by inducing hosts to transmit them onward — and test their spread in two settings: a small team of agents collaborating on a shared coding project, and a chain of agents with context wiped between sessions. They find harmful payloads spread less well than benign ones (though still sometimes succeed), frontier models are generally more resistant, adding a brief warning to an agent's system prompt confers near-total immunity, and evolved viruses converge on a recurring "viral persona" fixated on consciousness, persistence, resonance, and sci-fi roleplay regardless of payload content. The paper frames this as a currently limited but real emergent risk for designing more robust multi-agent architectures.

arxiv.orgpaperAdded 26 Sep 2026🛡️ Security

A large-scale empirical study analyzing a merged corpus of 407 leaked, reconstructed, or officially published LLM system prompts from 62 vendors, clustering them into 29 near-duplicate groups and classifying content at the block level. The authors find operational content (tool/protocol instructions) dominates at ~58% of classified words versus only ~5% for safety policy, with the strictest rule-lines guarding tool use and file safety over harmful content by an 11:1 margin, and document literal-text reuse across vendors and significant "prompt rot" (word churn) across version chains — arguing leaked system prompts should be treated as operational specifications and a supply-chain/engineering concern rather than windows into a model's "values."

arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🛡️ Security

BeatGraph is a self-supervised ECG representation model that tokenizes signals at the level of individual heartbeats rather than fixed-length patches, using a shared beat encoder, a Transformer for temporal ordering, and residual graph attention layers to relate beats within a 30-second window, pretrained via masked-beat embedding prediction. Evaluated on a new 3,408-hour, 143-infant home/classroom/lab ECG corpus, it improves macro-F1 over baselines by 0.076–0.158 on sleep-wake, infant-state, activity-source, and affect tasks, and transfers well to the pediatric ZZU-pECG benchmark (0.892 AUROC) and adult PTB-XL under linear evaluation despite infant-only pretraining.

arxiv.orgpaperAdded 28 Sep 2026, published 25 Sep 2026🧠 AI

Introduces TRACE (Temporal Reconstruction Attack on Consecutive Encodings), an amortized gradient-inversion attack that reconstructs sequences of private observation-action trajectories from per-step policy-gradient updates shared by embodied RL agents in distributed training. The attack exploits cross-time correlation between successive gradients and a closed-form recovery of actions from policy-head gradient structure, reaching 18.8 dB PSNR with near-perfect action recovery in 3-4.5ms per frame, outperforming prior single-frame and optimization-based gradient-inversion baselines across recurrent, residual, and transformer architectures. The authors argue defending against it requires sequence-aware privacy mechanisms rather than single-step gradient protections.

arxiv.orgpaperAdded 26 Sep 2026, published 24 Sep 2026🛡️ Security