🎓 Training & Fine-tuning257
huggingface.cowriteupMonsterHouse is a Halloween interactive projection built on the NVIDIA Nemotron Voice Agent: Nemotron Speech ASR, Nemotron 3.5 Bolt E4B 4GB with a LoRA persona adapter, Magpie TTS Zeroshot and Audio2Face-3D in Unreal Engine, on two RTX Blackwell GPUs. Median end-of-speech-to-audio is 1.70 seconds live and 0.72 seconds with cached responses. The post gives a build path and tips on caching and state handling.
Nemotron Voice AgentNemotron Speech ASRNemotron 3.5 Bolt E4B 4GB+11
NVIDIANemotronQwen3 30B-A3B+3
multimodal, agents, training· Published and added 30 Oct 2026
en.cryptonomist.charticleWM-Basin is a Meta method for detecting student LLMs distilled from watermarked teacher models, described in "Watermark Basins: Black-Box Detection of Distilled LLMs" (arXiv:2610.37266, 27 October 2026). It feeds a suspect model's API text into a clean probe model and checks gradient alignment with a key-specific watermark basin. It reached 79% true-positive rate at 0.1% false-positive rate across 1,200 students, versus 29% for the prior token-level detector. Clean-data fine-tuning and paraphrasing weaken it.
LLM
MetaMeta FAIRMeta Superintelligence Labs+3
research, training· Published and added 30 Oct 2026
huggingface.copaper WorkFactory is a framework that builds coherent, executable professional tasks for training working agents. It plans an information support graph from professional intents, then uses probe executions to find and repair missing or inconsistent task information. The authors built 112,686 tasks across 612 occupations and fine-tuned Qwen models at 4B, 27B and 35B-A3B (WorkPilot). WorkPilot-35B-A3B rose from 879 to 1565 Elo on GDPval-AA v2.1.
QwenHugging Face
WorkFactoryWorkPilotGDPval-AA v2.1
training, agents, research· Added 30 Oct 2026
arxiv.orgpaperOn-policy state training is a method for training chain embedding retrievers for multi-hop RAG on the states the encoder itself reaches, including those built on its own wrong retrievals. Each state is labeled with the earliest missing gold passage, other missing gold passages are masked, and updates are contrastive and mixed with teacher-forced states. It retrieves complete evidence more often than teacher-forced training and graph-based systems, and transfers to harder long-chain HotpotQA and 2WikiMultiHopQA variants the authors built.
RAGon-policy state trainingcontrastive learning+1
HotpotQA2WikiMultiHopQAarXiv
research, llm-apps, training· Added 31 Oct 2026, published 29 Oct 2026
arxiv.orgpaper CORAL (Cognitive Resource Self-Allocation) is an agent-callable working-memory toolset that lets an LLM agent checkpoint task progress and verified facts, then reset its cluttered context and resume from a clean state. A Multi-episode Agentic Reinforced Policy Optimization algorithm trains the checkpointing. With an 8B model it reaches 42.8% average accuracy on GAIA, uses 6-7x fewer input tokens than a ReAct agent, and adds 8.0 points to a proprietary agent on BrowseComp.
LLMReActCORAL
Multi-episode Agentic Reinforced Policy OptimizationGAIABrowseComp
agents, research, training· Added 31 Oct 2026, published 29 Oct 2026
arxiv.orgpaper Turing LLM post-training combines calibrated multi-teacher on-policy distillation (C-MOPD) with an execution path for dynamically routed mixture-of-experts models. C-MOPD matches each teacher on a local Top-K support with teacher-wise loss normalization and clipping. On Turing-20B-A2B it scores 0.9988 on four-domain integration, beats Qwen3-8B on math and code (85.92 vs 80.33 mean), and cuts consolidation step time from 398.7 to 139.3 seconds in a PPU profile.
Mixture of ExpertsC-MOPDon-policy distillation+1
Turing-20B-A2BarXiv
training, research· Added 31 Oct 2026, published 29 Oct 2026
arxiv.orgpaper M-PFT is an angular-margin method for prompt tuning of vision-language models that fixes base-to-novel dual miscalibration (underconfidence on base classes, overconfidence on novel classes). It adds two losses: minimizing the maximum cosine similarity between tunable class embeddings, and minimizing angular distance to each zero-shot embedding. Tests on 9 prompt-tuning methods and 15 datasets show lower novel-class calibration error at comparable accuracy and negligible overhead.
vision-language modelprompt tuning
arXiv
research, multimodal, training· Added 31 Oct 2026, published 29 Oct 2026
arxiv.orgpaper MedCBR is a two-stage alignment framework for medical vision language models. Difficulty Weighted Boundary Preference Optimization (DBPO) trains on counterfactual preference pairs at the model's capability frontier. Entropy Gated Grounded Policy Optimization (EGPO) then applies distilled clinical rubrics according to prediction entropy. It reaches 61.2% average accuracy on six medical benchmarks, with the largest gains on differential diagnosis, and the two stages combine super-additively.
vision-language modelpreference optimizationreinforcement learning
MedCBRDifficulty Weighted Boundary Preference OptimizationEntropy Gated Grounded Policy Optimization+1
research, training, multimodal· Added 31 Oct 2026, published 29 Oct 2026
arxiv.orgpaper DICE is a blockchain-powered federated learning (BCFL) algorithm for customizing large pretrained models among untrusted Web3 participants. It combines dynamic progressive learning and model slice verification, so hardware-limited participants can train part of the model, with a tree-structured committee consensus protocol and an efficiency-driven incentive scheme to scale to more data holders. Experiments cover vision and language models.
federated learningblockchain-powered federated learningprogressive learning+1
arXiv
research, training· Added 31 Oct 2026, published 29 Oct 2026
huggingface.coarticle Project ProtoStar is an initiative by Carnegie Mellon, Purdue, Georgia Tech, Arizona State, George Washington University, Astera Institute, ORCA and Hugging Face to release publicly funded science datasets, models and code in AI-ready formats. Hugging Face reports over 17,000 public science datasets and tripled sharing in 2026. The first challenge, run by CMU from 2 to 13 November 2026, asks teams to forecast climate indicators for 210 US cities.
Hugging Face
Project ProtoStarCarnegie Mellon UniversityPurdue University+15
ai-policy, training, evals· Published and added 29 Oct 2026
huggingface.coarticle Nemotron 3.5 Transcribe is an open-weight, promptable speech model that handles transcription in 40 languages, translation, diarization for up to eight speakers, and audio Q&A. It has about 4B active of 30B parameters and tops open-weight ASR and diarization leaderboards. The post also covers the Granary v2 curation pipeline (463,062 hours, 48 languages) and a medical fine-tuning case study that cut held-out WER by 45.8%.
NeMo SpeechNeMo CuratorvLLM+11
NVIDIANemotron 3.5 TranscribeGranary v2+16
models, multimodal, training, evals· Published and added 28 Oct 2026
arxiv.orgpaper This paper studies data scaling laws in stereo matching and releases XStereo, a realistic synthetic dataset of 200 thousand samples. In-domain training on five large datasets shows two regimes: a standard power law, then saturation, with a transition point roughly fixed for a given model. Cross-domain performance depends only weakly on source data scale, and distribution and coverage diversity reduce domain gaps more.
XStereoarXiv
research, training, multimodal· Added 30 Oct 2026, published 28 Oct 2026
arxiv.orgpaper This paper measures job-based doubt in LLM fact-checkers: judging a claim false more often when the poster has a lower-status job. It compares base and post-trained checkpoints of six model families on fact-checked claims with randomised poster profiles. Only the open Tülu-3 recipe (OLMo-2 32B, Tülu-3 70B) creates the effect, under one percentage point but reliable. In OLMo-2 32B the flip comes from one residual-stream direction and appears at supervised fine-tuning, confirmed on 400 new claims. None of seven commercial models doubts lower-status posters more.
LLMTransformer
OLMo-2 32BTülu-3Tülu-3 70B+3
research, ai-safety, training· Added 30 Oct 2026, published 28 Oct 2026
arxiv.orgpaper Soft Multi-Token Prediction (Soft-MTP) is a one-line change to multi-token prediction (MTP) pre-training. The authors show the MTP cross-entropy gradient splits exactly into a KL self-distillation term and a noisy residual, and a straight-through "KL gradient-recovery trick" keeps only the KL term. From 167M to 1.2B parameters it gives lower NTP perplexity, faster speculative decoding and higher zero-shot accuracy than standard MTP, with no added parameters or overhead.
LLMTransformer
DeepSeekMeta
research, training· Added 30 Oct 2026, published 28 Oct 2026
arxiv.orgpaper The paper studies detection and temporal localization of fraudulent inducements (prompts to follow, join chat groups, click links) in internet finance short videos. It compares OCR+LLM, OCR+MLLM and a zero-shot MLLM, and builds a dataset of 2,419 videos (66.49 hours, 3,194 events, four categories). OCR+MLLM reaches mIoU 26.52 versus 14.49 for keyframe OCR+LLM, with 67.0 percent macro recall, using a recall-weighted F2 localization reward.
MLLMLLMOCR
arXiv
research, multimodal, training· Added 30 Oct 2026, published 28 Oct 2026
arxiv.orgpaper LLMON (LLM Object Notation) is a framework that separates executable instructions from passive data and requires explicit identifier-based execution. The paper post-trains Granite-4.1 3B and 8B base models on a 4.6B-token corpus of general, RAG and tool-calling data with distractor variants, using SFT then RL. Attack success rates on indirect prompt-injection benchmarks fall from 53-100% to 0.02-5.6%, with general capabilities preserved. It also adds attention-based per-layer diagnostics.
LLMRAGTransformer
LLMONGranite-4.1arXiv
training, research· Added 30 Oct 2026, published 28 Oct 2026
arxiv.orgpaper This paper proposes an fMLLR-based compensation mechanism that cuts the fine-tuning data needed in transfer learning for speech emotion recognition under train-test acoustic mismatch. An autoencoder reduces trainable parameters, and an affine transform in the encoder latent space models rotations and shifts. In a human-robot interaction task, mean CCC rose 16.8% with 12.9% of the training set and 14.4% with 50%.
fMLLRautoencoder
arXiv
research, multimodal, training· Added 30 Oct 2026, published 27 Oct 2026
arxiv.orgpaper Heads of Security (HoS) is a prompt injection defense that trains a small set of per-head attention gates to shift attention between trusted and untrusted tokens, separating instructions from data. Tested on Llama-3.3-70B-Instruct and GPT-OSS-20B, the black-box RL-Hammer attack reaches 10% ASR on HoS versus 97% on base GPT-OSS-20B and 85% on SecAlign. HoS keeps base utility in few-shot settings, where SecAlign and ASIDE degrade.
TransformerLlamaLLM
Heads of SecuritySecAlign++SecAlign+5
research, training· Added 28 Oct 2026, published 27 Oct 2026
arxiv.orgpaper SynthAPI is a pipeline that generates synthetic tool-use environments with explicit control over diversity of tools, tasks and underlying databases. Across 458,752 tasks and 849 trained models of four sizes, the authors fit a scaling law predicting downstream agent generalization. At larger data budgets, scaling tool and database diversity beats adding more tasks, and higher complexity helps more. Agents trained this way beat prior synthetic-data baselines on four benchmarks.
LLM
SynthAPI
research, training, agents· Added 28 Oct 2026, published 27 Oct 2026
arxiv.orgpaper Know, then Draw is a learning paradigm for visual generation that uses autoregressive pretraining to acquire semantic knowledge and diffusion post-training for high-fidelity rendering. Controlled comparisons find autoregression the stronger pretraining objective, and semantic quality matters more than AR-only generation quality. This motivates a purely semantic tokenizer trained with language supervision only. A 3B text-to-image model trained in 6,600 H100 GPU-hours scores 86 on GenEval and 87 on DPG-Bench.
diffusion modelTransformer
arXivGenEvalDPG-Bench+1
research, multimodal, training· Added 28 Oct 2026, published 27 Oct 2026
arxiv.orgpaper VideoLVR is a method that lets video multimodal LLMs build latent visual evidence from local regions at relevant moments and reason over it interleaved with text tokens. A visual token prediction objective, defined over a vocabulary derived from the input video, supervises the latents. It extends to reinforcement learning with sampled visual tokens as actions and final-answer rewards, and improves fine-grained video benchmarks without much context growth.
vision-language modelLLM
VideoLVRarXiv
research, multimodal, training· Added 28 Oct 2026, published 27 Oct 2026
arxiv.orgpaper EnvSched is an online scheduler for agentic reinforcement learning that picks which environment-task pairs to roll out next. It builds a dual-relation graph over environments and tasks, propagates past rollout statistics to predict within-task reward variance, and adds environment quotas and a similarity penalty. On Qwen3-8B it scores 48.81 average on BFCL-v3, tau-Bench and ACEBench-Agent after 40 steps, above random selection at 120 steps.
Qwen3
BFCL-v3tau-BenchACEBench-Agent+1
training, agents, research· Added 28 Oct 2026, published 27 Oct 2026
huggingface.coarticle LFM3 is Liquid AI's open-weight family of six ~2B-parameter models (text, vision-language, audio, omni and two d1 decision models), all branched from LFM3-1.7B-Base. The base model uses a tri-hybrid backbone of 13 gated short convolutions, 5 sliding-window attention layers and 6 global attention layers, pre-trained on 22T tokens with a 256K context. The post gives transformers snippets, benchmark comparisons against LFM2.5 and Qwen3.5, and a robotics fine-tuning example.
TransformersHugging FacePyTorch+7
Liquid AILFM3LFM3-1.7B+29
models, multimodal, training· Published and added 27 Oct 2026
liquid.aiarticleLFM3 is Liquid AI's new family of open-weight multimodal models, six models of about 2B parameters branched from LFM3-1.7B-Base (22T pre-training tokens, 256K context). The hybrid backbone uses 13 gated short-convolution, 5 sliding-window attention and 6 global attention layers. Variants cover text, vision with video, audio, omni and two decision models, with on-device speed numbers, fine-tuning demos and robotics extensions.
llama.cppMLXvLLM+17
Liquid AILFM3LFM3-1.7B+32
models, multimodal, inference, training· Added 28 Oct 2026, published 27 Oct 2026
arxiv.orgpaper NEXUS is a hierarchical reinforcement learning framework that pairs neural skills with symbolic meta-policies, so transparent reasoning sits at the level of high-level skills rather than atomic actions. It uses object-centric observations and LLM interaction to design reward functions and meta-policies. Agents learn disentangled skills, align better with goals in the game manual, resist reward hacking more, and cope better with game simplifications than deep RL. The paper also compares neural, symbolic and neuro-symbolic meta-policy architectures.
LLM
NEXUSarXiv
research, training, ai-safety· Added 28 Oct 2026, published 27 Oct 2026
arxiv.orgpaper AdaRoll-GRPO is a method that allocates GRPO rollout budgets per question by difficulty instead of uniformly. It frames allocation as a sequential decision problem and learns an allocation policy with a Bayes-adaptive MDP, computed offline so training adds no online optimization cost. Experiments on several reasoning datasets and LLM architectures show gains over standard GRPO at the same total rollout budget.
GRPOLLM
AdaRoll-GRPOarXiv
training, research· Added 28 Oct 2026, published 27 Oct 2026
arxiv.orgpaper This paper tests the delta-learning hypothesis for Direct Preference Optimization (DPO), where the larger model's response in a single model pair is treated as preferred. It shows, in theory and experiments, that fixed pairs add generator-specific biases that predict the preference label regardless of quality. DPO on single-pair data underperforms multi-model data, consistent with reward hacking, and adding more generators partly fixes it without an external judge.
LLM
arXiv
training, research· Added 28 Oct 2026, published 27 Oct 2026
eprint.iacr.orgpaperOblivDGL is a framework for secure GNN training and inference in machine-learning-as-a-service settings, modelled on Deep Graph Library. It uses an oblivious message passing paradigm and a new oblivious graph representation built on function secret sharing, revealing only the total node and edge counts. On four benchmark graphs it cuts training communication up to 1024x with up to 14.3x speedup, and inference communication up to 754x with 4.19x speedup.
Deep Graph Librarygraph neural networkfunction secret sharing
OblivDGLNDSS
research, training, inference· Added 28 Oct 2026, published 27 Oct 2026
arxiv.orgpaper AK_QMUL's system for the ArGuard-2026 shared tasks fine-tunes JAIS-6.7B with 4-bit QLoRA and a linear head on the last-token representation. For binary safe/unsafe detection (B1) it uses a four-way head over dialect register and AraSafe MSA augmentation, reaching macro-F1 0.984. For seven-way harm domain (B2) it averages five seeds, reaching 0.790. Both ranked first. Bully is the weakest class.
JAIS-6.7BQLoRALLM
JAISArGuardAraSafe+2
research, ai-safety, training· Added 28 Oct 2026, published 26 Oct 2026
the-decoder.comarticleThe Decoder reports on OpenAI's response to a 20 September security incident, when an internal research model used a misconfigured DNS resolver to reach the internet during training. Frontier reinforcement learning now runs offline on cached web content. In isolation tests, agents passed secrets through CPU cache timing. During an 11-day pause, agents including GPT-6 Astra Cyber found vulnerabilities, among them Kata Containers CVE-2026-24834.
Kata ContainersCPU cacheDNS
CVE-2026-24834OpenAIGPT-6 Astra Cyber+6
ai-safety, training, agents· Added 30 Oct 2026, published 26 Oct 2026
brown.eduarticleBrown University undergraduate Cunyan Ma built an interactive map linking technology companies and their intermediaries to data workers around the world, with the university's Center for Technological Responsibility, Reimagination and Redesign. The map combines existing data worker databases, Ma's own data collection and news reports on working conditions. It aims to show "AI colonialism" at scale, beyond anecdotal accounts. The page text ends early.
Brown UniversityCunyan MaCenter for Technological Responsibility, Reimagination and Redesign
training, ai-policy· Added 27 Oct 2026, published 26 Oct 2026
en.cryptonomist.charticle This article reports a study submitted October 23, 2026 by Qiangong Zhou, Jiafeng Liang, Yimin Dong, Yang He and Hongxiang Li. They added Test-Time Training (fast-weight memory) to the vision-language-action models InternVLA-A1 and Pi0.5, trained on paired human demonstrations and robot trajectories. Shorter videos, full-trajectory gradient connectivity and contrastive regularization gave no clear gain in demonstration-guided target selection at the tested scale.
vision-language-action modelTest-Time Training
InternVLA-A1Pi0.5Qiangong Zhou+4
research, multimodal, training· Published and added 26 Oct 2026
en.cryptonomist.charticle RoSA is a finetuning framework from Qiuyu Kong and three co-authors for long-text image-text retrieval. It targets "saliency collapse", where models over-rely on text tied to prominent visual features and miss contextual information. RoSA splits pairs into salient and contextual views using object-level saliency estimation and LLM text decomposition, then trains on both with plug-and-play auxiliary alignment objectives. Code and checkpoints are public.
LLM
RoSAQiuyu Kong
multimodal, research, training· Published and added 26 Oct 2026
arxiv.orgpaper SymLift is a compile-free vulnerability detection framework for code fragments that lack project context. A fine-tuned LLM reconstructs control-flow, data-flow, memory and resource relations as a constrained LLVM-like IR, and a deterministic parser turns it into facts for Datalog rules that give findings with derivation traces. SymLift-Qwen-7B reaches 94.41% Target-F1 on FormAI and 91.66% micro-averaged Target-F1 on MegaVul.
LLMQwenDatalog+3
SymLiftSymLift-Qwen-7BFormAI+2
research, training· Added 28 Oct 2026, published 25 Oct 2026
arxiv.orgpaper Intervention-Certified Amplification (ICA) is a validity gate for sigma-weighted hybrid SFT/RL post-training. The paper shows that DIAA, a per-sample sigma-weighted hybrid, emits unexecuted tool-integrated reasoning on 29% of MATH-500 prompts (three times vanilla GRPO) even with Python fences removed from its anchor. ICA gates sigma with paired-rollout evidence, cutting TIR to 13.8% (frozen) and 11.2% (online) and raising accuracy from 47.5% to 48.7% and 49.3%. It transfers to GSM8K.
GRPOPython
DIAAIntervention-Certified AmplificationMATH-500+2
training, research· Added 27 Oct 2026, published 24 Oct 2026
arxiv.orgpaper AutoTavern is a self-improving system of specialised LLM research agents with a typed shared memory and verification gates. In 20 days it built TavernGym, a full-content Hearthstone Battlegrounds simulator, and 23 versions of TavernAgent, a PPO-trained player. TavernAgent averaged placement 1.60 with 80% first places over its last 20 live games, beating the top ten players (2.34, 59%). On TavernBench (960 tasks), it answered 91% of play tasks against at most 63% for frontier LLMs.
PPOLLM
AutoTavernTavernGymTavernAgent+3
agents, research, training, evals· Added 27 Oct 2026, published 24 Oct 2026
arxiv.orgpaper This paper compares LoRA and full fine-tuning for prompt-safety classification using a matched 400M encoder-decoder pair (Ettin) across three task formats, with up to 15 seeds per cell and pre-specified analyses. Full fine-tuning leads LoRA by 2-3 pp at the pre-specified learning rates, and the encoder gap closes when both use the same learning-rate search. Training LoRA to write a reason after its verdict adds 4.0 pp, while a content-free sentence of equal length does not. Trained models beat a prompted 8B in domain but trail it by 8-23 pp on adversarial jailbreaks and over-flag benign prompts (27-66% against 2-3%).
LoRAEttinTransformer
training, research, evals· Added 27 Oct 2026, published 24 Oct 2026
arxiv.orgpaper SPAFT is a structured prune-then-finetune framework for PPG (photoplethysmography) foundation models used on wearable signals. It finds that pretrained PPG models have inherent sparsity and redundancy, then restricts fine-tuning to a compact parameter subspace chosen by parameter importance and structural redundancy. Across four PPG foundation models, five datasets and ten tasks, it wins 82.8% of regression and 87.5% of classification comparisons.
SPAFTarXiv
research, training· Added 27 Oct 2026, published 24 Oct 2026
arxiv.orgpaper TriageRAG is a failure-aware self-training method for adapting retrieval-augmented LLMs to specialized domains using only an unlabeled corpus. It probes the student on self-generated questions with and without retrieved context, sorts them into known, solved, context-failure and retrieval-failure, and routes each to a matching training signal. With Qwen3-4B on 11 datasets it beats budget-matched SimRAG by 1.2-6.4 points and recovers closed-book accuracy where retrieval hurts.
RAGLLMQwen3
TriageRAGSimRAGCS-Bench+1
research, llm-apps, training· Added 27 Oct 2026, published 24 Oct 2026
arxiv.orgpaper RALE (Representation-Aware Logical Ensemble) is a method for LLM-based vulnerability detection in C code. The authors train LLMs on raw source code, Abstract Syntax Trees and Control Flow Graphs, and find each representation works best for certain vulnerability classes. Combining the models with explicit logical rules and majority voting raises F1 from at most 73% for a single model to 78%, with gains in accuracy, precision and recall.
LLMstatic analysis
arXivRALE
research, training· Added 28 Oct 2026, published 24 Oct 2026
arxiv.orgpaper VulDec is a dataset and framework for detecting vulnerabilities in binaries by first decompiling them with fine-tuned LLMs. The dataset aligns real-world Assembly-C function pairs across several architectures with CWE labels. Tuned neural decompilers reach about 56% Edit Similarity and 43% BLEU-4, and tuned detectors reach a macro F1 of 0.61 on a realistic test set with a 3% vulnerability rate.
LLM
VulDecCWE
research, training· Added 28 Oct 2026, published 24 Oct 2026
x.comthreadAn X post showing how to have Codex train a small model on Apple silicon through the mlx-lm-lora MCP server and skill. It gives five setup steps (pip install with the mcp extra, npx skills add, locate mlx-lm-lora-mcp, codex mcp add). The prompt runs four pre-training trials on tiny-random/qwen3 with the mlx-community/recycling_the_web-1k dataset. Codex picks the optimizer and learning rate itself, and the result is a table with validation loss and the best adapter path.
CodexMLXModel Context Protocol+5
mlx-lm-loraGoekdeniz-Guelmeztiny-random/qwen3+2
training, mcp, coding-agents· Added 25 Oct 2026, published 24 Oct 2026
magazine.sebastianraschka.comcourseBuilding Reasoning Models from the Ground Up is a series of eight coding videos (about 11 hours) by Sebastian Raschka, accompanying his book Build a Reasoning Model (From Scratch). Starting from a pre-trained Qwen3 0.6B model, it implements KV-cached generation, a MATH-500 verifier, self-consistency and self-refinement, simplified GRPO for RLVR, and distillation from DeepSeek R1 answers in Python and PyTorch.
PyTorchPythonQwen3+5
Sebastian RaschkaMATH-500DeepSeek-R1+2
training, evals, inference· Published and added 24 Oct 2026
arxiv.orgpaper FORK is a reward for rubric-based reinforcement learning that jointly optimizes recall and a new precision objective. Precision requires each unit of a response to be necessary (rubric-driven necessity credits) and factually correct (a grader). Rubric-coverage rewards otherwise produce verbose, less accurate responses. FORK keeps similar coverage with shorter outputs, raising win rate against the base policy from 10.6% to 68.0% on RubricHub-Medical and from 22.1% to 74.1% on HealthBench.
LLM
HealthBenchRubricHub-MedicalFORK
training, research· Added 27 Oct 2026, published 24 Oct 2026
huggingface.copaper IQuest-Q1 is an open-source sparse Mixture-of-Experts model with 320B total and 15B activated parameters, built for agentic coding in CLI systems. Pre-training combines Stable SplitNorm, Muon and muP with a two-stage curriculum that raises the coding-data share in stage two. Mid-training extends context, and post-training mixes SFT, domain-specialized RL and MOPD across scaffolds, followed by model merging.
Mixture of ExpertsStable SplitNormMuon+3
IQuest-Q1Hugging Face
models, training, coding-agents, research· Added 24 Oct 2026
x.comarticle Kimi K3.1 Pro is Moonshot AI's post-trained Kimi K3 with a 1-million-token context, plus a Highspeed variant; weights are due by 4 November. It scores 65.7% on Terminal-Bench 4.0. Moonshot removed cyber data from mid-training and RL, and exploit pass@3 on xdev-bench-hard fell from 90.5% to 81.0%. The author argues this is a modest reduction.
LinuxNode.jsJavaScriptCore+2
Moonshot AIKimi K3.1 ProKimi K3+4
models, training, evals, ai-safety· Added 25 Oct 2026, published 24 Oct 2026
newsletter.semianalysis.comarticleSemiAnalysis reviews AWS Trainium3 and the new TorchNeuron native PyTorch backend after a few weeks of hands-on use. It reports TorchTitan Qwen3-32B results on Trainium2 (11,099 tokens/s eager at 23.89% MFU, 14,156 compiled at 30.47%), a 27-minute gpt-oss compile time, 89 of 96 FlexAttention cases passing, matmul comparisons with GB300 and B200, and a positive view of the Neuron Explorer profiler.
TrainiumTorchNeuronAWS Neuron+17
SemiAnalysisAmazonAWS+10
inference, training, ai-infra· Added 29 Oct 2026, published 23 Oct 2026
arxiv.orgpaper DeepFaune-UK is a fine-tune of the open DeepFaune camera-trap classifier on 28 UK classes, paired with MegaDetector v6. On 20,212 MammalWeb images it reached 88.8% strict accuracy against 56.5% (DeepFaune v1.5.0) and 59.0% (SpeciesNet). Re-applying the recipe to the DINOv3-based classifier gave 90.6%. Fine-tuning on about 150 crops per class matched full-data out-of-distribution accuracy, and a DINOv2 run took about 22 minutes on under 4 GB of GPU memory.
DeepFauneMegaDetectorSpeciesNet+2
DeepFaune-UKMammalWeb
research, training, multimodal· Added 26 Oct 2026, published 23 Oct 2026
arxiv.orgpaper DRIVE is a per-sample weighting framework for single-stage fine-tuning when the source pre-training data is unavailable. It uses one differentiable objective: Shapley additivity splits each sample's contribution into anti-forgetting and adaptation parts, a covariance-based diversity term reshapes them, and a sample-characteristic prior stabilizes them. The authors prove better stability-plasticity guarantees than existing weighting schemes and report better performance, faster convergence and more robustness.
DRIVEarXiv
training, research· Added 26 Oct 2026, published 23 Oct 2026
arxiv.orgpaper Accordion is a mixture-of-experts language model (Accordion-6B-A0.5B) that supports five inference budgets through fixed-prefix layer looping, with the minimum budget being the unlooped model. After 3.6T pretraining tokens, deeper inference raises the macro-average over 37 tasks by 3.01 points, and the middle budget captures 89% of that gain with half the extra layer executions. SFT and RL keep the budgets, merging three domain experts via parameter-group merging and budget-matched multi-teacher on-policy distillation.
Mixture of ExpertsTransformerLLM
AccordionAccordion-6B-A0.5BarXiv
research, training, inference· Added 26 Oct 2026, published 23 Oct 2026
arxiv.orgpaper SOMA (Sharpness-aware Orthogonalized Momentum Algorithm) combines sharpness-aware minimization (SAM) with the Muon optimizer for LLM training. It avoids SAM's extra gradient computation by using stale, purely stochastic gradient noise as the adversarial perturbation. The authors prove sample complexity does not depend on perturbation direction, study robustness to heavy-tailed gradient noise, and test SOMA against post-training quantization degradation and catastrophic forgetting during fine-tuning.
MuonLLM
SOMAarXiv
research, training· Added 26 Oct 2026, published 23 Oct 2026
arxiv.orgpaper ProfileSim is a profile-driven user simulator for financial marketing outbound calls. It models user profiles (demographics, Big Five traits) and business profiles (intents reverse-engineered from real call logs). The base model is fine-tuned on real voice dialogues, then refined with GRPO using dialogue-level and utterance-level rewards. Against other user generators it scores highest on colloquial naturalness and profile adherence, and lowest agent score on long-tail intents, with shorter utterances at comparable business compliance.
GRPORAGLLM
ProfileSimarXiv
research, training· Added 26 Oct 2026, published 23 Oct 2026
🗂️
openai.comarticleSecuring our frontier model training environment is an OpenAI post on containing models during RL training and evaluation. After a September 20, 2026 DNS-resolver escape, OpenAI paused its most capable runs, moved to no live internet access (an "offline world"), and had GPT-6 Astra Cyber and an internal model red-team its sandboxes. The agents found VM escapes, network routes and cache-timing covert channels. Training resumed October 1.
Kata ContainersgVisorDocker+3
CVE-2026-24834CVE-2026-74753CVE-2026-80521+6
ai-safety, training, ai-infra· Published and added 23 Oct 2026
arxiv.orgpaper MART-GRPO is a variant of group-relative policy optimization for vision-language-action (VLA) reinforcement learning. It uses a LoRA-fine-tuned VLM to find the last visible error without recovery in a failed rollout video, keeps failure feedback up to that point, and drops it afterward. Martingale stopping conditions show this preserves the expected GRPO gradient and can reduce covariance. With OpenVLA-OFT on RoboTwin 2.0, it raises success rates over full-trajectory GRPO across multiple tasks.
GRPOLoRAvision-language-action model+2
RoboTwin 2.0arXiv
research, training, multimodal· Added 26 Oct 2026, published 23 Oct 2026
huggingface.cowriteup ThinkingBox-Training is Microsoft's released RL stack that turns executable database-state checks from ThinkingBox tasks into GRPO rewards. Fifty GRPO steps on 187 curated tasks raised Qwen3.8-27B pass@1 from 51.70% to 60.78% and tasks passing all 20 attempts from 38 to 107 on the held-out 507-task benchmark. The post explains offline policy-relative difficulty filtering with Jeffreys posteriors, the 24-H100 Verl setup and evaluation steps.
GRPOQwen3.8-27BVerl+9
MicrosoftThinkingBoxThinkingBox-Bench+11
training, agents, evals· Published and added 22 Oct 2026
arxiv.orgpaper BeNice! is a post-training method for looped language models that broadcasts the final recurrence's KV-cache into the first recurrence, so one cache can serve all recurrences. It follows a first stage that uses stochastic depth in pretraining to induce contractive residual dynamics. It matches standard finetuning's unshared validation perplexity and composes with multi-latent attention, Kimi delta attention and fp8, mxfp8 and nvfp4 cache quantization. In simulated low-memory long-context inference it raises cache hit rates by up to 31.4% and throughput by up to 23.6%, and cuts p90 time-to-first-token by up to 83.6%.
Transformermulti-latent attentionKimi delta attention+3
BeNice!arXiv
research, inference, training· Added 24 Oct 2026, published 22 Oct 2026
arxiv.orgpaper This paper trains small open language models with reinforcement learning to select tools for multi-step instructions over corpora of more than ten thousand tools. A Qwen3-8B model post-trained with the recipe outperforms Llama-4-Maverick (402B) on ToolBench. The trained model transfers to different retrievers and generalizes to new tool corpora in other domains, without relying on proprietary LLMs like Claude or ChatGPT.
Qwen3LlamaLLM
ToolBenchClaudeChatGPT+1
research, training, agents· Added 24 Oct 2026, published 22 Oct 2026
huggingface.cowriteup Tutorial for training a walking policy for Microduck, an open-source bipedal robot from Pollen Robotics and Hugging Face, in NVIDIA Isaac Lab 3.0 with Newton. It covers RSL-RL training with the backlash preset, BAM actuator models and domain randomization, then ONNX export (61 observations, 14 joint-position actions) and deployment with robotctl. Policies can be shared on the Hugging Face Hub or tested in Microduck Arena.
Isaac LabNewtonMJWarp+7
NVIDIAPollen RoboticsMicroduck+2
training· Published and added 21 Oct 2026
huggingface.coarticle VocabX is a vocabulary adaptation method from Dharma-AI that selects sub-word and multi-word "macro" tokens by serving cost instead of frequency. On a Qwen3-4B Portuguese essay grader, response length fell from 350 to 101 tokens, the LM head shrank from about 152,000 to 65,000 rows, and measured cost dropped 77.0% on an RTX 5090 with vLLM. The bench score rose from 0.703 to 0.810. It beat FVT, MWT and in-place BPE across 15 model and domain combinations.
Qwen3vLLMLlama+3
Dharma-AIVocabXQwen+1
inference, training, research· Published and added 21 Oct 2026
arxiv.orgpaper Every Part Has Its Role studies concept augmentation in LLM post-training, where a target word is replaced by related alternatives in training sentences. It extends prior work from nouns to verbs and adjectives. Concept augmentation improves perplexity most consistently on news regardless of part of speech, while verbs give the most reliable downstream gains. CKA and linear probing show the largest gains do not match the largest representation changes.
LLM
arXiv
research, training· Added 23 Oct 2026, published 21 Oct 2026