Skip to content

Back to the catalog

[AINews] not much happened today
latent.spacearticle

[AINews] not much happened today

Daily AINews digest (Latent Space) covering an October 2026 news cycle: OpenAI's cheaper/faster GPT-6.1 Sol and Anthropic's Claude Sonnet 5.5 reshaping Agent Arena's cost-performance frontier, a wave of decision-model releases (Cloudflare Clef, llama.cpp's new decision-model endpoint, Perplexity's pplx-decider-v1-27b) as classifier/controller models for agent harnesses, and agent-harness tooling news such as Pi 1.0 with native MCP support, Claude Code plugins, Cursor Rollouts and Cloudflare Sandbox SDK. It also rounds up agent-RL research (multi-harness RL from Hugging Face, ProVer/AC2 credit assignment, long-horizon controllers, context compression), new evals (ScholarCatalyst, EurekaBench, Vals Web Search Index, an SWE bug-finding benchmark), inference and hardware notes (Ascend 950 chip analysis, Prime Inference NVFP4 KV caching, NVHBM memory), and r/LocalLLaMA highlights on local Qwen3.8-27B inference and MTP speculative decoding in llama.cpp.

TL;DR Latent Space's daily AI news roundup: GPT-6.1 Sol/Sonnet 5.5 leaderboard shakeup, a rush of new decision-model releases, agent-harness updates, and a grab-bag of fresh agent-RL, long-context and eval research.
Document

What it claims

A one-day digest (Oct 1–2, 2026) with figures behind its headlines. GPT-6.1 Sol is priced at $2/$10 per million input/output tokens, against $10/$50 for GPT-6 Astra. On Agent Arena it costs $0.56 median per task, 39% cheaper than GPT-6 Sol while scoring 1.52 points higher, and 81% cheaper than Astra while landing within 1.04 points. Sonnet 5.5 [Max] debuted at #3 and is #1 in Chat. At $2.74 per task it costs more than #2 Opus 5.5 at $1.58, so it is off the Pareto frontier. Anthropic holds the top three Agent Arena spots.

Evidence

Agent RL and control

  • Multi-harness RL (Hugging Face): the same weights score 62% in one harness and 33% in another.
  • A proxy speaks the OpenAI, Anthropic and Gemini API formats. It records sampled token IDs and logprobs for training without changing the harnesses.
  • LFM2.5-2.6B rose from 42% to 54% across four harnesses and made 31% fewer tool calls.
  • SFT on 3,189 Qwen3.8-27B rollouts plateaued at 47.5%.
  • The trainer, data and all seven trained models are open.
  • ProVer: a judge locates the decisive trajectory segment, and rollouts on either side set that segment's advantage. Relative gains over GRPO are +9.91% on Qwen3.5-2B and +7.12% on Qwen3.5-4B.
  • SFT vs RL: SFT generalizes worse because its data is off-policy, not because of the objective. Rewriting expert trajectories in the base model's style closes the gap.
  • Dedicated controller (Meta Superintelligence Labs): lifts GPT-5.5 on ProgramBench from 63.7% to 71.5% with the same workers and budget, versus 58.0% for Codex.
  • Context:
  • Microsoft's training-free FOCUS cuts peak context by up to 48% and raises task success by up to 8.9 points.
  • NVIDIA measures a 62.8% accuracy drop from 4K to 128K context across seven open models.
  • Multi-agent coordination: in AgentWorld, fewer than a third of multi-agent actions help, and coordination tasks reach only 12% success.

Evals

  • Vals Web Search Index: holds model and harness fixed and swaps only the search tool. Without search, agents score 2.9% on legal and 7.4% on finance tasks; with search, 30–50%.

Inference

  • Prime Intellect: stores the MLA latent in NVFP4, shrinking rows from 576 to 352 bytes and fitting about 50% more cached tokens than FP8.
  • It serves GLM-5.3 on vLLM and Dynamo, and the sparse-MLA kernel is going to FlashInfer.
  • Stas Bekman: measures NVFP4 about 9% more efficient than MXFP4 on B200, with higher accuracy. His mamf-finder tool now benchmarks FP8, MXFP8, MXFP4 and NVFP4.

How to use it

Decision models

  • llama.cpp added a /v1/systemone endpoint for local "Jev-style" decision-model inference. Launch example as posted:
llama serve -hf ggml-org/Kev-4B-GGUF
  • Cloudflare Clef is post-trained from Qwen3.8-27B. clef-flash is post-trained from Qwen3.5-9B. Both are on Ollama.
  • Perplexity claims pplx-decider-v1-27b averages 85.7% across 11 benchmarks.
  • One commenter describes the pattern as constrained JSON classification: allowed classes go in a schema, and the model picks one per item.

Agent tooling

  • Pi 1.0 adds:
  • native MCP in Codemode
  • deferred tool loading
  • Anthropic cache warming
  • mid-conversation system messages
  • experimental MIT-licensed Pi Durable, which runs on Cloudflare Durable Objects via agents SDK v0.26.0
  • DeepSeek Harness ships desktop builds for macOS and Windows. Linux users install @deepseek-ai/dsh from npm.
  • OpenAI's Agents API adds one-call browser computer use and claims 99.97% turn reliability and 20% faster tool calls.

Local Qwen3.8-27B on one RTX 4090 (24GB)

  • Setup:
  • Qwen3.8-27B-UD-IQ4_XS.gguf (14.25GB)
  • llama.cpp b11115 with llama-swap v257
  • ctx-size 196608
  • q8_0 K/V cache
  • speculative MTP draft
  • reasoning budget of 4096
  • Result: 115 tok/s decode at 22,934 MiB peak VRAM.

MTP speculative decoding

  • llama.cpp PR #29761 adds MTP via --spec-type draft-mtp. It is merged into the aman/qwen4-opt branch, not described as in main.
  • On DGX Spark, Qwen3.8-Flash-Next iq4_xs with --spec-draft-n-max 3 went from 28.36 to 43.88 tok/s (1.55×), with mean acceptance 0.640 across 24 tasks.
  • The IQ4_NL GGUF is about 102 GB.

Other releases

  • webAI TwIL-LM3-Pro: 3.66B parameters, Q4 GGUF of 2.09 GiB, non-commercial licence.
  • Reka RIDM: an inverse dynamics model released under Apache 2.0.

Limits

Sources

  • This is a digest of tweets and Reddit posts. Most numbers are self-reported by vendors or posters and were not checked by the newsletter.
  • The Fable 5.5 and "Astra 6.1" rumors are explicitly unverifiable.
  • WeirdML results are flagged as incomplete.

Local 27B vs frontier coding claim

  • It rests on a single DeepSWE task: 40/43 hidden tests, partial score 0.980, but a binary pass of 0.
  • The frontier subset on that task scored 85.3% pass. Commenters dispute broader parity.

MTP

  • One user reports MTP made inference slower on very large models because acceptance was low.
  • Another reports EXL3 via tabbyapi was much faster than llama.cpp GGUF for their workload.

Decision models

  • No benchmarks were reported for llama.cpp's decision-model support itself.
  • Clef's behavior below Q8 quantization is an open concern.
  • @mervenoyann calls the category a rebrand of zero-shot classifiers.

Opus 5.5 regression reports

  • Complaints of a post-launch regression are anecdotal. The cited sentiment drop (71–73 to 55 on modelsentiment.com) measures user opinion, not model behavior.

Eval integrity

  • David Rein questions whether Harbor, the framework behind Terminal Bench, lets agents modify trajectories before evaluation. He says he may be misreading the code.

Organisations named here

  • OpenAI
  • Anthropic
  • Google
  • Google DeepMind
  • Google Research
  • Meta
  • Meta Superintelligence Labs
  • Microsoft
  • NVIDIA
  • StepFun
  • Moonshot AI
  • xAI
  • Zhipu AI
  • Alibaba
  • Perplexity
  • Cloudflare
  • Hugging Face
  • Prime Intellect
  • Reka AI
  • webAI
  • IBM
  • Cerebras
  • Epoch AI
  • SemiAnalysis
  • ValsAI
  • DeepLearningAI
  • Trillium Labs
  • Halcyon Futures
  • Schmidt Sciences
  • Underdog
  • a16z
  • Khosla Ventures
  • Canada's National Council on AI
  • Virtue AI
  • Bloomberg
  • LessThanThreeAI
  • Earendil
  • DeepSeek
  • MiniMax
  • Xiaomi
  • Black Forest Labs
  • Ideogram
  • The Vatican
  • New York Times
  • The Batch
  • vLLM project
  • ggml-org
  • Micron
  • Vals
  • NeurIPS
  • Apple
  • Latent Space
  • Agent Arena
  • AgentWorld
  • Andrej Karpathy
  • Ascend 950
  • AutomationBench
  • DeepSWE
  • EurekaBench
  • Granite
  • Jev
  • Nathan Lambert
  • ScholarCatalyst
  • Terminal-Bench
  • Vatican
  • Yoshua Bengio

Technologies named here

  • GPT-6.1 Sol
  • Codex
  • GPT-6 Sol
  • llama.cpp
  • GPT-6 Astra
  • Harbor
  • DeepSeek Harness
  • Astra 6.1
  • GPT-6 Astra Lite
  • Claude Code
  • pi
  • gpt-5.5
  • Pi Durable
  • Opus 5.5
  • T3 Code
  • OpenAI Agents API
  • Opus 5
  • Cursor Rollouts
  • Sonnet 5.5
  • Claude Fable 5.5
  • Cloudflare Sandbox SDK
  • Ollama
  • Claude Mythos
  • Gemini 4 Argon
  • vLLM
  • Gemini 3.8 Flash
  • Dynamo
  • Gemini 2.5 Pro
  • FlashInfer
  • DeepGEMM, FlashMLA, TileKernels, DeepEP
  • MiMo-V2.6-Pro
  • mamf-finder
  • MiMo Flash
  • Grok 4.7
  • Cloudflare Agents SDK
  • Kimi K3
  • Muse Gadgets
  • Muse Home Link
  • Step 5 Preview
  • Kev 1.0 / Kev-4B
  • OpenAI Dots
  • pplx-decider-v1-27b
  • Grok Bot
  • Clef
  • backburner
  • Clef-flash
  • llama-swap
  • webAI TwIL-LM3-Pro
  • Granite 4.2
  • Qwen3-8B
  • Reka RIDM
  • LFM2.5-2.6B
  • Qwen3.8-27B
  • Qwen3.5-2B
  • Qwen3.5-4B
  • FLUX.2-dev
  • Ideogram 4
  • GLM-5.3
  • GLM 5.3 Flash
  • Qwen3.8-27B-Humanlike-Chat 2.0
  • Qwen3.8-Flash-Next
  • Gemma 4 31B
  • Griffin
  • MiniMax-H3
  • Model Context Protocol
  • Hugging Face
  • GGUF
  • LoRA
  • GRPO
  • Claude Sonnet 5.5
  • Claude Opus 5.5
  • Kev
  • SWE-bench

Techniques named here

  • Codemode
  • Multi-harness proxy training
  • ProVer credit assignment
  • AC2 partial rollouts
  • PTGS
  • Trajectory style-rewriting for SFT
  • Dedicated controller for long-horizon agents
  • FOCUS context compression
  • LoopCD
  • Decision models
  • On-policy distillation with dual teachers
  • NVFP4 MLA latent caching
  • MTP speculative decoding
  • Distributed cross-device inference