Skip to content

Back to the catalog

[AINews] not much happened today
latent.spacearticle

[AINews] not much happened today

Latent Space's AINews daily digest for 9/16-9/17/2026, synthesizing AI Twitter and Reddit discussion into themed sections: agent runtime productization (Anthropic's Claude Code Projects for parallel cloud threads, Google's Gemini managed-agent harness with Credentials/Files APIs), the rise of TypeSafe's Jev as a cheap discriminative classifier/routing primitive for agent harnesses (with pushback from Theo on using it for context compaction), OpenAI's Astra for Law vertical launch, DeepMind's Stellar Colosseum multi-agent math/TCS harness and NVIDIA's Agora git-commit-memory agent system, Anthropic's internal AI-R&D automation metrics (Claude-led R&D tasks rising from 1% to 26% in six months), and a Claude Opus-assisted exploit chain that compromised OpenAI-connected accounts. It also covers Reddit local-LLM threads on Qwen 3.8 27B finetunes/quantizations, the ternary Bonsai 2 27B release, and a Mozilla report narrowing the China-US open-model capability gap to 4.4 months.

TL;DR Latent Space's AINews roundup covering Claude Code Projects, the Jev classifier-primitive debate, OpenAI's Astra for Law, DeepMind's Stellar Colosseum, Anthropic's AI-R&D transparency metrics, a Claude-assisted OpenAI exploit chain, and local Qwen/Bonsai model releases.
Document

What it claims

This is a one-day digest, so it has no single thesis. Its value over the catalog summary is the specific figures, mechanisms and practitioner reports attached to each item. Most of them are second-hand, drawn from tweets and Reddit threads rather than primary sources.

How it works

Gemini managed agents.

  • The Credentials API keeps secrets out of model context. The model sees placeholders, and outbound requests pass through a proxy that only allows trusted domains.
  • The Files API moves artifacts and provides persistent sandboxes.
  • The release claims up to 30% lower cost and 22% higher cache hits. The page gives no baseline for either figure.

Claude Code Projects. Threads currently run only in the cloud; local workflows are "coming". A single controlling Claude aggregates status across threads and keeps long-lived memory.

Jev usage pattern. Builders use Jev for LLM-as-judge, harness routing, subagent creation, typed extraction and reranking, not for free-form generation. It is available through Cloudflare AI Gateway. An open reproduction, openjev-s, uses Qwen3.6-35B-A3B with the SGLang radix cache.

Theo's critique of Jev-driven compaction is the most actionable design argument on the page:

  • Compaction is not just filtering.
  • Dropping hidden reasoning payloads can degrade frontier models.
  • Editing history invalidates cached prefixes, so compacting can cost more than leaving the history alone.

Research harnesses.

  • Stellar Colosseum (DeepMind) is model-agnostic. It separates strategy, decomposition, subproblem solving and verification into distinct roles.
  • Agora (NVIDIA-associated) uses Git commits as shared memory across 13 workers for 12 days. It made reproducible progress on model initialization without gradient updates.

Evidence

  • Stellar Colosseum: Codeforces rating 4263 and 71.0% on TCS-Bench. The page states no baselines.
  • Astra for Law:
  • Ships with 26 partner plugins and 47 community plugins.
  • Vals reports it beats generic GPT-6 Astra plus web search on Vals' legal benchmark at every price point. These are OpenAI-reported runs.
  • Exploit chain:
  • Three researchers used Claude Opus 5 to chain an image-upload bug into a ChatGPT/Codex account takeover, then into OpenAI-connected services.
  • They proved access with a PR to OpenAI's internal monorepo, reportedly in under 72 hours and for "under a few thousand dollars" in tokens.
  • The surfaces involved were SSO, forums, email and connected productivity tools.
  • Multi-agent contagion paper: after handoff injection, unsafe trajectories propagated and caused harm in 40–95% of runs.
  • Goodfire: activation probes trained with Prime Intellect detect reward hacking about as well as LLM-as-judge, at lower cost.
  • Anthropic internal metrics: about 30,000 internal agents, and over 90% of model R&D involves Claude.
  • Anthropic bio models: Claude optimized inference for 30+ open-source biology models, averaging 4× speedup. The code is open-sourced.
  • Epoch Benchmark Reviews: 15 audits, each labelled Verified, Flawed or insufficiently documented.

How to use it

Ternary Bonsai 2 27B (PrismML)

  • Derived from Qwen3.8-27B and keeps its hybrid-attention architecture.
  • 5.9 GB, which the page calls 9× smaller than FP16, and claimed to retain 98.2% of aggregate benchmark performance.
  • Licensed Apache 2.0. Runs in-browser on WebGPU through an HF Space.

Needle 3 (Cactus Compute)

  • A sliceable automation model of 8–29 MB, spanning 25–121M parameters.
  • Aimed at tool selection and typed extraction on edge devices.

Swift Qwen 3.8 27B (UkisAI)

  • Claims 58.3% fewer tokens and 1.95× speed with no accuracy loss, achieved by penalizing overthinking.
  • GGUF builds are available from UkisAI and bartowski.
  • An NVFP4→GGUF conversion for llama.cpp is at HuggingJoost/Swift-Qwen3.8-27B-NVFP4-GGUF.
  • An NInfer V3 conversion (CaptainArni/Swift-Qwen3.8-27B-NInfer) reportedly fits the full 262k context with vision on one RTX 5090. It uses an nvfp4 KV cache and reaches about 190 tok/s decode at an 80% power limit.

30-day local Qwen3.8-27B report

  • Setup: Unsloth Qwen3.8-27B-UD-Q4_K_XL on an RTX 5070 Ti plus RTX 4070 Super, Ryzen 5700X3D, 32 GB RAM.
  • Throughput: 845.1 tok/s prompt processing, 73.8 tok/s generation, and 0.481 MTP acceptance.
  • The author reports this flag is about 20% faster than MTP+ngram on their hardware. The full llama.cpp config is on Pastebin. `` --spec-type draft-dflash,ngram-mod ``

Limits

Failure modes reported for Qwen3.8-27B at Q4:

  • Reasoning bloat filling up to about 50% of context, with bursts of 60k reasoning tokens.
  • Tool-call loops and poisoning beyond 100k context.
  • Fragile KV caching that forces full prompt reprocessing.

The reported mitigations are enforced subagents, per-subagent reasoning levels, and loop detection that deletes bad tool calls. Commenters note these depend on the harness used. One FP8 user reports few loops up to about 262k context, and argues FP8/Q8 is materially more stable than Q4.

Unverified or disputed claims:

  • Commenters doubt Bonsai 2's 98.2% retention, and one calls earlier Bonsai releases "useless".
  • The Mozilla 4.4-month gap figure is disputed over model rankings and survey design. A prior Mozilla report was criticized as apparently AI-generated.
  • Anthropic's R&D figures come from secondary discussion.
  • Altman's math-capability rankings come with no benchmark.

Treat every number on this page as a pointer to the primary source, not as verified evidence.

Organisations named here

  • Anthropic
  • Google
  • Google DeepMind
  • OpenAI
  • TypeSafe
  • Cloudflare
  • LangChain
  • NVIDIA
  • Epoch
  • Vals
  • Goodfire
  • Prime Intellect
  • Meta
  • Perplexity
  • Base44
  • Google Labs
  • UkisAI
  • PrismML
  • Cactus Compute
  • Mozilla
  • Hugging Face
  • Wall Street Journal
  • Unsloth
  • Epoch AI
  • Latent Space
  • WSJ
  • METR
  • Agora
  • Claude Code
  • Jev

Technologies named here

  • Jev
  • Claude Code Projects
  • openjev-s
  • Gemini managed agents
  • GPT-6 Astra
  • Credentials API
  • Files API
  • Astra for Law
  • Perplexity's Computer
  • Codex
  • GPT-Live-1
  • Base44's Superagent
  • Claude Opus 5
  • Google Labs' family-oriented CC agent
  • Bonsai 2 27B / Ternary Bonsai 2
  • Meta's Muse
  • Cloudflare AI Gateway
  • Needle 3
  • LangChain
  • Swift Qwen 3.8 27B
  • Stellar Colosseum
  • Swift-Qwen3.8-27B-NInfer V3
  • Swift-Qwen3.8-27B-NVFP4-GGUF
  • Agora
  • Great AI Firewall
  • Qwen3.8-27B
  • Goodfire's activation probes
  • GLM 5.3 Flash
  • K3
  • llama.cpp
  • Unsloth
  • Terra
  • gpt-5.5
  • COLMAP
  • GPT-5.6
  • GLOMAP
  • Gemma 4 12B
  • Postshot
  • Krea 2
  • Brush
  • Lichtfeld
  • Vibe Code Bench
  • Benchmark Reviews
  • Astra for Law plugins
  • Codex voice via GPT-Live-1
  • Appshots on Windows
  • Claude Code
  • Qwen3
  • GGUF
  • LoRA
  • vLLM
  • SGLang
  • Git
  • Gemini Enterprise Agent Platform
  • Antigravity
  • Opus 5

Techniques named here

  • History compaction
  • KV caching / cached prefixes
  • Discriminative control flow
  • Ternary quantization
  • Activation probes for reward hacking detection
  • Recursive Self-Improvement via evolving worlds
  • Git commits as shared agent memory
  • Video-to-3D Gaussian Splatting pipeline