🏗️ AI Infrastructure146

Project Suncatcher is a Google research effort to power AI compute in space. Its prototype satellite launched on 1 October 2026 and, after commissioning, returned the first AI response from a data-center-class TPU in orbit: a haiku from the onboard Gemma 4 open model, downlinked over Svalbard. Next come thermal-stress and radiation tests, then twin interconnected satellites in 2027.

blog.googlearticlePublished and added 30 Oct 2026

An AIBOM is a machine-readable inventory of models, datasets, dependencies, AI services, agents and MCP servers, with evidence of origin, license, integrity and evaluation. The Endor Labs explainer walks through a worked CycloneDX example for a fine-tuned support assistant. It compares CycloneDX ML-BOM, SPDX 3.x, the OWASP AIBOM project and the May 2026 CISA/G7 guidance, and lists what an AIBOM cannot show: runtime behavior and agent actions.

endorlabs.comarticlePublished and added 29 Oct 2026

no-agent-summary.js is a roughly 70-line Bun preload by Flamerix AI that stops Claude Code from re-sending each background agent's full transcript to its model every ~30 seconds for a status-line summary. The write-up cites OpenTelemetry measurements of 18 to 26 percent of spend (since version 2.1.232), explains the setTimeout hook, and gives install and verify steps. It was tested on Linux with Claude Code 2.1.257 to 2.1.312.

gist.github.comwriteupAdded 30 Oct 2026, published 29 Oct 2026

clauth is a Rust terminal UI for Claude Code that combines multi-account switching with a live 5h / 7d usage monitor. A fallback chain moves the user off an exhausted account before Claude Code blocks. It supports Pro, Max, Team and Enterprise OAuth accounts and custom API endpoints on Linux, macOS and Windows. The post notes that auto-switching means the tool decides when accounts change.

x.comtoolAdded 30 Oct 2026, published 28 Oct 2026

Latent Space podcast episode with Supabase founders Paul Copplestone and Ant Wilson on why frontier models pick Supabase first for app backends. It covers the alpha Docker-free local runtime, declarative schemas kept in Git, Supabase Compute for containers beside the database, and scale work (OrioleDB, Multigres, Turso). The founders say Supabase launches about five million databases a month and that AI-driven signups converted better.

latent.spacetalkPublished and added 28 Oct 2026

GitHub reported 7.4 billion commits per month in September 2026, up from 2.9 billion in August and 1.4 billion in April, which it attributes mostly to agentic demand. It has added 4 million CPU cores, 160 PB of storage and 50 Tb/s of network capacity this year, mostly on Azure. It is also rearchitecting to separate compute and storage, with internal benchmarks showing up to 35x higher write throughput.

thenewstack.ioarticleAdded 30 Oct 2026, published 28 Oct 2026

Decrypt reports, citing The Information, that OpenAI plans to buy Google TPUs rather than rent them, to reduce dependence on Nvidia. Neither company has confirmed, and price, volume and timing are undisclosed. The article covers OpenAI's TPU optimization job listing, its Broadcom-built Jalapeño inference chip due end of 2026, Nvidia and AMD deals, and Anthropic's multi-gigawatt TPU agreement.

decrypt.coarticlePublished and added 28 Oct 2026

GitHub Universe 2026 recap in which GitHub presents its agentic software delivery vision and new Copilot products: the Copilot app, Copilot Fusion multi-model routing, Copilot projects, session continuity, automations that learn from outcomes, and code review Max. GitHub Enterprise customers can use all Copilot features without a separate subscription. GitHub also reports added capacity, a multi-region Azure migration and a redesigned Git architecture.

github.blogarticleAdded 29 Oct 2026, published 28 Oct 2026

Photon Capital's thread covers the 27 October 2026 NVIDIA and Oracle announcement of general availability of Vera Rubin NVL72 and Vera CPUs on OCI. It lists specs (Spectrum-6 at 102.4Tbps, HGX Rubin NVL8 with Xeon 6, 150,000 initial Vera CPUs) and OpenAI's use of Vera CPUs for agentic sandboxes. The commentary argues CPU capacity can cut cost per task and shorten KV cache residency in GPU memory.

x.comthreadAdded 28 Oct 2026, published 27 Oct 2026

Latent Space episode with Katelyn Lesse (engineering) and Angela Jiang (product) of Anthropic, recorded the day after the Claude Opus 5.5 launch. It covers distillation defences such as enforced preserved thinking blocks and a new API compaction feature, per-model data retention and verification programs, trust grants for access control, and the Managed Agents split between harness and sandbox. The text shown is truncated; later sections are known only from timestamps.

latent.spacetalkPublished and added 27 Oct 2026

Latent Space episode with Katelyn Lesse and Angela Jiang on the engineering behind the Claude Platform. Topics include the Claude Opus 5.5 launch and pricing, Claude Managed Agents that separate the model's brain from the harness and sandbox, rebuilding the Messages API in Rust, credential protection, safety classifiers, model routing and agent evaluation. The page lists show notes and timestamps only, with no transcript.

latent.spacetalkPublished and added 27 Oct 2026

PGX is a free, open-source Postgres runtime written in Rust that hosts thousands of isolated databases in one process, aimed at AI agents. A companion agent skill, installed with `npx skills add pgrundev/pgx --skill pgx`, gives each Claude Code agent its own database automatically. The author claims 1,000 databases in 659 MB RAM, about 0.7 MB per idle database, an 85 ms clone of a 674 MB database, and a 200-agent test with no conflicts.

x.comtoolAdded 28 Oct 2026, published 27 Oct 2026

Cloudflare's postmortem of a tenant isolation bug in the GLM-5.3 model on Workers AI, active 27 August to 9 September 2026. Prompts over 681,280 tokens exceeded the prefill KV pool, and an SGLang disaggregated-mode bug let decode read stale pages, so 155 responses contained other customers' data. It covers the timeline, config and engine fixes (SGLang v0.5.22), and recommendations for operators.

blog.cloudflare.comwriteupAdded 27 Oct 2026, published 26 Oct 2026

Bankless compares three onchain inference marketplaces: Orbio on Robinhood Chain, and Surplus Intelligence and Antseed on Base. Orbio tokenizes $1 of inference as CREDIT for agents, Surplus runs an order book that routes to the cheapest reseller (over 120M requests in 28 days, discounts near 90%), and Antseed is a peer-to-peer network with model-fingerprinting checks. The article also covers token links to usage and unproven sustainability.

bankless.comarticleAdded 30 Oct 2026, published 26 Oct 2026

Latent Space interview in which swyx talks with Supabase co-founders Paul Copplestone and Ant Wilson about backends for software built by AI agents. Topics include Supabase Compute for running workloads next to the database, Multigres for highly available Postgres (private alpha), the Turso acquisition, declarative schemas, and durable workflows. The page has only show notes and chapters, recorded ahead of Supabase Select 2026.

latent.spacetalkPublished and added 26 Oct 2026

Tom's Hardware reports that Jensen Huang put Nvidia's software licensing at about $2,000 per GPU per year for software that runs agents on AI factories, said at GTC Berlin on 22 October 2026. Nvidia AI Enterprise is listed at $4,500 per GPU per year, and Nvidia has not said which products or terms the new fee covers. The piece also covers the OpenShell Reference Architecture and Sentry agent monitoring on BlueField-4.

tomshardware.comarticleAdded 28 Oct 2026, published 26 Oct 2026

This X thread summarises OpenRouter usage charts. Weekly volume nears 200 trillion tokens, and open-weight models take 72.6% of tokens (136 trillion) against 27.4% for closed-weight models. Anthropic's daily average rose from about 0.6 to 2.25 trillion tokens alongside the Opus 5.5, Sonnet 5.5 and Haiku 5.5 releases. DeepSeek leads text requests at 26.5%, and agents plus coding account for 57.7% of spending. The author notes the data describes OpenRouter only.

x.comthreadAdded 26 Oct 2026, published 25 Oct 2026

PRAXO-CORE 2.5.0 is a Go agent kernel that owns model calls, tool authorization, context, checkpoints, events and human-in-the-loop decisions, and leaves graph execution, memory storage and tenant policy to RHEOVELA or the host product. The release adds pkg/conformance, with checks for VFS, memory, sandbox, event, policy, model and tool contracts. It also adds stricter Windows path rejection and a plugin trust/SBOM handoff, and it states which adapters are only offline-tested.

x.comarticleAdded 27 Oct 2026, published 25 Oct 2026

HiRoute is an open-source (Apache-2.0) local model router for developers using agent clients such as Codex and Claude Code. Routing plans judge each new message and send routine work to economical models, while harder design decisions and fixes stay on the primary model. It supports custom task branches, ordered failover candidates with explicit exhaustion, per-session cost and usage records, and runs as a macOS desktop app or a Linux CLI and daemon.

x.comtoolAdded 25 Oct 2026, published 24 Oct 2026

SemiAnalysis reviews AWS Trainium3 and the new TorchNeuron native PyTorch backend after a few weeks of hands-on use. It reports TorchTitan Qwen3-32B results on Trainium2 (11,099 tokens/s eager at 23.89% MFU, 14,156 compiled at 30.47%), a 27-minute gpt-oss compile time, 89 of 96 FlexAttention cases passing, matmul comparisons with GB300 and B200, and a positive view of the Neuron Explorer profiler.

newsletter.semianalysis.comarticleAdded 29 Oct 2026, published 23 Oct 2026

Securing our frontier model training environment is an OpenAI post on containing models during RL training and evaluation. After a September 20, 2026 DNS-resolver escape, OpenAI paused its most capable runs, moved to no live internet access (an "offline world"), and had GPT-6 Astra Cyber and an internal model red-team its sandboxes. The agents found VM escapes, network routes and cache-timing covert channels. Training resumed October 1.

openai.comarticlePublished and added 23 Oct 2026

The torch-neuronx model support Space is a Hugging Face and AWS Neuron lookup that shows whether a Transformers model runs unmodified on AWS Trainium2. Each result lists core count, wall time and peak memory, plus the run.py script and a public NEFF compile cache. Tests generate 32 tokens on up to 16 cores. Results are in the aws-neuron/torch-neuronx-model-support Parquet dataset.

huggingface.coarticlePublished and added 23 Oct 2026

Latent Space interview with Modal CEO Erik Bernhardsson, after Modal's $750M Series D at a $16B valuation and passing $1B annualized run rate. He explains why GPU demand is not "rectangular" like fixed-term capacity contracts, how Modal pools demand and buys from about 25 clouds on three-year deals, and why sandboxes grew to about a third of revenue. Also covers GPU price-collapse risk and non-NVIDIA accelerators. Only the first part of the transcript was available.

latent.spacetalkPublished and added 22 Oct 2026

Latent Space interview with Modal CEO Erik Bernhardsson after the company's $750M Series D at a $16B valuation, with a transcript. He explains why GPU demand does not match rectangular fixed-term capacity contracts and how Modal pools demand across customers. He covers sourcing from nearly 25 clouds on multi-year deals, the risk of falling GPU prices, sandboxes reaching about a third of revenue, and non-NVIDIA accelerators.

latent.spacetalkAdded 23 Oct 2026, published 22 Oct 2026

Decrypt explainer on neoclouds, specialist providers such as CoreWeave and Nebius that rent Nvidia GPU clusters for AI training and inference. It covers the chips, power and debt model, Bitcoin miners turned AI hosts, and customers including Microsoft, AWS, Google and Anthropic. It cites Gartner's 14 October 2026 forecast that over 80% of neoclouds will stop operating independently by 2030.

decrypt.coarticlePublished and added 22 Oct 2026

Muse AI's X post describes the compromise of LiteLLM 1.107.0, published to PyPI on 21 October at 7:39 AM and quarantined about 1 hour 43 minutes later. The payload was a .pth file that ran at Python startup and sent cloud credentials, private keys and AI dev-tool auth files to an attacker endpoint. The author lists five agent-builder defences: hash-locked pins, capped per-tool keys, a release cooling period, keeping secrets away from Python startup, and outbound traffic monitoring.

x.comarticleAdded 23 Oct 2026, published 22 Oct 2026

OpenAI CLI is OpenAI's official Go command-line client for the REST API. It lets users generate images, upload and download files, create and wait on batches, call the Responses API, and query admin usage endpoints from a terminal or shell script. It supports JSON, JSONL and YAML output, GJSON transforms, shell completion, and install via Homebrew, go install or release binaries.

github.comrepoAdded 23 Oct 2026, published 22 Oct 2026

The OpenShell Reference Architecture, announced by NVIDIA at GTC Berlin, splits agent work across hardware: Vera Rubin runs models, Vera CPUs run agents inside the open-source OpenShell runtime, and BlueField-4 DPUs run the Sentry monitor. OpenShell has a gateway, supervisor, sandbox and formal-verification policy prover. Sentry inspects agent-to-model traffic outside the host. Sentry availability is listed as early next year.

decrypt.coarticlePublished and added 21 Oct 2026

The Huawei-DeepSeek Symbiosis analyzes DeepSeek's 30 September 2026 Ascend support for TileLang, DeepGEMM, DeepEP, TileKernels, FlashMLA and DeepSelect. It microbenchmarks the Ascend 950PR (BF16 GEMM, HBM bandwidth, die topology, AICPU) against H100, and profiles DeepSeek-V4.1-Flash on 32 Ascend 950DT chips. It also lists vLLM-Ascend gaps on x86 hosts.

newsletter.semianalysis.comarticleAdded 29 Oct 2026, published 21 Oct 2026

Omnara is an open-source, self-hostable managed agent platform, an alternative to Claude Managed Agents and OpenAI's Agents API. It runs agents on any model (OpenAI, Anthropic, OpenRouter, Bedrock, LiteLLM, Ollama) and any machine, with Postgres-backed durable state, stateless workers, per-tool permissions, MCP, skills, memory, subagents, schedules and Slack, Discord and GitHub triggers. It ships a REST API, TypeScript SDK, CLI and Docker Compose setup.

github.comrepoAdded 23 Oct 2026, published 21 Oct 2026

Part 1 of a series on profiling TorchNeuron, the open source PyTorch backend for AWS Trainium. It shows how to configure torch.profiler with NeuronConfig, read the key_averages() table, and trace one op through Neuron Explorer. Three RMSNorm variants are compared: naive eager (2.355 ms device time), torch.rms_norm (403 μs) and torch.compile (375 μs).

huggingface.cowriteupPublished and added 21 Oct 2026

LayerFS is a serverless, versioned filesystem for AI coding agents. Every file or Bash tool call becomes a commit on a branch, agents on different machines share one Store without a database server, and same-file clashes are refused with Conflict. Forks copy no files, chunks are deduplicated and compressed, and ignored dependency files persist, so a mount takes about 0.05 s against about 5 minutes of reinstalling. The page gives vendor claims and no benchmarks or docs.

layerfs.aitoolAdded 22 Oct 2026, published 21 Oct 2026

OpenAI's ChatGPT ad stack uses a custom post-trained LLM, the orchestrator, that makes tool calls for retrieval, filtering, scoring and auction nomination across stateful ad sessions. Ad selection runs in a separate service from answer generation, so ads cannot influence responses or delay them. The post covers ANN retrieval, a model-generated preamble, delivery versus impression, logging, and model-based evaluation.

openai.comarticlePublished and added 21 Oct 2026

AINews issue for 19 to 20 October 2026 whose top story is DeepSeek's open-source DeepInfer, the inference engine behind V4.1 Flash. It covers prefill/decode separation, wide expert parallelism, a 3FS-backed prompt cache with 96% input hits, vLLM's decode result within 6% of DeepInfer on GB200, and disputed margin estimates built on the reported $38 per accelerator-hour. It also digests other news, and the page text is truncated.

latent.spacearticleAdded 23 Oct 2026, published 21 Oct 2026

This AINews issue (20 October 2026) leads with DeepSeek's open-sourced DeepInfer, the vLLM-based inference engine behind V4.1 Flash. It covers prefill/decode separation, a 3FS-backed prefix cache with 96% hit rate, SWA Bounded Replay, and DeepSeek's claims of 155T tokens/day and $38 revenue per accelerator-hour. It also covers vLLM's within-6% decode reproduction on GB200, disputed margin estimates, and a round-up of other AI news. Only the first 40,000 of 56,439 characters were available.

latent.spacearticlePublished and added 21 Oct 2026

Alter is a privileged access management layer for AI agents (YC S25). It stores credentials in a vault, injects them per request through a proxy, gives each agent its own identity and scoped grants, and logs every call to a tamper-evident audit trail. One SDK call covers storage, refresh, policy and audit for 140 API providers, with LangChain, MCP and AWS integrations. Policy is default-deny down to the parameter, with human approval for risky calls.

alterauth.comtoolAdded 22 Oct 2026, published 21 Oct 2026

TorchTPU is Google's open-source project for running PyTorch apps on its TPUs, announced the day after Amazon released TorchNeuron for its Trainium chips. Google says migration needs "a simple configuration change" with no rewrite. It worked with Meta, Hugging Face, and the vLLM and SGLang teams on compatibility, and added an agent suite that helps migrate apps and fix errors. The post is brief and gives no benchmarks.

x.comthreadAdded 21 Oct 2026, published 20 Oct 2026

Mastercard's Agent Pay for Machines lets AI agents buy digital services with signed payment vouchers inside a business-set task, permission and budget. On 20 October 2026 it opened Early Access with buyer and seller APIs, a toolkit, sandbox and docs. In the Hype demo at Cloudflare Connect, an agent made nine payments to two providers over the x402 protocol. The system is still at pilot stage.

en.cryptonomist.charticlePublished and added 20 Oct 2026

Headroom is an open-source GitHub project that compresses logs, files and tool outputs before they reach an AI coding agent. The tweet by RoundtableSpace claims up to 95% fewer tokens for JSON and about 20% fewer overall, with the same answers and lower API bills. The tweet gives no method or benchmarks, and the repo link is truncated.

x.comthreadAdded 21 Oct 2026, published 20 Oct 2026

Latent Space interview with Evan Conrad, CEO of SF Compute, recorded at AI Engineer NYC. He explains why the company runs a cloud's operations to physically settle GPU contracts on an order book with multi-constraint matching. Topics include preemption and storage recovery, hardware cohorts, batch versus live inference pricing, forward curves, a B300 price arbitrage, and cash versus physical settlement. The last ~3,600 characters of the transcript were not available.

latent.spacetalkAdded 23 Oct 2026, published 20 Oct 2026

Latent Space podcast episode with Evan Conrad, CEO of SF Compute, recorded at AI Engineer New York in 2026. He explains why the company moved from subleasing a cluster to running cloud-level operations so it can physically deliver traded GPU capacity. Topics include a constraint-matching order book, spot versus forward prices, batch versus live inference leases, and cash versus physical settlement. The transcript was truncated near the end.

latent.spaceotherPublished and added 20 Oct 2026

TorchTPU is a native PyTorch backend that makes Google TPUs a regular "tpu" device, replacing the older torch_xla path and Optimum TPU. The Hugging Face post shows Transformers (device_map="tpu"), Diffusers (pipe.to("tpu")) and Pallas kernels from the Kernels Hub running on it. It reports up to 21.5x faster decoding on Qwen3-30B-A3B at batch 64 and a 96.5% TPU test pass rate.

huggingface.coarticlePublished and added 20 Oct 2026

Cloudflare describes how it cut the average cost of its AI code reviewer from $2.43 to $0.77 per review (68%) and median time from 4m 9s to 1m 32s, between September and October 2026. About 40% of savings came from code changes, mainly sharing a cached prompt prefix across repositories and reviewers, and the rest from model and effort choices (Opus 5.5, Sonnet 5.5). Quality was checked through author action rates and blinded model judging.

blog.cloudflare.comwriteupAdded 29 Oct 2026, published 19 Oct 2026

Clairic is Cloudflare's preview System One extraction model, hosted on Workers AI as @cf/cloudflare/clairic, with open weights planned. It reads text or images in one forward pass and returns typed values with spans, confidence, p_null, 80% intervals for estimates and forecasts. A claim-handling cascade with Clef and GLM-5.3 ran in 19.3 seconds against 61.7 for an all-LLM version.

blog.cloudflare.comarticleAdded 29 Oct 2026, published 19 Oct 2026

SemiAnalysis argues that global AI datacenter capacity will grow by about 50GW in 2027, against Brad Gerstner's guess of roughly 25GW. Evidence cited: over 24GW in advanced construction across 40 campuses, nearly USD 1T of binding leases signed in 2026, and record self-build starts. It also covers modular "LEGO" designs, behind-the-meter power and ex-US growth. The page text cuts off before the oversupply section.

newsletter.semianalysis.comarticleAdded 29 Oct 2026, published 19 Oct 2026

llm-echo 0.5 is a debug plugin for Simon Willison's LLM CLI. It adds an "echo" model that calls no LLM and repeats the prompt back as JSON. The release updates simulated token usage counts to include tool calls, system prompts and reasoning tokens. An example run with `-o thinking 1 --usage` reports 2 input and 24 output tokens. Willison is testing PRs ahead of a new LLM release.

simonwillison.netarticleAdded 19 Oct 2026, published 18 Oct 2026

Antirion is an open-source AI gateway shipped as one Rust binary with a built-in admin console. It sits between apps and providers such as OpenAI, Anthropic, Bedrock, Vertex and vLLM, translating between OpenAI, Anthropic, Gemini and Bedrock dialects. It covers routing with fallbacks and circuit breakers, budgets, guardrails, caching, MCP and A2A gateways, SSO, and a benchmark against Bifrost 2.2.4 and LiteLLM 1.103.1.

github.comrepoAdded 21 Oct 2026, published 17 Oct 2026

Decrypt guide to "tokenmaxxing" reframed as maximizing value per token rather than burning tokens. It gives tiered tips: pick smaller models for simple jobs, write one clear prompt, start new chats, cap output length, and use free models (beginner); Claude Code commands like /model, /clear, /compact, /context, /mcp, /effort and plan mode (intermediate); and prompt caching via cache_control, 50% batch discounts, and agent budget limits like --max-budget-usd (advanced). Includes context on Meta, Amazon and Uber token leaderboards and spend, a worked invoice-processing example where routing cut cost from $30 to $3.90, and the Jevons paradox in falling token prices.

decrypt.coarticlePublished and added 17 Oct 2026

Tracekit 1.2.3 is a tamper-evident flight recorder for AI agents. It checks each tool call before it runs, signs calls and decisions into a hash chain, and writes one offline-verifiable .tkb file per run. It has adapters for 13 agents and frameworks, policy packs, one-time approvals and a "why" replay. The post reports 8 of 8 tamper attacks caught and under 1 ms added per call, and lists its limits.

x.comtoolAdded 19 Oct 2026, published 17 Oct 2026

News report on Vitalik Buterin's open-source "paranoid mode" privacy wrapper for his pi agent harness. It is a daemon compatible with the OpenAI API that sits between the agent and an external LLM provider. It gives each conversation its own Tor circuit with random cover traffic, rewrites prompts with a local model (qwen3.8-flash-next) before they leave the device, and runs the agent in a bubblewrap sandbox wrapped with torsocks. It pays through zkAPI, the Ethereum Foundation / Open Anonymity Project zero-knowledge scheme that separates payment authorization from the funder's identity. The article also covers the limits: high latency at conversation start, and a provider colluding with a Tor guard relay can defeat cover traffic, which motivates a proposed constant-cover-traffic mixnet.

en.cryptonomist.charticlePublished and added 16 Oct 2026

AI Usage Meter is a free, MIT-licensed desktop app for Mac and Windows that shows live Claude and Codex usage and rate limits, so users aren't cut off mid-task without warning. It also tracks API costs and other AI providers. It runs locally and needs no account.

x.comtoolAdded 16 Oct 2026, published 15 Oct 2026

magpie, by @yetone, is an open-source local gateway and desktop app that lets any coding agent use any model or provider. It translates between the OpenAI Chat, OpenAI Responses, Anthropic Messages and Gemini APIs. It also offers routing groups and automatic failover across keys and accounts, so a Claude Code rate limit doesn't force a config rewrite. It works with Codex, Gemini CLI, OpenCode, Goose, Cursor CLI and Copilot CLI, and backs up its config to a file, WebDAV or S3.

x.comtoolAdded 16 Oct 2026, published 15 Oct 2026

Latent Space's AINews issue for 10/13–10/14/2026. It opens with Modal's $750M Series D at a $15.75B valuation, with Sandboxes at a $300M run rate, then recaps the day's AI Twitter. Coverage includes the Gemini 4 Argon rollout and its weaker monitorability, Meta Muse Wonder, Grok Voice 3.0, and open-weights releases (Ultramarine 1 Flash, Ling-3.1-flash, DeepSeek V4.1 Flash). It also covers new evals (AA-Robotics, SpireClimb, TasteVal), rogue agent and reward-hack safety items, inference benchmarks (AA-AgentPerf, InferenceX), and agent sandbox platforms. Useful as a dated snapshot of the field.

latent.spacearticlePublished and added 15 Oct 2026

Hackers-Arise tutorial on NVIDIA's open-source NemoClaw, which runs OpenClaw (and Hermes or LangChain Deep Agents) inside OpenShell sandboxes. OpenShell provides kernel-level isolation and declarative YAML policies for files, credentials and network access. It covers OpenClaw's risks (543 tracked CVEs, 40,000+ exposed instances), an OpenClaw vs NemoClaw comparison, the caveat that sandbox escapes and core-logic zero-days remain possible, and a Docker/Node.js install via the nemoclaw.sh wizard with TUI testing. It also cites the Cisco AI Defense plus OpenShell case study, in which an agent that does security patching was protected against a simulated exfiltration attempt.

hackers-arise.comwriteupPublished and added 14 Oct 2026

Anthropic describes Scion, an in-house version control system that replaced git for its monorepo in five months as merged changes grew from about 2,500 to over 30,000 per day. Scion is server-centric, with always-online clients, changesets in a write-ahead log, derived data, and tiered content-addressed caches (scion-daemon, scion-cache, scion-server) backed by Spanner. It cut infrastructure 200x versus git mirrors and made checkouts about 100x faster. The post also covers lessons from building it with Claude Mythos Preview and Claude Tag: a seven-person team, engineers steering agents away from constraint violations, "superfan" monitoring agents, and merge queues giving way to post-merge testing.

anthropic.comarticlePublished and added 13 Oct 2026

Open-source Python CLI (`tra`) for autonomous trading desks in which LLM analysts (technical, macro, on-chain, sentiment) and validators only give opinions on figures the system computed. Fixed rules do the arithmetic: pricing the round-trip cost, applying risk limits, sizing, cost gates, and sending a single order with stop attached via ccxt (Bybit and OKX demo accounts tested). It supports multiple model providers with per-role models, effort settings and fallbacks. Every answer is parsed against a closed schema, every refusal is logged with the figure behind it, and models can tighten but never loosen controls. This makes it a concrete reference for keeping LLM agents away from arithmetic and money.

github.comrepoAdded 18 Oct 2026, published 13 Oct 2026

bitra (CLI name tra) is an MIT-licensed Python framework from Bijective Labs for autonomous trading agents. Language models only read system-computed figures and give opinions, while deterministic code prices the round trip, applies declared limits, sizes the trade and sends one order with stop attached. Every cycle's briefs, answers and refusals are stored on disk with hashes. It supports many model providers and ccxt venues, with sandbox, demo and mainnet tiers.

github.comrepoAdded 25 Oct 2026, published 13 Oct 2026

A tweet describing a free setup for running a ~27B open-source Qwen model on Google Colab's free T4 GPU, driven from VS Code. A Cloudflare tunnel with a proxy locks the endpoint behind an API key, and the endpoint is connected to 9router so Claude Code and Claude Cowork on the desktop can use it. It matters as a pointer to a zero-cost way to get Claude Code-style workflows on a self-hosted open model, though the steps are only in an accompanying video and the tweet gives no configuration or quantisation details.

x.comthreadPublished and added 12 Oct 2026

Latent Space report from an Anthropic workshop at AI Engineer New York 2026 on "dynamic workflows" (flows) in Claude Managed Agents. Instead of developers configuring a coordinator and a roster of subagents, the lead Claude agent writes an orchestration program that launches agents, collects results and manages information flow. The Q&A covers parallelism defaults and evals, session budgets, the Claude Console graph view, subagents sharing a filesystem, "dreaming" memory consolidation, and the higher cost of flows compared with a single agent.

latent.spacearticlePublished and added 12 Oct 2026

Reports Microsoft's Maia 300, its third-generation in-house AI accelerator, unveiled October 12, 2026 with production workloads from 2027. Microsoft claims 40% more tokens per megawatt than leading GPU systems and up to 7x Maia 200's rack-level token throughput in a 96-accelerator rack. It uses a chiplet design on TSMC N2P that separates compute, memory-controller and I/O. It is aimed at long-context reasoning and agentic inference, while Nvidia and AMD stay in place for training. Useful as a data point on the shift toward custom inference silicon and model-chip co-design.

en.cryptonomist.charticlePublished and added 12 Oct 2026

Arcjet JS SDK is an open-source (Apache-2.0) JavaScript monorepo that adds runtime security to AI apps, agents and HTTP endpoints. It ships request SDKs for Next.js, Node.js, Bun, Deno, Fastify and NestJS. It also has a Guard API for places with no HTTP request object, such as agent tool calls, MCP handlers, queue workers and background jobs. Built-in checks cover prompt-injection detection, sensitive-information detection (PII, credit cards, custom patterns) and token-bucket, fixed-window or sliding-window rate limits, including token budgets.

x.comrepoPublished and added 11 Oct 2026

Agent Standup is a free, open-source local server and UI that turns a Claude Code session into a live team-meeting view: the lead agent gives orders, and sub-agents join, share their screen and report back. It shows one status per agent (who is waiting or blocked), a context gauge and token counts, plus replay, recap, tree and video views, voices, custom characters and 8 languages. It runs as an editor extension (VS Code-family via VSIX, Cursor, Windsurf, VSCodium), in any terminal, as a desktop app, or as a Claude Code status line / tmux indicator, at zero token cost.

atoll92.github.iotoolPublished and added 11 Oct 2026

A tweet describing an independent open-source project, "Free Claude Code", that lets Claude Code run against non-Anthropic providers such as DeepSeek and Kimi. It supports switching models, configuring fallback providers and using providers' free tiers, launched via `fcc-claude` from the terminal or an IDE. It states the limits: free usage follows provider quotas, some providers still need API keys, it does not unlock Anthropic's own models, and it is not affiliated with Anthropic. The page also shows a quoted article on a 5-layer setup for running coding agents in YOLO/auto-approve mode safely.

x.comthreadPublished and added 10 Oct 2026

KedgeFlow specifies language-independent contracts so trusted controllers can authorize state-changing operations by enterprise AI agents and privileged gateways can enforce that authority independently of agent reasoning. It combines evidence-backed policy checks, signed permission for an exact action, a single-use shared allowance, target-side conditions and retained outcome records, with two conditional properties (at most one claim per allowance; every dispatch linked to a grant and claim) that hold even if the agent is compromised. A reference implementation exposes the path via MCP; evaluation on a three-member etcd cluster gave exactly one successful claim for each of 82 allowances across 6,560 concurrent attempts, and one committed effect in a 32-call gateway race. The authors report limits: permissive policy still authorized an undesirable effect, and distributed reservations, production access routes, crash recovery and real-target exactly-once effects remain untested.

arxiv.orgpaperAdded 15 Oct 2026, published 10 Oct 2026

Uber's engineering team describes how it extended its Zero Trust stack to give AI agents verifiable identities. Each agent workload gets a SPIRE SVID, and a Security Token Service checks an Agent Registry and mints single-hop, short-lived JWTs. Those tokens carry the full actor chain (for example user → Oncall Agent → Investigation Agent), loosely modelled on OAuth 2.0 Token Exchange (RFC 8693). The tokens are enforced at an MCP Gateway for tool calls, and an AI Gateway fronts model calls with guardrails. The post also covers an A2A client in the SDK that makes the secure path the default, observability of actor chains, and a 2026 roadmap toward dynamic access control and unified policy enforcement. It is a concrete production reference for agent attribution and delegated authorization.

uber.comwriteupAdded 10 Oct 2026

Prime Intellect describes rewriting its open-source Prime Agent coding-agent harness from TypeScript to Rust. Prime Agent orchestrated 2,000+ agents across 10,000+ Prime Sandboxes, using GLM-5.3 inference, to do the rewrite. A root orchestrator split the work into topologically ordered tasks, and each task passed through planner, implementer, reviewer and verifier agents, with TUI, harness, protocol and feature parity checks as the objective verification. A follow-up three-day hillclimbing loop on a benchmark harness merged 69+ changes, and the post reports ~14x faster time-to-input and over 80% less memory after startup. The post also covers the new architecture: nine crates, per-session worker processes, platform abstraction for Windows support, and a runtime-fetched model/MCP catalog. Vendor-run comparisons with other harnesses carry the post's own caveat about the lack of a common benchmark standard.

primeintellect.aiarticleAdded 10 Oct 2026, published 9 Oct 2026

A tweet explaining how to cut Claude Code costs by routing all subagents to Claude Haiku 5.5. It sets the model in settings.json (the `haiku` alias points at Haiku 5.5 from Claude Code v2.1.293), keeps the main session on the larger model, and lets individual agents override the model in their frontmatter. It links to the subagent model docs.

x.comthreadPublished and added 9 Oct 2026

Ai2's AI Infrastructure team describes replacing a priority-based scheduler on thousands of H100/B200/B300 GPUs with GPU time budgets, hierarchical fair-share over a 7-day lookback window, and a "scheduling contract" where workloads declare a minimum runtime (capped at 8 hours) to enable time-slicing. Results over 30 days: 98% of owed GPU hours delivered, occupancy steady at 98%, debug-workload p90 queue wait down from about 2 hours to 30 seconds, and 74% fewer repairs needing a human. It also covers a simulator used to predict outcomes before rollout, plus problems that remain: interactive sessions hurt by preemption and possible capacity fragmentation.

huggingface.cowriteupPublished and added 9 Oct 2026

Asana's StackAI browser agent became 76x cheaper and 5x faster in tests, after GPT-6 Astra in Codex ran a 144-run study across four models. The fixes were caching the growing browsing history, a larger history budget (480,000 characters) and removing screenshots in batches of 20. Average estimated cost fell to $0.47 per run on GPT-6.1 Sol, and all 18 runs answered correctly.

openai.comarticlePublished and added 9 Oct 2026

ttok is a command-line tool by Simon Willison for counting and truncating text by LLM token count, piping files or stdin through a tokenizer. Version 1.0 switches the default tokenizer from GPT-4 to the one used by the GPT-5/GPT-6 family, based on an experiment by William Liu showing all seven GPT-5.5/5.6/6 variants produce identical token counts across 31 test fixtures, even though OpenAI has not officially confirmed this.

simonwillison.nettoolPublished and added 9 Oct 2026

ttok is Simon Willison's CLI tool for counting tokens in text using OpenAI's open-source tiktoken library. This 0.4 release fixes a Click deprecation warning, updates CI, and adds a --list-models command to enumerate supported tokenizer models; it can be run instantly via uvx without installation, e.g. piping a file's contents into it to get a token count.

simonwillison.nettoolAdded 9 Oct 2026, published 8 Oct 2026

Decrypt reports on Google Cloud's newly announced Gemini Agent, a long-running AI agent that operates across Gmail, Docs, Sheets, Slides, Drive, Chat, Calendar, Microsoft 365 and Slack, and can run for hours or days on a single goal. The feature allows managers to spin up coworker agents with their own Workspace email address, calendar, Drive storage and directory listing, each given a cryptographically attested identity and a separate audit trail; agents connect to Salesforce, ServiceNow, Jira, Snowflake, BigQuery and any Model Context Protocol server, and are orchestrated across both Gemini and Anthropic's Claude models depending on cost and quality fit. Google pairs the launch with safety infrastructure, an Agent Sandbox, an AI network firewall called Agent Gateway, and real-time token-spend caps, citing a prior Claude Cowork VM-escape finding by Accomplish AI as the kind of containment failure it is designed to prevent.

decrypt.coarticlePublished and added 8 Oct 2026

MXC is Microsoft's cross-platform sandboxed code execution system for running untrusted workloads — model output, plugins, and tool calls — behind a unified containment model with Rust, .NET, and Node SDKs. It offers multiple containment backends (ProcessContainer, Windows Sandbox, LXC, Bubblewrap, Seatbelt, MicroVM/Nanvix, Hyperlight, WSLC) with JSON-based filesystem, network, and UI policies, plus diagnostics like audit mode for building policies from observed access.

github.comrepoAdded 8 Oct 2026

LegalOn Technologies cut estimated daily Codex costs by about 65% against a GPT-5.5 Fast baseline without slowing development. It matched GPT-6 Luna to clearly specified implementation, GPT-6.1 Sol to standard design and analysis, and GPT-6 Astra to architecture. It also turned off Fast mode by default and set budget caps by department and person, asking mature businesses for about 20% savings. The page is a vendor-published case study.

openai.comarticlePublished and added 8 Oct 2026

OpenSRE is an open-source framework for building AI SRE agents that resolve production incidents by correlating logs, metrics, traces, deploys and runbooks across 60+ connected tools (observability, cloud infra, incident management, MCP). Beyond the agent runtime (CLI, Python API, Slack/PagerDuty/Telegram integrations), the project's stated mission is to build an RL training and evaluation environment — explicitly modeled on SWE-bench's role for coding agents — to scale realistic infrastructure-failure scenarios as a benchmark for AI SRE.

github.comrepoAdded 8 Oct 2026

Latent Space interviews Stacklok founders Craig McLuckie and Joe Beda (Kubernetes co-creators) about Mecatl, an open-source "cloud-native harness" for coding agents that separates the agent loop from local tool execution, session state and model provider so enterprises can run and govern agents centrally rather than on individual desktops. The piece also covers Stacklok's earlier pivot from supply-chain security to ToolHive, an open-source platform/Kubernetes operator for running and governing MCP servers, and a not-yet-open-sourced "AI Gateway" focused on access control, budgets and provider routing for regulated enterprises (banks, telcos, semiconductor firms). The framing draws an explicit analogy to how Kubernetes decoupled enterprises from cloud providers, arguing agent harnesses need the same "cattle not pets" treatment to scale beyond desktop tools like Claude Code, Codex and GitHub Copilot.

latent.spacearticlePublished and added 7 Oct 2026

The author revives "cablese," the terse telegraph-era writing style, as an LLM prompting technique: instructing a model to write dense, article-dropping summaries cuts output tokens 25–49% depending on model family, while downstream models (including ones never shown the instruction) answer comprehension questions from the compressed text at parity or better than from plaintext. The piece introduces the "Telegraph Test," an open benchmark (github.com/Travis42/telegraph-test) with ~1,300 questions over 50 passages and a fixed deterministic grader, used to measure compression ratio, cross-model legibility, and read-back/decode costs for GLM-5.3-Flash, Gemma, Qwen and gpt-5-mini; it also contrasts this human-readable, auditable register against emergent machine-only compression protocols described in other papers (BabelTele, GLOSSOGEN) and existing tools (Terse, Caveman).

fiveminutesforward.comwriteupPublished and added 7 Oct 2026

Kubernetes Agent Sandbox is a Kubernetes SIG Apps project that gives each AI agent session an isolated, stateful, single-Pod workspace for running untrusted code. The newsletter explains the Sandbox CRD, SandboxTemplate, SandboxWarmPool, SandboxClaim and Sandbox Router workflow, gVisor and Kata Containers isolation, and suspend/resume and scheduled deletion. It points to a hands-on guide with a Kubernetes troubleshooting agent.

newsletter.devopscube.comarticleAdded 21 Oct 2026, published 7 Oct 2026

Kubernetes Agent Sandbox on AWS EKS is a step-by-step tutorial for the kubernetes-sigs agent-sandbox controller with gVisor. It deploys an AI troubleshooting agent backend using SandboxTemplate, SandboxWarmpool and SandboxClaim, with Bedrock access through EKS Pod Identity. It also runs untrusted Python through the k8s-agent-sandbox SDK and sandbox router, and covers scheduled deletion and suspend/resume with persistent volumes.

devopscube.comwriteupAdded 21 Oct 2026, published 7 Oct 2026

Simon Willison describes using Parseable, a new open-source (AGPL) Rust-based observability platform shipped as a single ~180MB binary with enterprise and cloud-hosted tiers, to collect and view OpenTelemetry traces emitted by Datasette, which gained OpenTelemetry support in version 1.0a41 (added by Alex Garcia). He used Codex to work out the integration and links to a human-written TIL documenting the working setup, alongside a screenshot of a Datasette trace rendered in Parseable's web UI.

simonwillison.netarticlePublished and added 6 Oct 2026

AWS Security Blog walkthrough showing how to build identity-aware AI data agents on Amazon Bedrock AgentCore that propagate a real user's OIDC id_token through the agent's tool-calling chain (Runtime → MCP Gateway → Lambda) via HTTP headers, keeping the token out of the foundation model's context entirely. A Lambda function performs a server-side token exchange using IAM Identity Center Trusted Identity Propagation, assumes a scoped TIP role, and runs the user's Athena query so AWS Lake Formation evaluates the real user's grants, producing per-user row/column access and CloudTrail audit records naming the actual human (onBehalfOf) without rewriting existing governance policies.

aws.amazon.comwriteupAdded 8 Oct 2026, published 6 Oct 2026

Overmind is an open-source platform (MIT SDK/CLI, AGPL-3.0 platform, self-hostable) that instruments an agent's code via OpenTelemetry tracing, turns the resulting production traces (or any dataset) into a fine-tuned model benchmarked against user-defined eval metrics, and serves it through one unified API with downloadable/retrainable weights. It ships an SDK, CLI, REST API, Console, and an MCP server exposing project tools and workflows (investigate-capability, finetune-capability, ship-model) for Cursor, Claude Code, OpenCode and Codex, and can sync traces from Langfuse, LangSmith, Braintrust or Galileo; self-hosting runs via Docker Compose with Postgres, Redis, Celery workers and Modal-based GPU workers for fine-tuning/serving (vLLM).

github.comrepoAdded 6 Oct 2026

A quote from Anthropic's Felix Rieseberg explaining why Cowork (Anthropic's agentic coding/tool-use product) moved from running a local VM for tool-call execution to running both model inference and the VM sandbox entirely in the cloud. The change addresses local resource costs (disk, battery, performance) and lets sessions persist independent of the user's device, with the desktop app only handling device-local file access when needed.

simonwillison.netwriteupAdded 6 Oct 2026, published 5 Oct 2026

Simon Willison argues that pay-by-usage APIs and cloud services need default *hard* budget caps (not just warning emails) because coding agents and personal agents can autonomously spin up usage that costs hundreds or thousands of dollars overnight. He points to AWS's newly launched project spend limits (which pause a project once its monthly limit is hit) and Google Cloud's Spend Caps feature as early examples of this becoming a trend, and argues such caps should be opt-out rather than opt-in.

simonwillison.netarticlePublished and added 3 Oct 2026

Herschel is a continuous optimization system for production LLM inference that uses adaptive, on-demand profiling instead of always-on tracing to diagnose serving inefficiencies with low overhead (under 0.5% TTFT, 7% TPOT impact). It attaches to and detaches from running inference processes without engine restarts, reconstructs cross-process operator execution traces to pinpoint inefficiency mechanisms, and has AI agents implement and test candidate engine/kernel fixes under controlled replay of the triggering workload before expert review and deployment. Over six months of production use it collected ~17,000 traces across 120+ model variants and 10+ accelerator types, finding inefficiency patterns in 23% of traces and driving optimizations like restructured synchronization and removal of unused computation.

arxiv.orgpaperAdded 3 Oct 2026

The Ethereum Foundation and the Open Anonymity Project launched zkAPI on Ethereum mainnet: users deposit ETH or USDC into a vault contract, then generate a zero-knowledge proof of sufficient, unspent funds to obtain a capped, short-lived API key, letting them call AI models through OpenRouter without the provider linking their prompts to a billing identity. The protocol (based on a February 2026 Ethereum Research proposal by Davide Crapis and Vitalik Buterin) issues signed usage receipts after the key expires to settle actual spend, and ships with a browser chatbot (OA Chat) and an open GitHub repo; it is explicitly labeled experimental with no formal audit yet. The same proof-based metering pattern is proposed for other metered services like blockchain data queries, image/video generation, and machine-to-machine payments.

decrypt.coarticlePublished and added 2 Oct 2026

A vendor blog primer (Endor Labs) that walks through the main families of sandboxing technology - VMs (Firecracker), shared-kernel containers (namespaces, cgroups, seccomp, runc), userspace-kernel middle grounds (gVisor, Kata Containers), and language/runtime sandboxes (Java SecurityManager, V8 isolates, WebAssembly/WASI) - explaining what each actually isolates, its cost, and known escape CVEs (VENOM/CVE-2015-3456, runc's CVE-2019-5736, Spectre/Meltdown). It then pivots to AI coding agent sandboxing specifically, framing agents as "confused deputies" vulnerable to prompt injection via Simon Willison's "lethal trifecta" (private data access plus untrusted content plus external communication), and lays out the policy controls that matter in practice: filesystem scoping, egress allowlists, action classification, reviewable diffs, scoped short-lived credentials, and human-in-the-loop approval, plus the need to log accumulated session permissions for audit.

endorlabs.comarticlePublished and added 2 Oct 2026

Bifrost is an open-source, high-performance LLM gateway (by Maxim AI) that exposes a single OpenAI-compatible API across 23+ providers including OpenAI, Anthropic, AWS Bedrock, Google Vertex, Azure, Cohere, Mistral, and Ollama. It provides automatic failover, load balancing, semantic caching, Model Context Protocol (MCP) tool integration, budget and governance controls, OIDC user provisioning, and Prometheus-based observability, deployable via npx or Docker with claimed sub-15 microsecond overhead at 5,000 RPS. It is positioned as a drop-in replacement requiring only a base-URL change for existing OpenAI, Anthropic, or GenAI SDK code.

github.comrepoAdded 2 Oct 2026

pi pod is a self-hosted platform that runs the 'pi' coding agent harness inside isolated sandboxes, adding native clients, RBAC-based session sharing, and browser/native-app automation on top of the minimal pi agent loop. It targets individuals and organizations who want full ownership of their agentic coding environment without vendor lock-in, with a self-hosted edition available now and a hosted service planned.

pipod.devtoolAdded 3 Oct 2026, published 2 Oct 2026

The Ethereum Foundation and the Open Anonymity Project launched zkAPI, a system that lets users prepay into an on-chain USDC vault and then generate zero-knowledge proofs to unlock short-lived, spend-capped API keys for AI models (and other metered services) without tying usage back to a billing identity. It ships a local client that mimics the OpenAI and Ollama APIs so existing apps can switch to account-free access with minimal changes, plus an in-browser client called OA Chat; funds remain withdrawable on-chain even if zkAPI's own servers go down. The design, originally sketched by Davide Crapis and Vitalik Buterin on Ethereum Research, still leaves IP address and prompt content visible to providers, so the team recommends Tor for stronger privacy.

bankless.comarticlePublished and added 2 Oct 2026