Skip to content

33 results for โ€œTypeSafeโ€

What you seeeverything
blog.alexewerlof.comarticle๐Ÿง  AI

The rise and fall of Jev hype

The essay uses the launch of Jev, TypeSafe AI's "System One" general-purpose classifier trained with RLCD, to dissect AI marketing patterns: name dropping, jargon, ambiguity, inflated claims and drama. The author argues Jev's hype peaked and collapsed within about 33 days, while open-weight rivals beat it on cost and performance. It also lists incremental advances since ChatGPT and four unsolved problems: abstract reasoning, continuous learning, embodiment and the economics of running AI.

JevLLMModel Context Protocol+4
TypeSafe AITypeSafeOpenAI+14

ai-policy, modelsยท Added 24 Oct 2026, published 23 Oct 2026

github.comrepo๐Ÿง  AI

Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console

PS5LM is a homebrew app for jailbroken PS5s (firmware 7.00โ€“13.60). It runs llama.cpp with the ggml-vulkan backend on the console's RDNA 2 GPU, using 11.4 GB of shared memory, and loads any GGUF model. It serves OpenAI /v1/chat/completions, Anthropic /v1/messages (usable from Claude Code, Codex and opencode) and a browser chat page on port 8081. It also supports image-projector vision models and TypeSafe-style decision models through a /v1/systemone endpoint. A planner picks the longest context and best cache that fit the free memory, and the app downloads models from Hugging Face.

llama.cppGGUFVulkan+9
TypeSafeClefGemma 4+2

inference, modelsยท Added 17 Oct 2026, published 16 Oct 2026

securitylabs.datadoghq.comwriteup๐Ÿ›ก๏ธ Security

Jev as a judge: How counterfeit policy steers Jev

Datadog Security Labs tests TypeSafe AI's Jev decision model as a prompt-injection detector and as the judge behind LangChain's tool-risk gating. On four public datasets Jev had 99.66% precision and 82.90% recall. A prepended "counterfeit policy" that redefines the attack categories cut recall by over 79 points. In a LangChain scenario, a user-editable profile field lowered the mean is_risky score from 0.893 to 0.290, below the 0.5 block threshold. Plain prompt injection did not move the score.

JevLangChain
TypeSafe AIcounterfeit policyprompt injection+3

AI Securityยท Added 29 Oct 2026, published 15 Oct 2026

x.comthread๐Ÿง  AI

Jetwani Avinash (@jetwaniavinash) on X

Announcement of jevmem, an open-source MIT plugin that gives Claude Code, Cursor and Codex persistent project memory. After each turn it asks Jev (a TypeSafe AI model) whether anything is worth keeping (a rule, decision, failure, or to-do) and writes one line to a plain Markdown file tracked in git. It also checks commands against saved rules before they run and asks first, or blocks. Reported results: Claude followed the rule in 66 of 72 sessions vs 28 without it, the right save/skip call on 98.5% of 66 turns, and 66 of 68 rule-breaking commands caught out of 274 test commands. Listed in Anthropic's Claude plugin directory and on the MCP Registry.

Claude CodeCursorCodex+2
jevmemJevTypeSafe AI+1

coding-agents, agentsยท Published and added 10 Oct 2026

latent.spacearticle๐Ÿง  AI

[AINews] TypeSafe/Jev at >$100M ARR, $7.5B valuation 3 weeks after launch

AINews issue for 10/8โ€“10/9/2026 from Latent Space. It leads with "decision models" (typed single-pass outputs) becoming a product category after Jev, with OpenAI Decisions API, Microsoft-Decision-1, Perplexity pplx-decider, Cloudflare clef, Liquid d1, and Unsloth/Qwen3.5 training recipes. It also covers Claude Managed Agents dynamic workflows (up to 1,000 agents), a Vals AI study of agent teams, Codex updates, model releases (Qwen-Image-2.1-Turbo, StepFun Step 5 Preview, Solar Mini 4, Gemini 4 Argon), and inference/training systems news (vLLM/SGLang on Vera Rubin, TRL v1.15, DeepSeek stride weak spots).

vLLMSGLangTRL+17
Latent SpaceJevTypeSafe+35

models, agents, inferenceยท Published and added 10 Oct 2026

simonwillison.netwriteup๐Ÿง  AI

llm-openai-decisions 0.1a0

Simon Willison built llm-openai-decisions, a plugin for his `llm` CLI tool that wraps OpenAI's newly announced Decisions API (unveiled at DevDay), modeled on his existing llm-typesafe plugin for Jev's competing API. Both APIs support structured yes/no, multiple-choice, and score-style questions, but OpenAI's gpt-6-luna model also accepts image input (at 10 cents per million input tokens, versus Jev's 4.2 cents), and the plugin itself was built by having GPT-6 Astra read OpenAI's docs. The post includes install instructions and a worked example querying an image attachment for a yes/no answer.

OpenAI APIllm
Simon WillisonOpenAIJev+3

prompting, multimodalยท Added 7 Oct 2026, published 6 Oct 2026

github.comrepo๐Ÿง  AI

Microsoft Agent Framework python-1.20.0 release

Release notes for python-1.20.0 of Microsoft's Agent Framework, an open-source agent/workflow orchestration library. This release adds native vector-store connectors for DuckDB, SQL Server and MongoDB plus a TypeSafe AI connector, redesigns Foundry hosting around request-scoped agent factories and sandbox-isolated sessions, adds computer-use support to Responses clients, and ships Magentic manager and handoff-routing improvements for multi-agent orchestrations alongside a large batch of MCP, Bedrock, Gemini, Anthropic and Ollama provider fixes.

Model Context ProtocolPythonDocker+7
MicrosoftMicrosoft Agent FrameworkDuckDB+4

agentsยท Added 6 Oct 2026

github.comrepo๐Ÿง  AI

browser-use/jev-ultrafast

jev-ultrafast is an open-source browser automation agent (from Browser Use) that represents each page as an indexed element table and uses a 'TypeSafe' policy to speculatively predict both the next operation (CLICK, TYPE_TEXT, SELECT, SCROLL, WAIT, DONE, BLOCKED) and its target in a single network round trip, only invoking a small LLM (e.g. inception/mercury-2.5 via OpenRouter) to generate text when the operation is TYPE_TEXT. The repo includes a local inspector UI, Chrome automation via a 'Browser Harness' tool, offline tests, and published before/after benchmarks showing a Google Flights search dropping from a median 9.45s to 7.09s and browser protocol calls from 1,092 to 101 across repeated runs.

PythonOpenRouterGemini+2
Browser UseJevTypeSafe+2

agentsยท Added 6 Oct 2026

github.comrepo๐Ÿง  AI

Show HN: Made an open-source Lego AI generator

ldraw-nova is an open-source agentic pipeline where an LLM agent (tested with models like Claude Opus 5.5 and GPT-6 Astra) takes a build prompt, reads LDraw-building instructions, and produces a plan.json describing a model's geometry. From that plan it writes a Python generator script that, when executed, outputs an LDraw (.mpd) 3D CAD source file, viewable in 3D/VR (Meta Quest 3) or exportable to Blender-editable glTF. The agent uses jev-rerank, a semantic search tool with reranking backed by TypeSafe's Jev System One model, to find suitable LEGO parts and example models, falling back to full-text search without an API key; it also uses headless rendering and collision/gap detection to self-inspect and iterate on designs.

DockerPythonBlender+2
TypeSafeJev System Onejev-rerank+13

agents, multimodalยท Added 3 Oct 2026, published 2 Oct 2026

x.comthread๐Ÿง  AI

Amada Echeverrรญa (@amadaecheverria) on X

Jes is an open-source real-time guardrails library for AI agents built by LangChain Ambassador Eden Marco, designed to check every step of an agent's trajectory: prompts, tool calls, tool results, skills, and final responses. It runs as LangChain middleware and uses decision models like Jev from TypeSafe AI via a TypeSafeClassifier to make pass or fail calls at each checkpoint, with docs showing a concrete middleware integration example.

LangChainTypeSafeClassifier
JesEden MarcoTypeSafe AI+1

agents, ai-infraยท Added 3 Oct 2026, published 1 Oct 2026

x.comtool๐Ÿ›ก๏ธ Security

Amada Echeverrรญa (@amadaecheverria) on X

jes is an open-source real-time guardrails project for AI agents, built by LangChain Ambassador Eden Marco, that inspects every step of an agent's trajectory โ€” prompts, tool calls, tool results, skills, and responses. It runs on decision models like Jev from TypeSafeAI and ships with a LangChain middleware example for wiring the checks into an agent pipeline.

LangChainjesJev
Eden MarcoTypeSafeAI

AI Securityยท Added 3 Oct 2026, published 1 Oct 2026

developers.cloudflare.comarticle๐Ÿง  AI

Introducing Clef and Clef-flash: Cloudflare's open-source decision models

Cloudflare announces Clef and Clef-flash, its first in-house trained decision models, now hosted on Workers AI and open-sourced under Apache 2.0 on Hugging Face. Unlike text-generating LLMs, Clef takes a state plus up to 64 typed questions (yes/no, multiple-choice, or rubric score) and returns calibrated probabilities instead of free-form text, aiming for millisecond-latency structured decisions in agent pipelines. Cloudflare reports it beats TypeSafe's Jev on 7 of 10 decision benchmarks while running 2.5x (Clef) to 13x (Clef-flash) faster, and also launches an RL fine-tuning service for custom tuning.

Hugging FaceCloudflare
ClefClef-flashJev+2

models, training, inferenceยท Added 4 Oct 2026, published 1 Oct 2026

magazine.sebastianraschka.comarticle๐Ÿง  AI

Language Models for Text Classification: From Bag-of-Words to Jev

Sebastian Raschka surveys the history of text classification โ€” bag-of-words with naive Bayes/logistic regression, RNNs and CNNs with word embeddings, then transformer approaches (BERT/ModernBERT, GPT-style decoder fine-tuning, T5 encoder-decoder) โ€” before analyzing TypeSafe AI's new Jev model, a fast/cheap general-purpose classifier accessed via Choice/Noul/Score APIs. He benchmarks Jev against a fine-tuned ModernBERT on the IMDb sentiment dataset (Jev ~96.2-96.5% vs ModernBERT ~95%), explains how to retrofit a Jev-like classification head onto BERT/GPT models, and discusses probability calibration, including the RLCR (Reinforcement Learning with Calibration Rewards) technique from a 2025 paper that likely inspired Jev's proprietary "RLCD" training method.

TransformerBERTGPT+5
JevTypeSafeGPT-5.6 Luna+15

models, trainingยท Published and added 29 Sep 2026

latent.spacearticle๐Ÿง  AI

[AINews] Opus 5.5 is good at explainer videos

Daily AINews digest (Latent Space) covering the week's AI developments: Claude Opus 5.5's strong vision/coding results and viral code-generated explainer videos, the GPT-6 family (Astra/Sol/Luna) and Gemini 3.8 Flash releases, and Xiaomi's open MiMo-V2.6-Pro. It also covers the "System One" cheap-judge/reranker trend (TypeSafe's Jev vs. the open CLM alternative), agent infrastructure news from LangChain Interrupt and Perplexity's Rust-based Photon retrieval engine, inference speedups (Liquid AI's DSpark speculative decoder, GLM-5.3 on AMD MI355X), and research highlights including Harness-Zero agent-distillation, DeepMind's XYEval on sycophantic agent failure, a single-neuron safety-refusal bypass, and Sakana AI's RSI Lab with Jรผrgen Schmidhuber.

LangChainvLLMSGLang+11
Claude Opus 5.5GPT-6 AstraGPT-6 Sol+31

models, evals, researchยท Published and added 29 Sep 2026

github.comrepo๐Ÿง  AI

dzhng/jevgrep

Jevgrep (the `jg` CLI) lets a coding agent ask a natural-language question about a repository and get back relevant files, reading leads, and verbatim source excerpts in one response, using an LLM (Jev) to judge relevance across folders, files, and declarations instead of relying on grep/ripgrep alone. It ships an installable "skill" for Claude Code, Codex, OpenCode and other agents that teaches them when to call jg versus their normal tools, and requires a key for Vercel AI Gateway, TypeSafe, OpenRouter, or OpenCode Zen. A reported ten-task SWE-bench repeat found ~40% lower coding-agent cost ($7.62 to $4.52) but a lower solve rate (7/10 vs 8/10 baseline), explicitly framed as a cost/quality tradeoff rather than a win.

Node.jsTypeScriptBun+4
JevTypeSafeVercel AI Gateway+7

coding-agentsยท Added 27 Sep 2026, published 26 Sep 2026

latent.spacearticle๐Ÿง  AI

[AINews] The Future of Latent Space

The daily AINews digest from Latent Space rounds up a heavy week in AI: Claude Opus 5.5 topping SimpleBench and Terminal-Bench-Science, the GPT-6 family (Astra/Sol/Luna), Gemini 3.8 Flash, and Xiaomi's open-weight MiMo-V2.6-Pro; TypeSafe's Jev system-one decision model (and open alternatives like CLM) for cheap structured judgments; agent-infra launches from LangChain Interrupt and Perplexity's Rust retrieval engine Photon; inference speedups like Liquid AI's DSpark speculative decoder and GLM-5.3 on AMD MI355X; and research on harness distillation, agent failure modes, and autonomous-science efforts led by Sakana AI's RSI Lab with Jurgen Schmidhuber.

LangChainvLLMSGLang+11
Claude Opus 5.5GPT-6 AstraGPT-6 Sol+34

models, agents, researchยท Added 29 Sep 2026, published 25 Sep 2026

simonwillison.netarticle๐Ÿง  AI

llm 0.36

Changelog for version 0.36 of Simon Willison's `llm` command-line tool: adds support for new OpenAI models gpt-6-sol and gpt-6-luna, lets model plugins declare supports_conversation = False so single-turn-only models raise llm.ConversationNotSupported instead of silently accepting chat history (first used by the llm-typesafe plugin), and wraps reasoning traces in collapsible details/summary tags in the Markdown output of `llm logs`. These are small but practical improvements to a popular open-source CLI for scripting and logging LLM interactions across providers.

Python
Simon WillisonOpenAIGPT-6 Sol+2

llm-appsยท Added 29 Sep 2026, published 22 Sep 2026

simonwillison.nettool๐Ÿง  AI

llm-typesafe 0.1a0

llm-typesafe is a plugin for Simon Willison's LLM CLI that adds support for TypeSafe AI's Jev model, exposing three structured answer types: "noul" (probabilistic yes/no scoring), "choice" (classification into a set of labeled categories), and "score" (rubric-based scoring against ordered criteria). It lets users pipe text into the CLI with a system prompt and get back structured JSON judgments, useful for tasks like routing support messages or triaging bug reports by severity.

JevTypeSafeSimon Willison

prompting, llm-appsยท Added 29 Sep 2026, published 22 Sep 2026

github.comrepo๐Ÿง  AI

yibie/jev-engineering-zh

A Chinese translation (with original source notes) of a design essay synthesizing TypeSafe founder Diogo Almeida's notes on 'Jev,' a typed decision model that drives a coding-agent harness. It argues coding agents are simple loops whose real leverage lies in how context is assembled each turn, and works through six problems inherited from KV-cache-driven, append-only context design: costly model routing, tool-schema bloat, lossy compaction, rare sub-agents, destructive session restarts, and the built-in-capabilities tradeoff. It proposes fixes including query-aware context scoring/visibility tiers, cost-aware routing that accounts for cache reprocessing, tiered tool disclosure, conditional AGENTS.md loading, and shared read-only background retrieval.

Claude CodeCodex
TypeSafeJevDiogo Almeida+4

coding-agents, llm-appsยท Added 26 Sep 2026, published 22 Sep 2026

simonwillison.netarticle๐Ÿง  AI

Jev introduces a new shape of LLM - System One, aka Decision Models

Simon Willison reviews Jev, a new class of model from TypeSafe AI dubbed "System One models" (or "decision models"): instead of generating text, it takes a text/structured "state" plus one or more yes/no ("Noul"), multiple-choice, or scored-range questions and returns floating point probabilities/confidence scores, priced at $0.042/million input tokens with free output. The post covers real use cases (classification, spam detection, search reranking over BM25 candidates), community experiments (jevchat, jev-leftpad, jev-2048), open-weight recreations built on Qwen 3.5 (the Kev models and JevBench benchmark), and raises concerns about the model's black-box nature and bias risk, plus Willison's own llm-typesafe plugin for the LLM CLI tool.

QwenBM25
JevTypeSafeSimon Willison+8

models, evalsยท Added 29 Sep 2026, published 21 Sep 2026

latent.spacetalk๐Ÿง  AI

Jev: System One models for Prod, not God โ€” with Diogo Almeida, CEO, TypeSafe AI

Latent Space interview with Diogo Almeida, CEO of TypeSafe AI and an InstructGPT co-author, on the launch of Jev, a "System One" model built for software/programmatic consumption rather than chat. Almeida argues RLHF causes mode collapse and hallucination-inducing overconfidence and RLVR narrows models into jagged rubric-solvers, and describes TypeSafe's alternative training target, RLCD (Reinforcement Learning for Calibrated Decisions), which optimizes for epistemically calibrated probabilities on discrete decisions rather than human preference or verifiable rewards. The conversation also covers why TypeSafe rejects public benchmarks and refusal-based safety alignment for API models, his "Bitterest Lesson" thesis that task/data design beats compute, and how Jev is meant to be used inside coding agents, dark-data pipelines, and other software rather than as a chatbot.

Diogo AlmeidaTypeSafe AIJev+11

training, modelsยท Added 29 Sep 2026, published 21 Sep 2026

github.comrepo๐Ÿง  AI

kerpopule/hermes-jev-skills

hermes-jev-skills wires TypeSafe's small, fast decision model "Jev" into agent workflows (Hermes, Claude Code, Codex) to handle cheap sub-decisions โ€” which model should answer a turn, which of many skills to load, which retrieved passages matter, which conversation turns survive a summary โ€” instead of burning frontier-model tokens on them. It ships ten agent-agnostic SKILL.md files, a CLI (jev routing/mail/screen/search), a local dashboard, and a plugin built on public Hermes seams (pre_llm_call, transform_tool_result, llm_request middleware) with detailed data-redaction guarantees for what gets sent to the Jev API. It also includes a shadow mode for safely evaluating routing decisions before enabling them.

Claude CodeCodexPython+4
JevTypeSafeHermes+2

coding-agents, agents, ai-infra, mcpยท Added 26 Sep 2026, published 18 Sep 2026

github.comrepo๐Ÿง  AI

vinilana/jev-gateway

jev-gateway is a local proxy that sits between coding agents (Codex, Claude Code, OpenCode, Kilo, Gemini CLI, Devin) and their LLM backend, intercepting only the tool-selection decision and routing it to TypeSafe's small, fast "Jev" model instead of the main reasoning model, while forwarding everything else untouched. It supports forced tool_choice, hint-based suggestions (for APIs like Anthropic's that can't force a tool mid-turn), a live dashboard for cost/latency/routing metrics, and a companion benchmark repo (jev-gateway-bench) showing routing helps most on debugging tasks but can hurt some models on feature-building tasks.

Claude CodeCodexOpenCode+4
jev-gatewayTypeSafeJev+4

ai-infra, coding-agents, mcpยท Added 26 Sep 2026, published 18 Sep 2026

github.comrepo๐Ÿง  AI

coldteadotai/abide

Abide is a CLI (npx @coldtea/abide) that hooks into Claude Code, Codex and OpenCode to check every agent edit or turn against project rules written in AGENTS.md/CLAUDE.md that a linter can't enforce (e.g. 'never let a raw error reach a user', 'no premature abstractions'). It uses Jev, TypeSafe's calibrated decision model, to answer a typed yes/no probability per rule per diff instead of a full LLM call, making it cheap (~300ms, fractions of a cent per turn) enough to check every edit; violations above a threshold are fed back to the agent to repair in the same turn.

Claude CodeCodexOpenCode+1
TypeSafeJevVercel AI Gateway

coding-agentsยท Added 26 Sep 2026, published 18 Sep 2026

latent.spacearticle๐Ÿง  AI

[AINews] not much happened today

Latent Space's AINews daily digest for 9/16-9/17/2026, synthesizing AI Twitter and Reddit discussion into themed sections: agent runtime productization (Anthropic's Claude Code Projects for parallel cloud threads, Google's Gemini managed-agent harness with Credentials/Files APIs), the rise of TypeSafe's Jev as a cheap discriminative classifier/routing primitive for agent harnesses (with pushback from Theo on using it for context compaction), OpenAI's Astra for Law vertical launch, DeepMind's Stellar Colosseum multi-agent math/TCS harness and NVIDIA's Agora git-commit-memory agent system, Anthropic's internal AI-R&D automation metrics (Claude-led R&D tasks rising from 1% to 26% in six months), and a Claude Opus-assisted exploit chain that compromised OpenAI-connected accounts. It also covers Reddit local-LLM threads on Qwen 3.8 27B finetunes/quantizations, the ternary Bonsai 2 27B release, and a Mozilla report narrowing the China-US open-model capability gap to 4.4 months.

Claude CodeCodexQwen3+7
AnthropicOpenAIGPT-6 Astra+22

agents, models, evalsยท Added 29 Sep 2026, published 18 Sep 2026

github.comrepo๐Ÿง  AI

OmniJev/awesome-jev-gallery

An extensive, actively maintained GitHub "awesome list" cataloging the ecosystem that has grown around TypeSafe's Jev and its "System One" typed decision models โ€” a non-generative alternative to chat LLMs that returns calibrated probabilities per option (Choice/Score/Noul primitives) via RLCD training and single-pass constrained decoding. It indexes dozens of open-weight reproductions (OneJev, Rizzo Flow, Laya, Jebadiah, kev), benchmarks and leaderboards (JevBench, Jev Decision Index, JevAdvBench, DecisionBench), downstream tools (browser/robot/trading agents built on the typed API), and the research lineage the design draws on (zero-shot entailment classifiers, InstructGPT's reward model, GLiNER/GLiClass, monoBERT, LLaDA, vLLM, DSPy, RouteLLM, Constitutional Classifiers). It also links commentary auditing TypeSafe's claims (accuracy vs. frontier LLM baselines, security issues found in community tools).

vLLMDSPyOutlines+13
JevTypeSafeDiogo Almeida+31

models, evals, researchยท Added 29 Sep 2026, published 17 Sep 2026

github.comrepo๐Ÿง  AI

AnotiaWang/awesome-decision-models

A community-maintained GitHub list cataloging "decision models" (also called System One models): small/fast models that take a state plus caller-declared questions (Noul/true-false, Choice/multi-option, Score/rubric) and return a probability per answer in one forward pass, rather than generating text. It tracks the originating TypeSafe AI Jev model and its /v1/systemone API alongside competing hosted models (Upstage Solar Decide, Liquid AI's d1, OpenAI's Decisions API, Inception's Mercury Decide, Respan's Span-01), dozens of open-weight fine-tunes (Cloudflare's Clef, Perplexity's pplx-decider, AWS Strands Decider, Together AI's Tev1, and many Qwen3.5-based community models), zero-training logit-reading approaches, local runtimes (Ollama, Ollaya, llama.cpp-based servers), SDKs across a dozen languages, and a very long list of agent/coding-tool/MCP integrations (browser agents, code review, routing, game-playing demos) that use these models for fast, typed, in-the-loop decisions. The page is truncated at 40k of ~51k characters, so later sections (further toys, demos, and possibly benchmarks) are not reflected here.

Qwen3.5Qwen3.8-27Bllama.cpp+15
TypeSafe AIJevJevBench+33

models, mcp, agentsยท Added 2 Oct 2026, published 17 Sep 2026

github.comrepo๐Ÿง  AI

Dicklesworthstone/skillranker

SkillRanker (sr) is a standalone Rust CLI that ranks which skill an agent should load next, combining local context/roster signals with TypeSafe.ai's Jev model for evaluation and FrankenSearch's Quill BM25 engine for local candidate prefiltering when a skill library exceeds 254 entries. It integrates with Claude Code and Codex via hooks, offers dry-run/explain/replay/eval workflows for inspecting and reproducing ranking decisions, and is explicitly advisory only โ€” it never executes skills or overrides agent instructions.

RustClaude CodeCodex
JevTypeSafe.aiQuill+1

coding-agents, promptingยท Added 26 Sep 2026, published 17 Sep 2026

latent.spacearticle๐Ÿง  AI

[AINews] Jev: a โ€œSystem One Modelโ€ that only decides/classifies/routes/scores โ€” >100x faster, >200x cheaper than small frontier LLMs

This AINews/Latent Space daily digest (Sep 14โ€“15, 2026) leads with TypeSafe's Jev, a non-autoregressive "System One Model" trained via RLCD (reinforcement learning from calibrated decisions) that skips free-form text generation entirely, instead outputting predefined structured decisions/classifications 20โ€“200x faster and 40โ€“400x cheaper than small frontier LLMs โ€” positioned as a cheap calibrated inference engine for routing, judging, and classification rather than a general LLM replacement. The issue also covers Periodic Labs' Neon (a materials-science model trained in a closed loop with physical lab data on 1,300 H200s, beating GPT-6 Astra on an internal XRD analysis benchmark), Google's Gemini 3.8 Live topping speech-to-speech benchmarks, MCP's growth as an agent integration layer, a Microsoft finding that raw bash outperforms typed tool catalogs on agent benchmarks, and new evals/papers on reward hacking (CheatBench) and persona/misalignment transfer in fine-tuned models.

Model Context ProtocolLangChainGemini+4
JevTypeSafeRLCD+18

models, evals, ai-safetyยท Added 29 Sep 2026, published 16 Sep 2026

github.comrepo๐Ÿง  AI

Mapika/decider

Decider is an open reproduction of TypeSafe AI's System One (Jev) model class: instead of generating text, it reads a state plus a set of typed questions (Choice, Score, or Noul/yes-probability) and returns a calibrated probability distribution for each in one forward pass, with no decoding or parsing. The repo ships 2B/4B/12B and a 35B mixture-of-experts checkpoint (built on Qwen3.5 and Gemma-4 base models), trained on roughly 95 public datasets plus teacher-labelled data, with per-type temperature calibration, GGUF/llama.cpp and vLLM serving paths, an MPS/Apple Silicon port, and a community Snapdragon X Elite NPU port. It benchmarks against TypeSafe's Jev on JevBench and the Decision Index, documenting where it closes the gap (language, tools, retrieval) and where it lags (knowledge-heavy MMLU/GSM8K/GPQA tasks and calibration on hard items).

PythonCUDAMetal+9
TypeSafe AIJevMark Marosi+14

models, inference, trainingยท Added 2 Oct 2026, published 16 Sep 2026

Showing 30 of 33

Show more