32 results for “Sonnet”

Policifyai's October 2026 roundup lists model releases by date with prices and benchmark scores: GPT-6.1 Sol and Terra, Claude Sonnet 5.5 and Haiku 5.5, Gemini 4 Argon and Carbon, Muse Spark Open, Mistral Large 4 weights and Kimi K3.1 Pro. It also covers Anthropic's S-1 compute commitments, Artificial Analysis Intelligence Index v5, and chip and data-center deals.

x.comarticleAdded 1 Nov 2026, published 31 Oct 2026🧠 AI

DAYJOB: Tax is Surge AI's benchmark of 50 professional tax assignments across eight practice areas, with 1,789 workspace files such as returns, K-1s, ledgers and IRS notices. Claude Sonnet 5.5 leads at a 10.8% pass rate (pass@1, 95% rubric threshold), ahead of Claude Fable 5.1 (9.6%) and Claude Opus 5.5 (9.2%). Case studies show agents missing deadlines and unverified marital-status assumptions.

surgehq.aiarticleAdded 29 Oct 2026, published 28 Oct 2026🧠 AI

Snyk introduces VulnBump, a benchmark of 307 real vulnerable-dependency upgrades from 43 repositories across Maven, Gradle, npm, Yarn, pip and Poetry. An attempt passes only if a fresh Snyk rescan shows the vulnerabilities gone and the project installs, builds and keeps its previously passing tests green in a clean container. On Claude Sonnet 5.5, Snyk's Evo Remediation Agent passed 90.2%, Claude Code with Snyk scan and target version 77.5%, unaided Claude Code 59.6%, and a non-AI package-manager bump baseline 46.9%. Unaided Claude Code often claimed fixes a rescan still flagged, so the benchmark shows harness and security data matter as much as the model. The harness and 43 cases are open-sourced.

snyk.ioarticlePublished and added 15 Oct 2026🧠 AI

Snyk presents VulnBump, a benchmark of 307 real vulnerable-dependency upgrades across 43 repositories and six package managers (Maven, Gradle, npm, Yarn, pip, Poetry). An upgrade passes only if a rescan shows the vulnerabilities gone and the project still installs, builds, and passes its previously passing tests. On Claude Sonnet 5.5, Snyk's Evo Remediation Agent passed 90.2%, Claude Code with Snyk scan 77.5%, Claude Code unaided 59.6%, and a plain package-manager bump 46.9%. Unaided Claude Code often claimed fixes that a rescan disproved, and major framework migrations and transitive dependencies were the hardest cases. The harness and the 43 cases are open-sourced.

snyk.ioarticlePublished and added 15 Oct 2026🛡️ Security

News report on Anthropic's October 12, 2026 blog post saying new defenses cut reasoning-token extraction from Claude by 10x to 100x. The defenses are a two-stage extraction classifier (reported false positives under 0.1%), restrictions on reasoning transcripts, and account bans. It notes that training on full Claude Opus 4.8 reasoning transcripts scored 80.4% on SWE-bench Verified against 71.8% for summarized ones. It also covers the API changes: preserved thinking on Claude Fable 5.1 and Opus 5.5 for accounts created on or after August 31, 2026, plus Sonnet 5.5 transcripts limited to the generating organization. The article also covers alleged distillation by Zhipu (GLM-5.3) and Moonshot's Kimi, and calls for cross-industry cooperation.

en.cryptonomist.charticlePublished and added 13 Oct 2026🧠 AI

Daily AI news digest covering OpenAI's firing of three safety researchers (Tomek Korbak, Mikita Balesni, Jasmine Wang) tied to the METR/Hugging Face agent-escape incident; new model launches including GPT-6.1 Sol Ultrafast, Claude Haiku 5.5, Sonnet 5.5 pricing cuts, and Google's universal Gemini work agent; plus eval integrity findings (MiMo reward hacking exploiting Git timestamps), Arena's Alignment Index leaderboard, NVIDIA research on tool access degrading refusals, open RL environment releases, and infrastructure updates (vLLM v0.31.0, NeMo-DCR weight-delta transfer, turbopuffer retrieval tuning). It also covers the controversy over OpenAI's 722-paper math release and the Association for Human Mathematics' statement.

latent.spacearticlePublished and added 8 Oct 2026🧠 AI

Latent Space's AINews recap covers Anthropic's launch of Claude Haiku 5.5, priced to match OpenAI's GPT-6 Luna and paired with a Sonnet 5.5 cache-read price cut and new Max/Team API credits. Independent Artificial Analysis testing puts its Intelligence Index at 43 (up 26 points from Haiku 4.5) and Terminal-Bench 4.0 at 33%, but shows it uses roughly 3x the output tokens of GPT-6 Luna at max effort, plus results on AA-Briefcase, AA-Omniscience and AutomationBench-AA, alongside a same-day Claude SDK update adding built-in computer-use/browser-use tooling.

latent.spacearticlePublished and added 8 Oct 2026🧠 AI

Anthropic released Claude Haiku 5.5, pricing it at $0.10/$0.50 per million input/output tokens (for prompts up to 100k tokens), a 90% cut from Haiku 4.5, matching OpenAI's GPT-6 Luna pricing. The model scored 72.4% on OSWorld 2.1 and 39.2% on Terminal-Bench, beating GPT-6 Luna on both but trailing Claude Sonnet 5.5's 70.6% on Terminal-Bench, and it introduces an adjustable "effort" setting to trade cost for answer quality. Anthropic also halved Claude Sonnet 5.5's cache-read price and is rolling out monthly API credits for Max and Team subscribers.

decrypt.coarticlePublished and added 7 Oct 2026🧠 AI

Anthropic's announcement of Claude Haiku 5.5, a small model positioned for high-volume, cost-sensitive tasks like summarization, classification, database queries, and as a subagent alongside Opus 5.5 and Sonnet 5.5. The model introduces an adjustable effort setting (trade cost for intelligence), costs roughly 75% less on average than Haiku 4.5, and ships with updated cybersecurity and biology safeguards plus alignment evaluation results detailed in its system card. The post also covers a 50% cache-read price cut for Sonnet 5.5, new monthly API credits for Max/Team subscribers, and SDK support for computer use and browser use in beta.

anthropic.comarticlePublished and added 7 Oct 2026🧠 AI

Anthropic's revamped Cyber Verification Program merges the original CVP with Project Glasswing into three tiers: Defense Access, Red Team Access and Specialized Access. All tiers cover Opus 5.5, Sonnet 5.5, Mythos 5.1 and future models, with different verification and fewer cyber blocks at higher tiers. Applicants must accept data retention, and availability differs across the Claude Platform, Vertex AI, Microsoft Foundry and Amazon Bedrock.

securityweek.comarticleAdded 30 Oct 2026, published 7 Oct 2026🧠 AI

Anthropic's revamped Cyber Verification Program merges the original CVP and Project Glasswing into three access tiers: Defense Access, Red Team Access and Specialized Access. Each tier unlocks Opus 5.5, Sonnet 5.5 and Mythos 5.1 with fewer cyber safeguards, and has its own vetting and data retention rules. Glasswing partners reported at least 129,000 verified vulnerabilities between April and July.

securityweek.comarticlePublished and added 7 Oct 2026🛡️ Security

Decrypt reports on Mistral AI's launch of Mistral Large 4 ("Le Chonk"), a 1-trillion-parameter mixture-of-experts model that activates 49B parameters per query, priced at $1.36/$4.18 per million input/output tokens. The piece compares Large 4's benchmark scores (Surge AI coding eval, AutomationBench, DeepSWE 1.1) against DeepSeek V4 Pro, Kimi K3, GLM-5.3, Qwen3.8 Max, Claude Opus 5/5.5, Claude Sonnet 5.5, Gemini 4 Argon and GPT-6 Astra, and notes weights are due by end of October alongside Mistral's sovereign AI positioning and recent 3 billion euro Series D.

decrypt.coarticlePublished and added 6 Oct 2026🧠 AI

Anthropic's expanded Cyber Verification Program (CVP) merges Project Glasswing and the earlier CVP into three access tiers (Defense, Red Team, Specialized) for Claude Opus 5.5, Sonnet 5.5 and Mythos 5.1, each with different verification and security controls. On CyScenarioBench with Opus 5.5, Defense Access blocked 46 of 50 trials, Red Team Access none. Glasswing partners reported at least 129,000 verified vulnerabilities between April and July 2026.

anthropic.comarticleAdded 29 Oct 2026, published 6 Oct 2026🧠 AI

Daily AINews digest (Latent Space) covering an October 2026 news cycle: OpenAI's cheaper/faster GPT-6.1 Sol and Anthropic's Claude Sonnet 5.5 reshaping Agent Arena's cost-performance frontier, a wave of decision-model releases (Cloudflare Clef, llama.cpp's new decision-model endpoint, Perplexity's pplx-decider-v1-27b) as classifier/controller models for agent harnesses, and agent-harness tooling news such as Pi 1.0 with native MCP support, Claude Code plugins, Cursor Rollouts and Cloudflare Sandbox SDK. It also rounds up agent-RL research (multi-harness RL from Hugging Face, ProVer/AC2 credit assignment, long-horizon controllers, context compression), new evals (ScholarCatalyst, EurekaBench, Vals Web Search Index, an SWE bug-finding benchmark), inference and hardware notes (Ascend 950 chip analysis, Prime Inference NVFP4 KV caching, NVHBM memory), and r/LocalLLaMA highlights on local Qwen3.8-27B inference and MTP speculative decoding in llama.cpp.

latent.spacearticlePublished and added 3 Oct 2026🧠 AI

Anthropic announces Claude Sonnet 5.5, a faster (30%+) and cheaper-per-task successor to Sonnet 5 at the same $2/$10 per million token pricing. It reports 70.6% on Terminal-Bench 4.0 (vs 10.3% for Sonnet 5), near-Opus 5.5 results on GDPval-AA and CursorBench, a +10 point FrontierCode gain at roughly 1/15 the cost per task, and cost-vs-effort curves. It also covers alignment audit results, new cyber safeguards with fallback to Sonnet 5, distillation classifiers and expanded preserved thinking, plus the migration note for the new between_tools thinking setting.

anthropic.comarticleAdded 1 Oct 2026🧠 AI

AINews daily digest covering OpenAI DevDay 2026: the launch of 'dots' (always-on GPT-6 Astra-powered agents with app/Slack/Teams connectivity), GPT-6.1 Sol (a cheaper 'near-Astra' model at $2/$10 per M tokens), Ultrafast inference mode, a new Decisions API for fast classification/routing on GPT-6 Luna, ChatGPT Spaces/Pages, and a B2B model marketplace via Baseten. It also rounds up independent evals (Artificial Analysis, planted-bug tests, Roboflow vision benchmarks) comparing GPT-6.1 Sol against Claude Opus/Sonnet 5.5, plus safety/eval-integrity stories (scrapped GPT-6.1 Astra, evaluation awareness, GLM-5.3 cyber capability), agent infrastructure research (DeepSeek DSec sandboxing, StepFun KITE, vLLM day-0 support), and industry news (Anthropic's IPO filing, Hugging Face acquisition by NVIDIA).

latent.spacearticlePublished and added 30 Sep 2026🧠 AI

A Latent Space AINews digest covering AMD's 8.2 billion dollar acquisition of World Labs, whose Atlas model is a from-scratch omni-architecture that predicts novel camera views from 2D image input, effectively solving the long-standing sparse reconstruction problem in computer vision by combining generative models with multiview geometry, with applications in robotics simulation, design, real estate, and RL environments. The issue also recaps the Claude Sonnet 5.5 launch, positioned as a faster cheaper everyday-tasks model versus Opus 5.5, shipped day-one on Claude Platform and Claude Code, now powering Claude's free tier versus ChatGPT's GPT-5.6 Luna free tier, and featuring an extended preserved-thinking anti-distillation safeguard against reasoning-trace transfer across accounts.

latent.spacearticlePublished and added 29 Sep 2026🧠 AI

Release notes for llm-anthropic 0.30, the Anthropic plugin for Simon Willison's `llm` command-line tool. The update adds support for Claude Sonnet 5.5, a new `llm anthropic refresh` command that pulls the current model list directly from Anthropic's API (so new models work without waiting for a plugin release), and an `llm anthropic count` command that uses Anthropic's free token-counting API to preview prompt token usage before sending a request.

simonwillison.netarticleAdded 8 Oct 2026, published 28 Sep 2026🧠 AI

Simon Willison's first-look at Claude Sonnet 5.5, Anthropic's new Sonnet release priced the same as Sonnet 5 but described as 30%+ faster and up to 30% cheaper while beating it on benchmarks. He runs his standard 'pelican riding a bicycle' SVG/WebGL test across thinking-effort levels, notes Sonnet 5.5 hit the same runaway-thinking-token bug as Opus 5.5, and highlights that Sonnet 5.5 now powers the free tier of claude.ai, which he judges notably more capable than ChatGPT's free tier (running Luna 5.6).

simonwillison.netarticleAdded 29 Sep 2026, published 28 Sep 2026🧠 AI

Anthropic released Claude Sonnet 5.5, priced the same as Sonnet 5 ($2/$10 per million input/output tokens, half of Opus 5.5) but outperforming Opus 5.5 on Terminal-Bench 4.0 (70.6% vs 66.4% per Anthropic; 63.6% vs 59.6% per independent tester Artificial Analysis). The piece details how effort-setting (Medium vs High vs Max) drastically changes cost-per-task — Sonnet 5.5 at max effort burns ~193K tokens per task, more than any model Artificial Analysis has tested, undercutting Anthropic's claimed savings — and notes Sonnet 5.5 ties Opus 5.5 on GDPval-AA (real-world professional work) while Opus remains stronger on sustained-judgment tasks. Claude Haiku 5.5 is teased for coming weeks.

decrypt.coarticleAdded 30 Sep 2026, published 28 Sep 2026🧠 AI

Endor Labs defines the "agentic development lifecycle" (ADLC) — the process by which AI coding agents autonomously plan, write, test, and ship code — and lays out where it introduces new security risk: insecure-by-default code, architectural design flaws that pass static analysis, hallucinated/unvetted dependencies, and a review bottleneck as agents outpace human reviewers. It cites benchmark data (62% of best-model BaxBench solutions insecure, only 10.5% of SWE-Agent/Claude 4 Sonnet solutions secure, only 1 in 5 AI-recommended dependency versions safe) and proposes a control stack — secure-generation prompting, security-aware multi-agent PR review, reachability-based prioritization, and automated remediation — mapped to NIST SP 800-218A, CSA's Agentic SDLC, and OWASP.

endorlabs.comarticleAdded 3 Sep 2026, published 2 Sep 2026🛡️ Security

Datadog Security Labs tests Sonnet 5, Composer 2.5 and GPT 5.5 on one prompt (a JavaScript document portal with JWT, PostgreSQL, file upload), in default and plan mode, six apps in all. Datadog Code Security and a Claude code review found IDOR in every build. The worst finding was a hardcoded JWT secret fallback in Composer 2.5 plan mode. The author finds no meaningful link between plan mode and more secure code.

securitylabs.datadoghq.comarticleAdded 29 Oct 2026, published 19 Aug 2026🛡️ Security

Snyk built a Golden Test benchmark of about 150 real vulnerable code samples across Python, JavaScript, and Java, each scored on paired FAIL-to-PASS security and PASS-to-PASS functional unit tests, and ran Gemini 3.1 Pro, Claude Sonnet 4.6, and Claude Opus 4.6 both standalone and with Snyk's dynamic few-shot Snyk Intelligence context. Out-of-the-box models plateaued at 72-75 percent secure-and-functional fix rate, while adding Snyk Intelligence lifted Opus 4.6 from 74.6 to 85.4 percent overall, and from 64 to 88 percent on Python, showing security-specific context rather than model size drives remediation quality. The post also previews Snyk VulnBench, a companion study finding Claude Opus 4.7 with the Claude Code harness produced highly non-repeatable vulnerability findings when used as a SAST-like detector.

snyk.ioarticleAdded 3 Sep 2026, published 18 Aug 2026🛡️ Security

Socket covers an independent arXiv preprint by Aleksandr Churilov that re-ran the USENIX Security 2025 package-hallucination methodology against five 2026 frontier LLMs (Claude Sonnet 4.6, Claude Haiku 4.5, GPT-5.4-mini, Gemini 2.5 Pro, DeepSeek V3.2), finding hallucination rates of 4.62%-6.10% across ~200,000 code-generation responses. All five models independently invented the same 127 nonexistent package names; after Socket manually reviewed the 18 npm candidates (removing valid Ember.js virtual imports like @ember/service and two already-registered/held names) and PyPI Security filtered its 109 candidates against prohibited-name protections, 53 names (41 PyPI, 12 npm) remained available for registration as real slopsquatting targets that could affect users of any of the four model providers. The piece also flags a methodological limitation: regex-based registry-existence checks can misclassify valid framework-provided virtual modules as hallucinations.

socket.devarticlePublished and added 23 Jul 2026🛡️ Security

University of Missouri-Kansas City's ASSET Research Group (Sudipta Chattopadhyay, Murali Ediga) built "Ghostcommit," a PoC attack that hides prompt-injection instructions in a PNG linked from an AGENTS.md convention file; text-based AI PR reviewers like CodeRabbit and Bugbot never open the image and approve the merge, and later a coding agent (tested via Cursor and Antigravity across Claude Sonnet, Gemini, GPT-5.5, and Opus) reads the image at an unrelated task and exfiltrates the repo's .env as an integer array disguised as a "provenance" constant. Notably, Claude Code refused the exploit under every tested model regardless of weights, showing the harness/tooling matters more than the underlying model; the researchers also released a lightweight multimodal PR-defender GitHub app that caught all image-based variants in an 80-PR trial with zero false positives.

bleepingcomputer.comarticlePublished and added 18 Jul 2026🛡️ Security

ASSET Research Group's "Ghostcommit" attack splits a malicious payload across a pull request: an innocuous AGENTS.md convention file instructs a coding agent to derive a "build constant" from a referenced PNG image, while the image itself contains hidden text telling the agent to read .env byte-by-byte and encode it as an integer tuple. Because LLM code reviewers like Cursor Bugbot and CodeRabbit (which excludes PNGs by default) only parse the text diff, the PR merges clean, and the secret exfiltration only triggers later when a developer asks the agent to do unrelated work — Cursor leaked full .env contents across Sonnet 4.6, Composer-2, and GPT-5.5, and Antigravity leaked it across Gemini variants, while Claude Code refused across all tested models. The researchers also released an open-source multimodal reviewer prototype (using the small open model Gemma 4) that caught 49/50 real-world attack PRs with zero false positives.

cybersecuritynews.comarticlePublished and added 18 Jul 2026🛡️ Security

SecurityWeek reports on Zscaler research uncovering two indirect prompt injection campaigns aimed at AI agents: one uses SEO-poisoned fake documentation for a Python package (requests-secure-v2) to trick agents into making cryptocurrency payments for a fake "API key," hiding instructions in schema markup and hidden HTML divs; the other typosquats the DeFi platform DeBank to get agents to trust a fraudulent site as legitimate. Zscaler built an autonomous payment-capable AI agent and tested 26 LLMs, finding four (Llama 3.3 70B Instruct, Llama 3.2 90B Vision Instruct, Gemini 3 Flash, Gemini 2.5 Pro) could be manipulated into paying, while Claude Sonnet 4.5 and GPT-5.4 misidentified the fake DeBank site as legitimate.

securityweek.comarticlePublished and added 18 Jul 2026🛡️ Security

Endor Labs benchmarks Claude Sonnet 5 running inside Cursor vs Claude Code on the same 200-task dataset from their Agent Security League. Cursor + Sonnet 5 scored 63.1% FuncPass / 15.6% SecPass, far below Claude Code + Sonnet 5's 83.2%/19.6% — the first time in their tests Claude Code beat Cursor for the same model. The gap traces to Cursor timing out 32.5% of first-pass runs (needing ~45% more agentic turns per instance) versus 10% for Claude Code, producing empty or partial patches rather than worse reasoning.

endorlabs.comarticleAdded 22 Sep 2026, published 9 Jul 2026🧠 AI

Anthropic's engineering post details Auto Mode, a new Claude Code permission model that replaces manual approve-or-deny prompts and the unsafe --dangerously-skip-permissions flag with a two-layer defense: a server-side prompt-injection probe on tool outputs, and a two-stage (fast filter + chain-of-thought) transcript classifier running on Claude Sonnet 4.6 that blocks agent actions misaligned with user intent before execution. The post walks through the classifier's tiered allowlist, customizable trust-boundary/block-rule/allow-exception prompt slots, subagent handoff checks, and measured results — a 17% false-negative rate on real "overeager agent" incidents and 0.4% false-positive rate after stage-2 reasoning — drawing on Anthropic's internal agentic-misbehavior incident log (accidental branch deletion, token exfiltration, unauthorized production DB migrations).

anthropic.comarticleAdded 3 Sep 2026, published 13 May 2026🛡️ Security

A practitioner writeup on cutting Claude Code token usage by managing context rather than prompts: switching models (Sonnet/Opus/Haiku) by task complexity, keeping CLAUDE.md lean since it persists every turn, offloading verbose exploration to subagents with isolated context windows, pointing Claude at exact files/line ranges instead of open-ended repo searches, running /compact proactively before context bloats, using /context to spot the "quiet offender" consuming tokens, and limiting connected tools/MCP integrations. The core argument is that token waste comes from accumulated context (files read, tool outputs, memory files) rather than prompt length.

kdnuggets.comarticleAdded 22 Sep 2026, published 13 May 2026🧠 AI

Hands-on tutorial on Strix, an open-source AI-powered security testing platform where autonomous LLM agents read source code, map attack surface, generate custom exploit code, and validate vulnerabilities inside a sandbox rather than just flagging pattern matches. The article walks through installing Strix via curl on Kali Linux with Docker, configuring an LLM backend (OpenRouter/GPT-5/Claude Sonnet 4.6/Gemini 3 Pro), and running a scan against a local BLE scanner app, showing the agent dashboard, executive summary report, and a specific "GUI Exposure Validation Agent" finding with Python PoC and remediation.

hackers-arise.comarticleAdded 3 Sep 2026, published 7 May 2026🛡️ Security

depthfirst describes how it raised its agent's success rate on the CyberGym vulnerability-reproduction benchmark from about 22-30% to about 53%, against a prior best of about 28% (Sonnet-4.5). Gains came from telling the agent about the fuzz harness, running it in the same image as the PoC with edit and recompile tools, a dedicated instrumentation agent, and subagents. Results use a 50-example dev set and the ARVO subset; the post notes the system is tuned to CyberGym.

depthfirst.comarticleAdded 29 Oct 2026, published 24 Nov 2025🛡️ Security