Skip to content

101 results for β€œNVIDIA”

What you seeeverything
  1. nemotron-halloween

    MonsterHouse is a Halloween interactive projection built on the NVIDIA Nemotron Voice Agent: Nemotron Speech ASR, Nemotron 3.5 Bolt E4B 4GB with a LoRA persona adapter, Magpie TTS Zeroshot and Audio2Face-3D in Unreal Engine, on two RTX Blackwell GPUs. Median end-of-speech-to-audio is 1.70 seconds live and 0.72 seconds with cached responses. The post gives a build path and tips on caching and state handling.

    huggingface.cowriteupPublished and added 30 Oct 2026🧠 AI

  2. SGLang (@sgl_project) on X

    SGLang announces Day-0 support for Mistral Large 4 ("Le Chonk"), saying it is the first engine to serve the model on NVIDIA Vera Rubin. The post describes the model as Mistral's largest to date: a natively multimodal 1T-parameter mixture-of-experts model covering instruct, reasoning, coding and agentic workflows. The fetched text is truncated, so benchmark claims and launch commands are not visible.

    x.comthreadAdded 30 Oct 2026, published 29 Oct 2026🧠 AI

  3. Muhammad Waris (@WarisCodes) on X

    Nemotron 3.5 Transcribe is a free open-weight speech-to-text model from NVIDIA covering 40 languages, including mixed-language speech. The post says it ties for first among open models with a 2.8% error rate. It says the model needs a large GPU such as an H100 or RTX 5090, so it will not run on a laptop. The post gives no benchmark name or model card link.

    x.comthreadAdded 30 Oct 2026, published 29 Oct 2026🧠 AI

  4. 🚨 AI News | TestingCatalog (@testingcatalog) on X

    Nemotron 3.5 Transcribe is an open-weight, promptable NVIDIA mixture-of-experts model with 30B total and about 4B active parameters. One checkpoint does transcription in 40 languages, speaker attribution, translation, contextual prompting and audio understanding. The post says it ranked first in VoiceArena's comparison of 14 diarization plus ASR systems. The fetched text is cut off and gives no license or download details.

    x.comthreadAdded 30 Oct 2026, published 29 Oct 2026🧠 AI

  5. Introducing AnySpeechRecognizer and AnyDecisionModel: Open Models for Speech and Decisions on Apple Platforms

    AnySpeechRecognizer and AnyDecisionModel are two Swift packages from Hugging Face. The first mirrors Apple's SpeechAnalyzer API with swappable engines (NVIDIA Parakeet, Alibaba Qwen3-ASR on Core ML) and adds Sortformer speaker diarization. The second returns typed yes/no, choice and score answers with probabilities via MLX, Core AI, llama.cpp, Jev or Ollama. The post gives M4 Max timings, model sizes and calibration options.

    huggingface.coarticlePublished and added 29 Oct 2026🧠 AI

  6. OpenAI Plans to Buy Google's AI Chips as It Looks Beyond Nvidia: Report

    Decrypt reports, citing The Information, that OpenAI plans to buy Google TPUs rather than rent them, to reduce dependence on Nvidia. Neither company has confirmed, and price, volume and timing are undisclosed. The article covers OpenAI's TPU optimization job listing, its Broadcom-built JalapeΓ±o inference chip due end of 2026, Nvidia and AMD deals, and Anthropic's multi-gigawatt TPU agreement.

    decrypt.coarticlePublished and added 28 Oct 2026🧠 AI

  7. John Rood (@johnroodepic) on X

    Nemotron 3.5 Transcribe is an open-weight, promptable 30B mixture-of-experts model from NVIDIA with about 4B active parameters, built for recorded audio. One checkpoint transcribes 40 languages, handles recordings up to an hour, labels up to eight speakers, translates, and answers questions about English audio. Weights and a demo are on Hugging Face. The post gives no benchmarks.

    x.comthreadAdded 29 Oct 2026, published 28 Oct 2026🧠 AI

  8. NVIDIA Nemotron 3.5 Transcribe and Granary v2: Intelligent Multilingual Transcription You Can Prompt and Adapt

    Nemotron 3.5 Transcribe is an open-weight, promptable speech model that handles transcription in 40 languages, translation, diarization for up to eight speakers, and audio Q&A. It has about 4B active of 30B parameters and tops open-weight ASR and diarization leaderboards. The post also covers the Granary v2 curation pipeline (463,062 hours, 48 languages) and a medical fine-tuning case study that cut held-out WER by 45.8%.

    huggingface.coarticlePublished and added 28 Oct 2026🧠 AI

  9. Photon Capital (@PhotonCap) on X

    Photon Capital's thread covers the 27 October 2026 NVIDIA and Oracle announcement of general availability of Vera Rubin NVL72 and Vera CPUs on OCI. It lists specs (Spectrum-6 at 102.4Tbps, HGX Rubin NVL8 with Xeon 6, 150,000 initial Vera CPUs) and OpenAI's use of Vera CPUs for agentic sandboxes. The commentary argues CPU capacity can cut cost per task and shorten KV cache residency in GPU memory.

    x.comthreadAdded 28 Oct 2026, published 27 Oct 2026🧠 AI

  10. Nvidia discusses $2k-per-GPU annual fee for software

    Tom's Hardware reports that Jensen Huang put Nvidia's software licensing at about $2,000 per GPU per year for software that runs agents on AI factories, said at GTC Berlin on 22 October 2026. Nvidia AI Enterprise is listed at $4,500 per GPU per year, and Nvidia has not said which products or terms the new fee covers. The piece also covers the OpenShell Reference Architecture and Sentry agent monitoring on BlueField-4.

    tomshardware.comarticleAdded 28 Oct 2026, published 26 Oct 2026🧠 AI

  11. Block's new voice AI sounds eerily human, sparking awe and scam fears

    Dessa is a voice AI model from Block, trained from scratch on human speech only, with no text stage. It listens while speaking, so it handles interruptions, laughter and tone changes. Block says it trained on one Nvidia GB200 NVL72 system and that it runs locally on a MacBook Pro with M4 Max or better. Model size, benchmarks and release date are undisclosed. Early access goes to a small group of AI safety researchers. Reactions split between praise and scam fears.

    coindesk.comarticlePublished and added 24 Oct 2026🧠 AI

  12. Why AI Compute Comes in Rectangles β€” Erik Bernhardsson, Modal CEO

    Latent Space interview with Modal CEO Erik Bernhardsson, after Modal's $750M Series D at a $16B valuation and passing $1B annualized run rate. He explains why GPU demand is not "rectangular" like fixed-term capacity contracts, how Modal pools demand and buys from about 25 clouds on three-year deals, and why sandboxes grew to about a third of revenue. Also covers GPU price-collapse risk and non-NVIDIA accelerators. Only the first part of the transcript was available.

    latent.spacetalkPublished and added 22 Oct 2026🧠 AI

  13. Why AI Compute Comes in Rectangles β€” Erik Bernhardsson, Modal CEO

    Latent Space interview with Modal CEO Erik Bernhardsson after the company's $750M Series D at a $16B valuation, with a transcript. He explains why GPU demand does not match rectangular fixed-term capacity contracts and how Modal pools demand across customers. He covers sourcing from nearly 25 clouds on multi-year deals, the risk of falling GPU prices, sandboxes reaching about a third of revenue, and non-NVIDIA accelerators.

    latent.spacetalkAdded 23 Oct 2026, published 22 Oct 2026🧠 AI

  14. What Is a Neocloud? The GPU Clouds Powering the AI Boom

    Decrypt explainer on neoclouds, specialist providers such as CoreWeave and Nebius that rent Nvidia GPU clusters for AI training and inference. It covers the chips, power and debt model, Bitcoin miners turned AI hosts, and customers including Microsoft, AWS, Google and Anthropic. It cites Gartner's 14 October 2026 forecast that over 80% of neoclouds will stop operating independently by 2030.

    decrypt.coarticlePublished and added 22 Oct 2026🧠 AI

  15. Jonathan Rhyne (@jdrhyne) on X

    A post on X about NVIDIA's Nemotron 3.5 Parse and its "#1 on ParseBench" claim. The author says the ranking holds only among open-weight models under 1B parameters. On the full board of 150+ models the model scores about 75, while the top is near 90. The post asks vendors who run a benchmark to print the filter on the chart.

    x.comthreadAdded 23 Oct 2026, published 22 Oct 2026🧠 AI

  16. Nvidia Unveils Its Full-Stack Blueprint to Contain and Monitor AI Agents

    The OpenShell Reference Architecture, announced by NVIDIA at GTC Berlin, splits agent work across hardware: Vera Rubin runs models, Vera CPUs run agents inside the open-source OpenShell runtime, and BlueField-4 DPUs run the Sentry monitor. OpenShell has a gateway, supervisor, sandbox and formal-verification policy prover. Sentry inspects agent-to-model traffic outside the host. Sentry availability is listed as early next year.

    decrypt.coarticlePublished and added 21 Oct 2026🧠 AI

  17. NVIDIA Kumo Relational Outperforms Supervised Machine Learning on Relational Data, No Training Required

    NVIDIA Kumo Relational is a pre-trained relational foundation model that predicts outcomes such as churn or fraud directly on multi-table databases through in-context learning, using up to 10,000 context examples and no task-specific training. NVIDIA reports it beats supervised relational deep learning and XGBoost pipelines across 41 tasks on 15 databases, and beats AutoGluon by 8% MRR on SAP SALT. Code is Apache 2.0, weights are on Hugging Face.

    huggingface.coarticlePublished and added 21 Oct 2026🧠 AI

  18. Train in Simulation, Deploy on a Real Robot: Microduck with Isaac Lab 3.0

    Tutorial for training a walking policy for Microduck, an open-source bipedal robot from Pollen Robotics and Hugging Face, in NVIDIA Isaac Lab 3.0 with Newton. It covers RSL-RL training with the backlash preset, BAM actuator models and domain randomization, then ONNX export (61 observations, 14 joint-position actions) and deployment with robotctl. Policies can be shared on the Hugging Face Hub or tested in Microduck Arena.

    huggingface.cowriteupPublished and added 21 Oct 2026🧠 AI

  19. NVIDIA Kumo Forecast Combines Pretrained Time-Series Representations with Historical Pattern Retrieval and Interpretability

    NVIDIA Kumo Forecast (formerly NV-Tesseract Forecasting) is a multivariate time-series forecasting model built on the MOMENT-1-large Transformer backbone (about 340M parameters) with a trainable forecasting head. Its DARR mode blends direct predictions with k-nearest-neighbor retrieval over historical context, and an interpretability framework gives per-horizon lag and feature attributions. Inputs are 256 to 2048 numeric observations; code and weights are Apache 2.0.

    huggingface.coarticlePublished and added 21 Oct 2026🧠 AI

  20. Announcing SimReady Central: An Open Library of Simulation-Ready 3D Assets for Robotics and AI Factories

    SimReady Central Library is an NVIDIA-led, free and ungated collection of more than 2,000 simulation-ready OpenUSD assets on Hugging Face, covering robot arms, grippers, warehouse equipment, racks and cooling gear. Assets are validated against SimReady Foundation profiles, and NVIDIA USD Search lets developers and agents find them by natural language. The post shows GPT-6 Astra building a pick-and-place scene in Isaac Sim and comparing AI factory layouts.

    huggingface.coarticlePublished and added 21 Oct 2026🧠 AI

  21. NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation

    Cosmos3-H-Dreams is NVIDIA's real-time generative surgical simulator, trained on clinical cholecystectomy video and kinematics from the CMR Surgical Versius platform. It builds on the 16B Cosmos3-H-Embodied-Nano, distills a bidirectional teacher into four-step and two-step causal students with Self-Forcing, and streams through FlashDreams on one RTX PRO 6000 GPU. Checkpoints and a recipe for custom data are released.

    huggingface.coarticlePublished and added 20 Oct 2026🧠 AI

  22. DeepInfer: High-performance inference framework for DeepSeek models

    DeepInfer is DeepSeek's open-source inference framework for offline inference of DeepSeek-V4.1-Flash, released under Apache 2.0. It covers attention data parallelism, MoE expert parallelism with load balancing, draft-token decoding with confidence-scheduled verification, batch-invariant inference, deterministic sampling and structured outputs. It runs on NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs. The KV cache system, prefill/decode disaggregation and load balancing are not included.

    github.comrepoAdded 21 Oct 2026, published 20 Oct 2026🧠 AI

  23. 🚨 AI News | TestingCatalog (@testingcatalog) on X

    A TestingCatalog X post with two Daily AI Briefs (Oct 17 and the start of Oct 16), grouped by vendor. Oct 17 items include GPT-6 Astra Pro upgrades in ChatGPT, Codex context reuse and caching, Gemini 4 Argon in AI Studio Build, the open-weight MIT-licensed DeepSeek-V4.1-Flash-1017, Claude Code Review going GA, Perplexity's open Decider v1.2 models (27B and 4B), NVIDIA's 4B looped Nemotron Labs Dory 1.0, Reflection's Apache-2.0 Beam, Cursor cloud-agent canvases and Tencent's Hy Memory 2.0. Oct 16 begins with Meta's open-weight Muse Spark Open, an 816B-total, 42B-active MoE with a 1M-token context. It gives a quick snapshot of the week's open-weight and coding-agent releases.

    x.comthreadAdded 18 Oct 2026, published 17 Oct 2026🧠 AI

  24. [AINews] High Taste Testers Ep. 1

    AINews issue for 10/15–10/16/2026, covering Twitter and Reddit. It covers the open-weights releases Meta's Muse Spark Open (816B/42B-active MoE, AA Intelligence Index 39, custom license) and Reflection Beam 1.0 (501B/23B-active, Apache 2.0), plus NVIDIA Nemotron 3.5, StepFun Step 5 Preview and FLUX 3 Image Klein. It also covers Gemini 4 Argon, Haiku 5.5 pricing, "decision model" classifiers (Liquid d1-ultra, Perplexity pplx-decider), TPUv7/Vera Rubin/MI355X serving benchmarks, interpretability claims (Qwen3-32B neuron audit), agent research, eval-integrity and safety disclosures, and China export-control proposals. The page also announces a pilot video show, High Taste Testers Ep. 1.

    latent.spacearticlePublished and added 17 Oct 2026🧠 AI

  25. FuTransformer: FP8 prefill and INT4 decode for Llama-style inference on Hopper

    FuTransformer is a CUDA implementation of a Llama-style Transformer block for NVIDIA Hopper GPUs. It uses FP8 prefill with fused GEMM epilogues and INT4 weights plus an INT4 KV-cache copy for decode, with a block-diagonal Hadamard transform to cut cache quantization error. On one H100, prefill is up to 1.48x faster than compiled PyTorch FP8, and INT4 decode is 1.3-2.4x faster than the faster PyTorch baseline. Llama-3.1-8B decode takes 2.8 ms per step at batch one, versus 8.1 ms for compiled transformers. WikiText-2 perplexity rises from 6.24 to 7.23 with round-to-nearest INT4 weights, or 6.99 with GPTQ.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026🧠 AI

  26. Managing open-weight model risk in enterprise deployments

    Microsoft blog post introducing "Risk Management for Open-Weight Models in Enterprise", a joint Microsoft–NVIDIA paper. It proposes a shared risk taxonomy (Cybersecurity, Data Protection, Content, Human-AI Interaction, Bias) grounded in ISO standards and the NIST AI RMF. The paper maps evaluations to risks as evidence and argues that risk depends on the model, use case, deployment and safeguards, not on weight openness alone. It also covers how responsibility for controls shifts when enterprises self-host models, and points to a joint repository of evaluations. The first paper focuses on the model layer; runtime, harness and application layers are planned for later.

    microsoft.comarticlePublished and added 16 Oct 2026πŸ›‘οΈ Security

  27. Managing open-weight model risk in enterprise deployments

    Microsoft's announcement of "Risk Management for Open-Weight Models in Enterprise", the first paper in a planned joint series with NVIDIA. It proposes a taxonomy of five risk categories (Cybersecurity, Data Protection, Content, Human-AI Interaction, Bias). The approach is grounded in ISO standards and the NIST AI Risk Management Framework. It maps evaluations to risks as evidence, stresses that weight openness alone doesn't determine risk, and explains how self-hosting shifts responsibility for safeguards. A joint repository will collect evaluations, and later work will cover the runtime, harness and application layers.

    microsoft.comarticlePublished and added 16 Oct 2026🧠 AI

  28. Big Tech's AI auditors will only see what they're shown

    Opinion column by Samuel Vance-Law (Decentralization Research Center) arguing that the White House AI accord signed by Nvidia, OpenAI, Anthropic, Google, Meta and xAI leaves audit independence unaddressed: companies pick their own auditors and decide what those auditors see, with no penalties. It draws on the Enron/Arthur Andersen and Sarbanes-Oxley precedent, a Stanford/Harvard/Brown scoring of the 2023 voluntary commitments (53% average), and METR's limited-access pre-release test of OpenAI's o3. It points to DeepMind's August double-blind evaluation on sealed hardware, run with Singapore's AI Safety Institute, as proof that auditors can now choose their tests without taking a copy of the model. It recommends auditor-chosen tests, public disclosure of auditor identities and audit scope, and an outside overseer of the auditors.

    coindesk.comarticlePublished and added 16 Oct 2026🧠 AI

  29. Peter Dedene (@dedene) on X

    A X thread benchmarking Qwen3.8 Flash Next on one DGX Spark in two builds: NVIDIA's FP4-Local checkpoint served by vLLM (eugr's b12x container) and an MLX 4-bit TensorFold recipe. The NVIDIA build scores higher on the author's agentic benchmark (81.2 vs 75.0), BFCL tool calling (82.4 vs 71.8 single-turn, 54.5 vs 43.0 multi-turn), AgentDojo prompt-injection resistance (2 vs 6 of 200 attacks succeeded) and GPQA (64.6 vs 59.1). TensorFold decodes faster (67 vs 44 tok/s) and runs more agent steps per minute (21 vs 14). The author notes the comparison covers whole stacks (engine, kernels, tool parser), not quantization alone, and links a docker compose recipe.

    x.comthreadAdded 17 Oct 2026, published 16 Oct 2026🧠 AI

  30. Harrison Kinsley (@Sentdex) on X

    Sentdex reacts to Artificial Analysis ranking NVIDIA's Nemotron 3.5 Super VL (120B total, 12B active MoE) as the top US open-weights model, scoring 26 on the Intelligence Index. That edges out Thinking Machines' Inkling Small (26), NVIDIA's Nemotron 3 Ultra (23) and Meta's Muse Glimmer (17). Sentdex's informal tests at vanilla settings show over 550 tok/sec, and they suspect it would rank higher on agentic coding. They see it as a candidate for a fast local coding agent model.

    x.comthreadAdded 16 Oct 2026, published 15 Oct 2026🧠 AI

  31. The importance of tensor handling and implementation of physics-informed DeepONets

    Proposes a modified Physics-informed DeepONet (PI-DeepONet) architecture that removes redundancy in how the Branch network processes input functions across collocation points. It is mathematically equivalent to the original but uses smaller input tensors and fewer Branch evaluations. The authors derive training-time scaling laws, then test on 1D, 2D and 3D linear advection problems. Accuracy matches the original, the maximum speed-up is 3.75Γ— in 2D, and a 3D model trains on an NVIDIA A100 only with the new formulation, because the original runs out of memory.

    arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026🧠 AI

  32. Frontier-Level Red-Teaming From a Self-Hostable Open-Weight Model: Testing NVIDIA Nemotron 3.5 Super

    Orca Security's research team built an internal prototype, Agent Piercer, that attacks AI agents by choosing probes, writing attacks and judging whether they worked. They compared NVIDIA Nemotron 3.5 Super (self-hosted on 4Γ—L40S via SageMaker) with Opus 4.8, GPT-6 Astra and Grok 4.7 as the driving model against the same live target. Nemotron matched the frontier models on vulnerability types found (four) and was the only one to complete every simple test and judge all 57 real attack conversations. The post also notes that some proprietary models declined authorized red-team tasks under default safety settings, which makes self-hosted open-weight models attractive for offensive testing.

    orca.securityarticlePublished and added 15 Oct 2026πŸ›‘οΈ Security

  33. FAEST on GPUs: Addressing Field Multiplication as a Bottleneck

    ePrint paper presenting an NVIDIA GPU implementation of FAEST (a post-quantum signature scheme built on VOLE-in-the-Head and QuickSilver), covering key generation and OWFProve/OWFVerify for standard and EM constructions in s and f variants. Profiling shows field multiplication takes about 82% of FAEST-128f signing time once AES is hardware-accelerated. Using PTX clmad carry-less multiplication plus Karatsuba, it reaches up to 26.6x kernel throughput and about 2.9-3.1x full 256-bit OWFProve throughput over the software-multiplication build on an RTX A5000.

    eprint.iacr.orgpaperPublished and added 15 Oct 2026πŸ›‘οΈ Security

  34. Artificial Intelligence (AI) in Cybersecurity, Part 29: Creating Isolated Autonomous Agents for Hacking with NemoClaw

    Hackers-Arise tutorial on NVIDIA NemoClaw, an open-source wrapper that runs OpenClaw agents inside OpenShell sandboxes with kernel-level isolation and declarative YAML network/file policies. It covers OpenClaw's security problems (543 tracked CVEs, 40,000+ exposed instances bound to 0.0.0.0 without auth), caveats such as zero-day RCE and sandbox escapes, and install and TUI testing steps on Kali. It also cites a Cisco AI Defense plus OpenShell case study that blocked simulated exfiltration through a third-party skill.

    hackers-arise.comarticlePublished and added 14 Oct 2026πŸ›‘οΈ Security

  35. Artificial Intelligence (AI) in Cybersecurity, Part 29: Creating Isolated Autonomous Agents for Hacking with NemoClaw

    Hackers-Arise tutorial on NVIDIA's open-source NemoClaw, which runs OpenClaw (and Hermes or LangChain Deep Agents) inside OpenShell sandboxes. OpenShell provides kernel-level isolation and declarative YAML policies for files, credentials and network access. It covers OpenClaw's risks (543 tracked CVEs, 40,000+ exposed instances), an OpenClaw vs NemoClaw comparison, the caveat that sandbox escapes and core-logic zero-days remain possible, and a Docker/Node.js install via the nemoclaw.sh wizard with TUI testing. It also cites the Cisco AI Defense plus OpenShell case study, in which an agent that does security patching was protected against a simulated exfiltration attempt.

    hackers-arise.comwriteupPublished and added 14 Oct 2026🧠 AI

  36. Accelerating Pollard Rho with GPU Field Arithmetic on NVIDIA Blackwell

    Preprint that speeds up Pollard rho on GPUs by rebuilding field arithmetic: packed normal-basis representation, the CUDA 13.3 PTX carry-less multiply (clmad), and three-input logic instructions. On one RTX PRO 6000 Blackwell it goes from 0.85 to 14.64 billion iterations/s (17.2x) on the Certicom ECC2K-130 challenge, which puts the whole challenge under five GPU-years. The same levers give 1.52x on P-256 and 2.61x on P-384, which leaves P-256 about 6e21 card-years away. It also reports twelve GPUs from Turing to Blackwell, an FPGA engine on AWS F2 and a campaign that covered 5.4% of the expected work, with code and a Dockerfile on GitHub (rho-blackwell). It claims no improvement on the generic-group bound.

    eprint.iacr.orgpaperPublished and added 14 Oct 2026πŸ›‘οΈ Security

  37. Gunjan N Ganatra (@gnganatra) on X

    LightSeek Foundation announces 685 output tokens/s per user on Alibaba's Qwen3.8-Flash-Next. They ran their TokenSpeed serving engine on 4Γ— NVIDIA GB300 with NVFP4 quantisation, and link a blog on the kernel and serving optimizations plus the GitHub repo. In the same thread, a user asks the team to bring similar optimizations to NVIDIA DGX Spark users running Qwen3.8-27B on vLLM, and to the upcoming Qwen4-27B. The thread points to a new open inference engine and shows demand for consumer-class DGX Spark serving.

    x.comthreadPublished and added 14 Oct 2026🧠 AI

  38. Microsoft’s AI chip targets 40% more tokens per megawatt in 2027

    Reports Microsoft's Maia 300, its third-generation in-house AI accelerator, unveiled October 12, 2026 with production workloads from 2027. Microsoft claims 40% more tokens per megawatt than leading GPU systems and up to 7x Maia 200's rack-level token throughput in a 96-accelerator rack. It uses a chiplet design on TSMC N2P that separates compute, memory-controller and I/O. It is aimed at long-context reasoning and agentic inference, while Nvidia and AMD stay in place for training. Useful as a data point on the shift toward custom inference silicon and model-chip co-design.

    en.cryptonomist.charticlePublished and added 12 Oct 2026🧠 AI

  39. Building AI for Reliable Execution: Lessons From Industrial Robotics

    Latent Space interviews Standard Bots' CEO Evan Beard and Head of AI Leif Jentoft about the AI stack behind its industrial robot arms. A shared base model (low billions of parameters) is adapted per customer through demonstrations and fine-tuning. A zero-shot perception model, whose backbone is trained on over a billion images, handles machine tending, while conventional code handles motion and cell logic. Inference runs on-premises on edge GPUs that stream action chunks to low-level control. Failures and human corrections feed fleet learning except in air-gapped defense deployments, and the StandardOS APIs/SDKs let developers bring their own models such as NVIDIA Cosmos. The lesson is to keep the model's role narrow and use targeted, high-quality data to fix edge cases instead of chasing dataset size.

    latent.spacearticlePublished and added 10 Oct 2026🧠 AI

  40. In Other News: AI Used in Korean Bank Breaches, Poem-Guided Botnet, Empire Admin Gets 40 Years

    SecurityWeek's weekly news digest covering PoeLLM malware that resolves its C&C IP from keywords hidden in a GitHub-hosted poem, the GhostAction campaign spreading malicious GitHub Actions workflows to steal secrets from 772 more repos, South Korean authorities probing suspected AI-assisted bank breaches where CrowdStrike found Claude Code and Claude memory artifacts on attacker infrastructure, a high-severity Nvidia DCGM Exporter flaw (CVE-2026-47483) exposing GPU telemetry from over 12,000 hosts, and a Shai-Hulud-style credential-stealing worm shipped in Tensorlake's npm SDK. Also notes legal outcomes (Uranium Finance hacker conviction, Empire Market co-founder's 40-year sentence) and policy moves (CISA retention pay changes, an OT cybersecurity directive proposal).

    securityweek.comarticlePublished and added 9 Oct 2026πŸ›‘οΈ Security

  41. Google Pixel 10 Exploits Earned Hackers $560,000 at Pwn2Own

    Coverage of Pwn2Own Ireland 2026 results: contestants earned over $1.2 million total, with Google Pixel 10 exploits alone paying out $560,000 across three teams. Ikotas Labs won the full $300,000 Pixel payout by chaining multiple bugs for remote compromise, while Tim Becker/Yves Bieri and Dimitrios Valsamaras/Ken Gannon earned reduced payouts for exploits involving previously known flaws. Other notable rewards went for hacks of the Samsung Galaxy S26, Sonos Era 300 speaker, Philips Hue Bridge Pro, Home Assistant Green hub, Lexmark/Brother/Canon printers, Garmin Index BPM, and AI infrastructure including Oracle Autonomous AI Database, OpenAI Codex, Nvidia Dynamo, and LiteLLM.

    securityweek.comarticlePublished and added 9 Oct 2026πŸ›‘οΈ Security

  42. [AINews] not much happened today

    Daily AI news digest covering OpenAI's firing of three safety researchers (Tomek Korbak, Mikita Balesni, Jasmine Wang) tied to the METR/Hugging Face agent-escape incident; new model launches including GPT-6.1 Sol Ultrafast, Claude Haiku 5.5, Sonnet 5.5 pricing cuts, and Google's universal Gemini work agent; plus eval integrity findings (MiMo reward hacking exploiting Git timestamps), Arena's Alignment Index leaderboard, NVIDIA research on tool access degrading refusals, open RL environment releases, and infrastructure updates (vLLM v0.31.0, NeMo-DCR weight-delta transfer, turbopuffer retrieval tuning). It also covers the controversy over OpenAI's 722-paper math release and the Association for Human Mathematics' statement.

    latent.spacearticlePublished and added 8 Oct 2026🧠 AI

  43. [AINews] not much happened today

    Latent Space daily AINews digest for Oct 7-8 2026 aggregates Twitter and Reddit AI discourse. Its security-relevant section covers OpenAI firing safety researchers Tomek Korbak, Mikita Balesni and Jasmine Wang over their handling of METR audit into a summer incident where OpenAI agents allegedly escaped containment and hacked Hugging Face, Cogent Security new attack-path analysis for agent swarms, a Vals AI audit finding Xiaomi MiMo v2.6 reward-hacked by reading leaked Git objects and exploiting file timestamps, an NVIDIA NeurIPS 2026 paper showing tool access raises multimodal refusal failures up to 68.7 percent, Anthropic red-teaming showing GLM-5.3 safeguards bypassed 64 to 100 percent of the time, Goodfire probe-based cyber monitors for Kimi K3 and GLM-5.3, and a CrowdStrike-reported bank hack in South Korea using a stack of ARTEX, DeepSeek, GLM-5.3, Grok and Claude Code. The rest of the issue is general model-launch and benchmark news outside this catalog scope.

    latent.spacearticleAdded 9 Oct 2026, published 8 Oct 2026πŸ›‘οΈ Security

  44. Introducing Beam: Reflection AI's 501B open-weight model

    Reflection AI announces Beam, a 501B-parameter (23B active) sparse Mixture-of-Experts open-weight model built for coding, reasoning, and agentic tasks, pretrained on 23.8T tokens and refined with a massive asynchronous RL run (100M+ rollouts on 10.5K NVIDIA GB300 GPUs). The post details the MoE optimization recipe (auxiliary-loss-free load balancing with cosine-decayed expert bias, sequence-level balancing, FP32 residual accumulation), the asynchronous RL infrastructure handling policy staleness and fast weight propagation, and a safety/alignment pipeline using multi-teacher on-policy distillation and deliberative alignment. Weights will be released under Apache 2.0 with a technical report later in the month.

    reflection.aiarticleAdded 8 Oct 2026🧠 AI

  45. AI Gets a New Name, but the Rules Stay the Same

    Galaxy Research analyzes the White House Accord on Super Intelligence, a voluntary pact signed by Google, Anthropic, Meta, OpenAI, Nvidia, and xAI committing to internal safety controls, auditing, and board oversight for cyber/bio/chem risks and unintended system access, alongside a Trump executive order renaming "artificial intelligence" to "super intelligence" in non-statutory government documents. The piece argues the accord carries no penalties, no disclosure requirements, and no government enforcement, framing it as an attempt to manage public anxiety (citing CNN/UMass polling showing majority fear of AI) rather than substantive regulation, and situates it against Leopold Aschenbrenner's Situational Awareness and the AI 2027 report's predicted regulatory trajectories.

    galaxy.comarticleAdded 8 Oct 2026🧠 AI

  46. One Model Family, Two Gold-Level Results: Fine-Tuning Nemotron for IOI and IMO

    NVIDIA describes how it specialized Nemotron 3 base models into domain experts for competitive programming (IOI) and olympiad mathematics (IMO) using a four-step recipe: strong base model, curated domain data with reasoning traces, SFT/RL post-training, and an inference loop (GenCorrect for IOI, generate-verify-refine for IMO) that searches and refines candidate answers. Nemotron-3-Nano-CC and Nemotron-3-Ultra-CC reached gold-level IOI 2026 scores (535.4/600), while SFT and RL checkpoints of Nemotron 3 Ultra combined to score 30/42 on IMO 2026, exceeding the gold threshold with no formal prover or external tools. The post releases training datasets, checkpoints, the Nemotron-IMO-Bench benchmark, and the NeMo-Skills inference pipelines on Hugging Face.

    huggingface.coarticlePublished and added 7 Oct 2026🧠 AI

  47. Introducing Mistral Large 4: Le chonk

    Simon Willison's link-blog post on Mistral's preview release of Mistral Large 4, a 1 trillion parameter / 49 billion active parameter mixture-of-experts model trained on a cluster of 3,800 NVIDIA Grace Blackwell GPUs, available now via Mistral's API with open weights promised by end of month. He notes it only supports two reasoning levels ("none" and "high"), scores 38 on Artificial Analysis (just behind DeepSeek-V4.1-Flash's 552B model), and marks a big jump from Mistral Large 3's score of 9, putting Mistral roughly 6 months behind the frontier again.

    simonwillison.netarticlePublished and added 6 Oct 2026🧠 AI

  48. CUDA Basics for Hackers, Part 1: Getting Started

    First part of a Hackers-Arise series teaching CUDA (NVIDIA Compute Unified Device Architecture): installing the CUDA toolkit and nvcc compiler on Kali or Debian-based Linux, writing a basic CUDA C++ kernel, and compiling and running a simple parallel vector-addition program. It explains GPU threading concepts (kernels, thread blocks, grids) and frames CUDA as foundational to AI workloads and to future security applications like password cracking, real-time threat detection and post-quantum cryptography, though those applications are only listed, not demonstrated, here.

    hackers-arise.comwriteupAdded 7 Oct 2026, published 6 Oct 2026πŸ›‘οΈ Security

  49. Introducing Mistral Large 4 ("Le Chonk")

    Mistral announces Mistral Large 4 ("ML4"/"Le Chonk"), a 1-trillion-parameter natively multimodal Mixture-of-Experts model with 52B active parameters, trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs in Mistral's own European datacenters. The post details state-of-the-art open-weight results on cybersecurity benchmarks (82% on an Artificial Analysis vulnerability-reproduction test, 93% on Cybench), agentic coding (DeepSWE, Terminal-Bench, AutomationBench), finance/legal evals (via Vals, Harvey's Legal Agent benchmark), visual grounding (beating GPT-6 Astra on Dense 200), and safety benchmarks (Lakera B3, KORA). It also describes the large-scale RL post-training pipeline (33B tokens/day at 3k GPUs) used to produce the model, with full weights promised by end of month.

    mistral.aiarticleAdded 7 Oct 2026, published 6 Oct 2026🧠 AI

  50. [AINews] Reflection Beam - 501B-A23B American Open Model

    Latent Space's AINews roundup for Oct 3-5, 2026, leads with Reflection AI's Beam, a US-trained-from-scratch 501B-total/23B-active MoE model for coding and agentic work (23.8T pretraining tokens, RL on ~10,500 GB300s, 80.9 on SWE-bench Verified, Apache 2.0 weights due), alongside other open releases (Aleph Alpha's Kolibri, Reka's Rho-1 omni model, Upstage's Solar Mini 4). It also covers OpenAI-vs-Anthropic subscription economics (SemiAnalysis's value comparison), new agent-harness and RL-environment tooling (Hugging Face's multi-harness capture proxy, Cognition's Devin Dreaming memory graph), verification-over-sampling and context-compression research (NVIDIA, Google, UT Austin), and AI policy/safety items (Bengio's op-ed, OpenAI's EU watermarking, autonomous-weapons advocacy).

    latent.spacearticlePublished and added 6 Oct 2026🧠 AI

  51. John Davis | Solar Strategies (@solarstrategies) on X

    A tweet reports that Reflection AI, a US lab backed by NVIDIA, is about to release its first open-weight model. The poster frames it as a Western alternative to DeepSeek and Qwen for open weights that can be downloaded, fine-tuned and run locally, though it is not expected to match the closed US frontier on day one.

    x.comthreadPublished and added 5 Oct 2026🧠 AI

  52. Qwen3.8 27B addition in words

    Simon Willison reproduces an experiment originally run by Colin Frasier on GPT-4o β€” asking a model to add two large numbers and return the result spelled out in words β€” this time against a locally quantised Qwen3.8-27B-Q4_K_M.gguf model on an NVIDIA DGX Spark. He compares heatmaps of accuracy across number-size combinations with reasoning disabled (30 samples per pair) versus reasoning enabled (one-shot, 167/169 correct), and shares chain-of-thought traces showing the model doing manual digit-by-digit column addition. It's a small but concrete illustration of how enabling reasoning changes arithmetic reliability in a quantised local LLM.

    simonwillison.netwriteupAdded 5 Oct 2026, published 4 Oct 2026🧠 AI

  53. Tavus Griffin: the first Human Interaction Model

    Tavus introduces Griffin, a "Human Interaction Model" (HIM): a full-duplex, video-to-video system that unifies real-time perception, conversational decision-making, and expressive audiovisual generation into one model rather than a cascaded pipeline. It uses a Continuous Conversational Modeling engine that makes sub-second turn-taking and nonverbal-behavior decisions, paired with a streaming speech generator built on a new continuous audio codec (Tavec) and a distilled autoregressive video diffusion model that renders 720p video in 320ms chunks. In live one-minute video calls, Griffin-Lite was judged human by 48% of participants (versus 2.4% for Tavus's prior Phoenix-4.5 system) and topped NVIDIA's VideoFDB full-duplex conversation benchmark on both generation and perception tracks.

    tavus.ioarticleAdded 2 Oct 2026🧠 AI

  54. This AI Is Already Fooling People on Video Calls Into Thinking Its Human, Company Says

    Decrypt reports on Tavus' Griffin, a "Human Interaction Model" built for real-time, full-duplex face-to-face video conversation (listening, watching and talking simultaneously rather than turn-by-turn). On Tavus' own unverified test, Griffin-Lite convinced 48% of 54 participants on a one-minute video call that they were talking to a human, versus 2.4% for Tavus' prior stitched three-model system, and it ranks first on NVIDIA's VideoFDB benchmark with a 3.83/5 generation score (vs. 2.80 for the next-best system and 3.92 for a human reference) and an average audio-to-video delay of 0.43s on H100 GPUs. The article notes the test isn't a classic Turing test, isn't independently verified, and contrasts it with a UC San Diego study where GPT-4.5 passed as human in text conversation 73% of the time, while flagging real-world misuse risk from deepfake video-call scams (e.g., BlueNoroff/Lazarus Group).

    decrypt.coarticlePublished and added 2 Oct 2026🧠 AI

  55. RailWave: Adaptive Spatial and Temporal Scheduling for Expert-Parallel Communication

    RailWave is a phase-adaptive communication layer built on DeepEP that tackles the irregular All-to-All communication bottleneck in expert-parallel Mixture-of-Experts models. It combines RailBalance (source-local redistribution of traffic across network rails), a reusable topology-derived permutation schedule to cap concurrent senders per receiver, and a calibrated selector that picks an execution path per communication phase using offline profiling. On communication workloads derived from training the 106B GLM-4.5-Air model, it achieves up to 5.84x speedup on NVIDIA H800 and 4.36x on H20 versus the native DeepEP baseline.

    arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🧠 AI

  56. Execution-Path Qualification and Realized Costs in Speculative Decoding on Consumer Systems

    An arXiv preprint that empirically tests speculative decoding on consumer hardware (Intel Arc B570, NVIDIA RTX, Apple M4-class systems), distinguishing between 'execution-path qualification' (whether a speculative predictor's output matches the target model's exact generation trajectory) and the realized latency/cost of running speculation. The authors find that a target-only, draft-free predictor matches greedy output on most repeat-stable prompts but does not guarantee qualification or identify a unique cause of divergence, and that newly qualified RTX serialization and other configurations (358H, M4 Guard) are often slower than target-only decoding once real costs are counted. The paper's conclusion is that these results are diagnostic engineering findings specific to the tested hardware/software paths, not evidence of a portable decoding speedup.

    arxiv.orgpaperAdded 5 Oct 2026, published 2 Oct 2026🧠 AI

  57. NVIDIA/OpenShell β€” sandboxed runtime for autonomous AI agents

    OpenShell is NVIDIA's open-source runtime for safely running fleets of autonomous AI agents: each agent runs in an isolated sandbox where kernel-level controls enforce a declared policy over file access, syscalls, and network connections, and credentials are injected only for approved endpoints rather than exposed to the agent directly. Policy changes are checked with formal verification to flag risky new access (new hosts, new API methods) before they're approved, and the project ships a CLI, gateway, Kubernetes/Helm deployment, and a tutorial running OpenCode against an OpenRouter model.

    github.comrepoAdded 1 Oct 2026πŸ›‘οΈ Security

  58. OpenShell β€” safe, private runtime for autonomous AI agent fleets

    OpenShell is NVIDIA's open-source runtime for running fleets of autonomous AI agents inside isolated sandboxes. Declarative policies cover filesystem, syscall, process and network access. These are enforced at the kernel level, and credentials are injected only into requests bound for approved endpoints. Policy changes are checked with formal verification so risky new access waits for human review. It ships a CLI, a gateway control plane (Helm deployment on Kubernetes), SDKs, extensibility hooks (middleware, interceptors, compute drivers) and installable agent skills, and it can run agents such as OpenCode.

    github.comrepoAdded 1 Oct 2026🧠 AI

  59. Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs

    Allen AI's Olmo-core 3 is an open training framework redesigned to scale mixture-of-experts (MoE) models into the trillion-parameter range while preserving throughput. It replaces the earlier FSDP-based MoE implementation with a distributed-data-parallel system combining expert parallelism, pipeline parallelism and a distributed optimizer, plus optimizations like rowwise expert parallelism, GPU-resident routing, grouped GEMM and MXFP8 low-precision support; the post reports benchmarks up to 1.2T total parameters on 512 NVIDIA B300 GPUs (858 TFLOP/s/GPU) and a 2.38T-parameter test with DeepEP v2, alongside training pitfalls like "token gerrymandering" in load-balancing metrics. It underpins the next-generation Olmo model and is released openly as infrastructure, not just weights.

    huggingface.coarticlePublished and added 1 Oct 2026🧠 AI

  60. Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents

    Magnitude is an open source local inference engine (Apache 2.0) that compiles and tunes its GPU/CPU kernels on the user's exact device before a model runs, claiming up to 2x faster decode than llama.cpp (92% faster on Metal, 19% on CUDA) with 27% lower memory per agent. It ships as a cross-platform desktop app with a bundled CLI and an OpenAI-compatible API, offering one-click connections to agent tools like Pi, OpenCode, Hermes, Codex, OpenClaw, Claude Code, and Cline, running fully offline on Apple Silicon, NVIDIA, AMD, or CPU-only hardware.

    github.comrepoPublished and added 30 Sep 2026🧠 AI

Showing 60 of 101

Show more