Skip to content

🧩 LLM Apps & RAG110

What you seeeverything
  1. Show HN: Overtone – Transcribe, correct and cut captions for any screen shape

    Overtone is a caption format (.overtone.json), a CLI and a video.js plugin that store each spoken word once and cut captions separately per screen shape (16:9, 9:16 or custom). The transcribe pipeline combines gpt-transcribe, Azure AI Speech and optional ElevenLabs Scribe, resolves disagreements with an LLM vote, and uses an LLM editor for corrections. A small public benchmark reports 5.3% word error rate and $0.023–0.025 per audio minute.

    github.comrepoAdded 30 Oct 2026, published 29 Oct 2026

  2. Glance: The Generator Is Its Own Reranker

    Glance is a RAG method in which the generator also reranks. It adds a lightweight decision adapter and pointer head that score candidate passages from one shared prefill, so a single resident 9B backbone does generation and reranking. After 39 minutes of MS MARCO fine-tuning it reaches nDCG@10 of 0.741 on SciFact and 0.345 on NFCorpus, against 0.721 and 0.326 for bge-reranker-v2-m3. On 300 HotpotQA questions it improves answer F1 by 0.045 over cross-encoder-selected context. Evaluation covers two retrieval datasets, one QA dataset and one backbone family.

    arxiv.orgpaperAdded 31 Oct 2026, published 29 Oct 2026

  3. Retrieving from Your Own Mistakes: On-Policy Training of Embedding Models for Multi-Hop Retrieval-Augmented Generation

    On-policy state training is a method for training chain embedding retrievers for multi-hop RAG on the states the encoder itself reaches, including those built on its own wrong retrievals. Each state is labeled with the earliest missing gold passage, other missing gold passages are masked, and updates are contrastive and mixed with teacher-forced states. It retrieves complete evidence more often than teacher-forced training and graph-based systems, and transfers to harder long-chain HotpotQA and 2WikiMultiHopQA variants the authors built.

    arxiv.orgpaperAdded 31 Oct 2026, published 29 Oct 2026

  4. Decompose, Estimate, Select: Coverage-Aware Context Construction for Long-Form RAG

    Decompose, Estimate, Select is a coverage-aware retrieval pipeline for long-form RAG. It splits a query into subquestions, ranks candidates with a coverage-trained bi-encoder, predicts a document-by-subquestion coverage matrix with a cross-encoder, and picks documents by greedy maximum-marginal coverage. On TREC RAG 2024, α-nDCG@10 rises from 0.625 to 0.702 (gold-nugget bound 0.718). A grounded self-feedback loop raises V_strict by 0.086 over two passes.

    arxiv.orgpaperAdded 31 Oct 2026, published 29 Oct 2026

  5. TCC-RAG: Temporal Causal Chain-Guided RAG for Temporal Knowledge Graph Question Answering

    TCC-RAG is a retrieval-augmented generation method for temporal knowledge graph question answering (TKGQA). It turns the temporal knowledge graph into a multi-view causal cue graph, builds a query-specific temporal causal chain to guide retrieval, and applies a causal evidence filter to the results. The authors report gains of 10.72% and 8.40% on two TKGQA benchmarks and 62.97% on multi-step temporal reasoning.

    arxiv.orgpaperAdded 30 Oct 2026, published 28 Oct 2026

  6. Early progress on accelerating drug development with Claude

    Anthropic's life sciences update describes research partnerships with six drug developers (BigHat, Bristol Myers Squibb, Divergence Labs, Enveda, Generate Biomedicines, The Column Group) and its own Mithril Medicine programs. Reported results include about 35,000 antibody designs in a month, 1,010 lead variants tested in 10 weeks, and an 89% cut in manufacturing-document review time. Work is mostly preclinical.

    anthropic.comarticleAdded 28 Oct 2026, published 27 Oct 2026

  7. Statistical Detection of Positional Bias in LLM-Based Recommender Systems: Methodologies and Empirical Evidence

    The paper proposes POB-ICM (contingency matrix with Chi-square independence testing) and POB-UNBP (a uniformity null model under permutation-based evaluation) to detect positional bias in top-1, single-turn LLM recommenders. On a RAG product-recommendation testbed with 2000 queries and 20 permutations each (40,000 instances), both methods reject positional independence in all evaluated models. Three metrics quantify the effect, and the bias persists across candidate-set size and temperature. Code is public.

    arxiv.orgpaperAdded 30 Oct 2026, published 27 Oct 2026

  8. Survival LLM: AI assistant and emergency library that runs on your own computer

    Survival LLM is a free, open-source desktop app for macOS (Apple Silicon) and 64-bit Windows that runs an AI model and an offline emergency library on the user's computer. It checks the machine's memory, downloads a fitting model, and answers from sources such as Wikipedia, WikiMed, Ready.gov and CDC guidance, citing each article. Users can add their own files; version 0.3.2 is dated October 2026.

    brangus.iotoolAdded 28 Oct 2026, published 27 Oct 2026

  9. When Is Additional Retrieval Worthwhile? A Cost-Aware Study of Evidence Gain and Answer Reliability in RAG

    This paper studies a cost-aware, two-action RAG routing policy that chooses between dense retrieval plus reranking and a hybrid lexical-dense retriever, using a regularized linear model to predict per-question evidence gain. On 60 held-out QASPER articles (188 questions), it triggers hybrid retrieval on 24.5% of questions and matches always-hybrid Hit@10 (78.70%). Answers from 4-bit Qwen3-4B show no clear correctness or faithfulness gain, and the assessments are model-assisted.

    arxiv.orgpaperAdded 28 Oct 2026, published 27 Oct 2026

  10. Tessera: Structure-Completed Evidence Units for Web Retrieval-Augmented Generation

    Tessera is a training-free evidence delivery layer for web retrieval-augmented generation. It rebuilds retrieved pages' HTML into fine-grained evidence units, each completed with page title, section path and table headers, then packs the relevant units into the reader context at the same token budget. Tracing evidence over full English Wikipedia shows chunking loses table and infobox content. Tessera adds 5 to 6 accuracy points on three QA benchmarks and carries over to agentic search.

    arxiv.orgpaperAdded 28 Oct 2026, published 27 Oct 2026

  11. p-DCIM: A 28nm Probabilistic SRAM DCIM based Ising Machine for Near-Memory Context Selection in LLM-RAG Pipeline

    p-DCIM is a 28 nm SRAM digital compute-in-memory macro (0.16 mm2, 0.41 mW) that works as an Ising machine for RAG evidence selection. Selection is cast as a QUBO problem, and the same MAC datapath computes embedding similarities and annealing steps. Replacing LLM reranking with it gives a selection-energy estimate over six orders of magnitude lower and cuts total energy per query by 67%, with comparable token-level F1 on the evaluated examples.

    arxiv.orgpaperAdded 28 Oct 2026, published 27 Oct 2026

  12. Show HN: Hob - Open-source, on device alternative to Claude Cowork and ChatGPT

    Hob is an MIT-licensed desktop app from Frigade that runs open-weight models such as Gemma and gpt-oss locally on Mac, Windows and Linux. It picks the best open-weight model that fits the user's computer and sets it up. It is positioned as a free, private, offline alternative to Claude and ChatGPT for tasks like filling out PDFs and working through documents. The page gives no technical detail on its runtime.

    github.comrepoAdded 27 Oct 2026, published 26 Oct 2026

  13. Reversible Pseudonymisation of Documents Sent to External LLMs: an Open Bilingual Benchmark and an Engine

    This paper presents an open benchmark of five existing pseudonymisation tools and a regex baseline on Russian and UK English documents, plus an open engine built on the two strongest tools. On a held-out set of 1,000 synthetic documents per language, the best existing tools leave a whole value visible in 58 to 61% of documents. The engine does so in 0.2 to 0.3%. Russian name restoration reaches only 94.6%, below the 99% threshold. Real documents were not tested.

    arxiv.orgpaperAdded 27 Oct 2026, published 25 Oct 2026

  14. HerHealthGPT: An Evidence-Grounded Conversational AI System for Women's Reproductive Health Copy title

    HerHealthGPT is a conversational AI system for women's reproductive health that combines retrieval-augmented generation, context-aware clarification and source validation in a web interface. Evidence retrieval raises concern-category accuracy from 54.1% to 59.3% over fine-tuning alone on 540 messages from 90 cases. The clarification router reaches 85.6% recall and 86.2% specificity. In a 30-adult study, 83.3% preferred the retrieval-enabled version. The authors say clinical validation is still needed.

    arxiv.orgpaperAdded 27 Oct 2026, published 24 Oct 2026

  15. DRILS: Dependency-based Requirement Change Impact Analysis Using LLMs

    DRILS is an LLM-based agentic framework for requirements change impact analysis. It uses multiple agents to generate candidate impact sets, with an LLM-as-a-judge promoting diversity in selection. It adds RE-RAG, a tuned retrieval technique, and a requirement dependency graph as a knowledge source. On three curated datasets it reaches 87.1% recall, 76.3% precision and 81% F1 at lower cost than baselines. The authors release the datasets.

    arxiv.orgpaperAdded 27 Oct 2026, published 24 Oct 2026

  16. Big Bull (@BIGBULLapp) on X

    5ire is a desktop AI assistant and MCP client that connects to OpenAI, Anthropic, Google, Mistral, Grok, DeepSeek and Ollama from one window. It has a local knowledge base and tool calls over Model Context Protocol. The tools feature needs Python, Node and uv installed because it runs a local MCP server; without them it works only as a chat client.

    x.comthreadAdded 25 Oct 2026, published 24 Oct 2026

  17. TriageRAG: Failure-Aware Self-Training for Adapting Retrieval-Augmented Language Models to Specialized Domains

    TriageRAG is a failure-aware self-training method for adapting retrieval-augmented LLMs to specialized domains using only an unlabeled corpus. It probes the student on self-generated questions with and without retrieved context, sorts them into known, solved, context-failure and retrieval-failure, and routes each to a matching training signal. With Qwen3-4B on 11 datasets it beats budget-matched SimRAG by 1.2-6.4 points and recovers closed-book accuracy where retrieval hurts.

    arxiv.orgpaperAdded 27 Oct 2026, published 24 Oct 2026

  18. LitPivot: Developing research ideas through dynamic contextualization within the literature landscape

    LitPivot is a system from Ai2 and the University of Pennsylvania that helps researchers revise early research ideas when reading prior work changes their direction. It splits a proposal into problem, contribution and evaluation facets, groups papers from Asta Paper Finder per facet, and offers critiques with supporting excerpts and suggested rewrites. In a 17-researcher study, domain experts rated LitPivot ideas as better grounded in the literature than ideas made with a text editor and an AI chat tool.

    huggingface.coarticlePublished and added 23 Oct 2026

  19. Semantically Rich, Metrically Affect-Blind: A Geometric Blind Spot in Modern Text Embedders

    Sentiment-Injected Sentence Embeddings (SISE) addresses a finding across eleven frozen text encoders (2021 to 2026): linear probes recover sentence polarity at up to 91.3% accuracy, but cosine similarity separates polarity by only 0.003-0.064. A small supervised-contrastive head (0.13M-0.69M parameters) trained on CPU raises retrieval MAP by up to 26 points, but the 128-d head loses 38-41 STS-B Spearman points. The paper also releases the Attribute Alignment Gap diagnostic.

    arxiv.orgpaperAdded 26 Oct 2026, published 23 Oct 2026

  20. Build more responsive apps with the Decisions API

    The Decisions API is an OpenAI endpoint, built on GPT-6 Luna, that answers bounded questions about text, images or native JSON inputs, up to 10x faster than Luna through the Responses API. It returns a probability (predicate), a choice or a score. It is generally available, accepts up to 400 questions per request, and costs $0.10 per million input tokens with no output charges.

    openai.comarticlePublished and added 22 Oct 2026

  21. How Ground Truth Shapes Retrieval Scores: Evidence-Aware Evaluation of a Retrieval-Augmented Generation System for Breast Lesions

    This paper describes an evidence-aware retrieval evaluation protocol for a clinical RAG system over breast lesion management literature. Relevance is defined by evidence spans mapped to all containing chunks. A hybrid retriever (dense, BM25, cross-encoder reranking) with 384-token chunks and 20% overlap reached 0.94 Recall@3 on 18 queries. Expanding ground truth from 25 to 37 spans did not change rankings. The authors note the small set needs independent validation.

    arxiv.orgpaperAdded 24 Oct 2026, published 22 Oct 2026

  22. From Structured Records to Patient Narratives: Preserving Clinical Alignment in LLM-Generated Health Summaries

    This paper studies evidence-grounded health summarization for menstrual health monitoring. It combines structured evidence conditioning with RAG in a prompt-based constrained generation framework, and scores 4,500 summaries from three LLMs with NLI, atomic factuality metrics and readability measures. Grounding constraints improved uncertainty preservation and generally kept or improved faithfulness against retrieved evidence, while omission effects varied by model. Clinical alignment came with harder reading and more medical terminology.

    arxiv.orgpaperAdded 24 Oct 2026, published 22 Oct 2026

  23. You are the Team — Anekha Sokhal, Moshi

    Latent Space interview with Anekha Sokhal, CEO of Moshi, recorded at AI Engineer New York. Moshi is a market-intelligence product for commodity and energy traders. It ingests structured and unstructured data, builds an ontology and graph, and pushes recommendations to each trader's book. She covers confidence scoring across divergent sources, an in-house vision-language model for messy PDFs, and build-versus-buy tradeoffs.

    latent.spacetalkAdded 23 Oct 2026, published 22 Oct 2026

  24. The Recommendation Engine for Commodity Traders — Anekha Sokhal, Moshi

    Latent Space podcast episode recorded at AI Engineer New York, in which Moshi CEO Anekha Sokhal, a former JPMorgan energy derivatives trader, describes a recommendation engine for commodity traders. Moshi ingests structured and unstructured market data plus private user data, tags it into a graph ontology and pushes items relevant to a trader's book. She covers confidence scores across divergent sources, an in-house vision-language model for messy PDFs, and build versus buy.

    latent.spacetalkPublished and added 22 Oct 2026

  25. You are the Team — Anekha Sokhal, Moshi

    Latent Space interview with Anekha Sokhal, CEO of Moshi, recorded at AI Engineer New York. Moshi is a recommendation engine for commodity and energy traders that ingests structured data, news, X posts, podcasts and private user documents into a graph. Topics include confidence scores for divergent sources, a self-built vision-language model for PDFs, build versus buy, and engineers told "you are the team".

    latent.spacetalkPublished and added 22 Oct 2026

  26. Chunk Recomputation under Real Document Revisions: Measuring Update Cost and Retrieval Quality of Fixed, Recursive, and Content-Defined Chunking

    Chunk Recomputation under Real Document Revisions measures how much text must be re-embedded after edits for three stateless chunkers (non-overlapping fixed-size, recursive paragraph-first, content-defined) on 120 pairs of adjacent Chinese and English Wikipedia revisions. Fixed-size recomputes 57-68% of the new-version workload, recursive 38-56%, content-defined 43-54%, while evidence recall at a 2048-token budget differs by under two points. The authors argue update cost should be reported alongside retrieval quality.

    arxiv.orgpaperAdded 24 Oct 2026, published 22 Oct 2026

  27. OpenAI CLI

    OpenAI CLI is OpenAI's official Go command-line client for the REST API. It lets users generate images, upload and download files, create and wait on batches, call the Responses API, and query admin usage endpoints from a terminal or shell script. It supports JSON, JSONL and YAML output, GJSON transforms, shell completion, and install via Homebrew, go install or release binaries.

    github.comrepoAdded 23 Oct 2026, published 22 Oct 2026

  28. SpyTech Ai (@RizeOnline) on X

    XiaoZhi ESP32 is an open-source, MIT-licensed firmware stack that turns ESP32 boards into MCP-based voice chatbots using models such as Qwen and DeepSeek. It streams Opus audio over WebSocket or MQTT + UDP through ASR, LLM and TTS, adds offline ESP-SR wake words, and uses device-side MCP to drive speakers, LEDs, servos and GPIO. It supports 138 board directories and builds with ESP-IDF 6.0.1 or newer.

    x.comthreadAdded 23 Oct 2026, published 21 Oct 2026

  29. How we built ChatGPT’s novel ad stack for user trust and relevance

    OpenAI's ChatGPT ad stack uses a custom post-trained LLM, the orchestrator, that makes tool calls for retrieval, filtering, scoring and auction nomination across stateful ad sessions. Ad selection runs in a separate service from answer generation, so ads cannot influence responses or delay them. The post covers ANN retrieval, a model-generated preamble, delivery versus impression, logging, and model-based evaluation.

    openai.comarticlePublished and added 21 Oct 2026

  30. Protection Is Not One Event: A Survey of RAG Protection Research by Measured Endpoint

    Protection Is Not One Event is a survey and human-coded evidence map of 118 RAG defense papers, grouped by measured endpoint into a seven-family taxonomy (kappa=0.867 across 32 annotators). It finds that only 17.8% of studies use content disclosure as their primary endpoint, and that most evaluations use general QA data and non-adaptive attacks. In a testbed on Qwen3-8B, an 8-gram guard cut copying to 0.0%, yet a three-query adaptive attacker still recovered 48.3% of hidden facts. Taxonomy, dataset, coding protocols and testbed are released.

    arxiv.orgpaperAdded 24 Oct 2026, published 21 Oct 2026

  31. 0xMarioNawfal - The Roundtable Show (@RoundtableSpace) on X

    Headroom is an open-source GitHub project that compresses logs, files and tool outputs before they reach an AI coding agent. The tweet by RoundtableSpace claims up to 95% fewer tokens for JSON and about 20% fewer overall, with the same answers and lower API bills. The tweet gives no method or benchmarks, and the repo link is truncated.

    x.comthreadAdded 21 Oct 2026, published 20 Oct 2026

  32. DeclineCraft: A RAG Abstention Benchmark for Jointly Measuring Combined Retrieval and Parametric Knowledge

    DeclineCraft is a dynamic RAG abstention benchmark whose unanswerable questions target Minecraft feature additions made after a corpus cut-off, with audits for parametric exposure. Across 27 LLMs, single-shot retrieval raises Correct Abstention Rate in 38 of 40 configurations, while iterative RAG lowers it in 30 of 40. Enabling thinking without retrieval lowers abstention for 8 of 13 models, shifting responses to premise denial.

    arxiv.orgpaperAdded 22 Oct 2026, published 20 Oct 2026

  33. A Multimodal Engineering GraphRAG Framework for Post-Wind-Event Building Assessment and Recovery Inference

    This paper presents a multimodal engineering GraphRAG framework that links post-wind-event damage evidence from images and reconnaissance reports to building-condition states, recovery actions and downtime. Evidence is stored as a provenance-preserving, component-level representation, and graph-aligned retrieval uses compatibility, contradiction, evidence-precedence and abstention checks. Demonstrated on tornado-affected low-rise homes, it beats BaselineRAG and Structured Baseline RAG, and ablations test each component.

    arxiv.orgpaperAdded 22 Oct 2026, published 20 Oct 2026

  34. Publish fake stats, get cited in LLMs

    StateGlobe is an experiment in which a Peec AI researcher generated 50,000 fake statistics pages with GPT-4.1 for about $50. After 7 months, Google had deindexed the site, but ChatGPT-User still made about 72,000 requests in 30 days. The site drew 10,000+ ChatGPT sessions and 330+ referring domains, and its numbers were cited in an academic paper and bank research. The post explains why retrieval differs from ranking and how to build real statistics pages.

    peec.aiwriteupAdded 21 Oct 2026, published 20 Oct 2026

  35. AnyLanguageModel 1.0: One Year of Local Models on Apple Platforms

    AnyLanguageModel 1.0 is a Swift package that gives apps Apple's Foundation Models API across the system model, llama.cpp, MLX, Core ML and hosted providers. This release post covers tool calling and guided generation on every provider, image input, and hosted support for OpenAI, Anthropic, Gemini, Ollama and Hugging Face Inference Providers. It also ships swift-huggingface 1.0 and swift-xet 1.0, and lists small open-weight models that fit on iPhone and Mac.

    huggingface.coarticlePublished and added 20 Oct 2026

  36. Introducing Clairic, a new System One class of extraction models

    Clairic is Cloudflare's preview System One extraction model, hosted on Workers AI as @cf/cloudflare/clairic, with open weights planned. It reads text or images in one forward pass and returns typed values with spans, confidence, p_null, 80% intervals for estimates and forecasts. A claim-handling cascade with Clef and GLM-5.3 ran in 19.3 seconds against 61.7 for an all-LLM version.

    blog.cloudflare.comarticleAdded 29 Oct 2026, published 19 Oct 2026

  37. EpiLens: Lightweight RAG for Epidemiological Knowledge Acquisition

    EpiLens is a lightweight, open-source retrieval-augmented generation package that applies a fixed retrieval template and output schema to every paper in a corpus and links outputs to source passages. On a corpus of 2,297 epidemiology papers, its classifier matches or exceeds supervised and zero-shot baselines on four tasks without task-specific training data, scored against 214 manual labels. It also compares model-based study shares across parameters and pathogens.

    arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026

  38. Large-Scale Biomedical RAG: Corpus Scaling, Document Representation, and Efficiency Trade-offs

    This paper is a controlled, large-scale evaluation of biomedical Retrieval-Augmented Generation across growing corpus sizes. It compares abstract, flat full-text and hierarchical full-text representations, with and without reranking, on multiple-choice QA over five external benchmarks and a held-out test set. RAG gave mean gains of up to 9.6 points externally and 10.2-30.3 points on the held-out set. Hierarchical indexing used 67% fewer units and 44-56% less storage than flat full-text.

    arxiv.orgpaperAdded 21 Oct 2026, published 19 Oct 2026

  39. Saylor (@Kev96790724) on X

    G-Krusch is an MIT-licensed, local-first Google Workspace hub built on Node.js 22 and SQLite WAL. It runs a 12-tool MCP server (SSE and Stdio) plus a REST bridge on port 5446 for Drive, Calendar and Gmail. It includes a 1,024-dimension hybrid Drive RAG with an embedding cascade (Ollama bge-large, then Gemini, then offline fallback) and FTS5 BM25. PDF extraction returns page citations. Tokens are kept in an AES-256-GCM vault; 30 of 30 tests pass.

    x.comrepoAdded 21 Oct 2026, published 19 Oct 2026

  40. DeepSeek search and fetch – $0.75 per 1000 successful requests

    DeepSeek Search & Fetch are two JSON APIs for agents and RAG apps. Search (/v1/tools/search) returns structured results from DeepSeek's in-house engine, with count, need_content and operators such as site:, lang: and after:. Fetch (/v1/tools/fetch) returns a page as Markdown. Both use bearer auth, bill only successful requests ($0.75 per 1000), and have account-level QPS limits. Calls from DeepSeek Harness, Claude Code or Codex are free until 1 November 2026.

    api-docs.deepseek.comotherAdded 19 Oct 2026, published 18 Oct 2026

  41. Show HN: Things to Do API

    Things to Do API is a hosted knowledge base of local events (shows, talks, pop-ups, markets, festivals) that you query in natural language, for example `/v1/search?q=comedy+in+san+francisco+this+weekend`. It returns structured JSON with title, category, local start time, venue and ticket and source links. It also exposes an HTTP MCP endpoint, added with `claude mcp add --transport http thingstodo https://api.thingstodoapi.com/mcp`, so agents can use it as a tool. Coverage is live for the San Francisco Bay Area, with New York City and Los Angeles coming. Pricing is pay-as-you-go from $5 per 1,000 calls, the first 1,000 a month are free, and there is a 300 calls/min limit.

    thingstodoapi.comtoolAdded 18 Oct 2026, published 16 Oct 2026

  42. ThetreStageAI: Multi-View Retrieval-Augmented Generation for Structured Bengali Theatre Production Planning

    ThetreStageAI is a retrieval-augmented framework for structured Bengali theatre production planning. It keeps separate scene, actor-blocking and lighting views, embeds Bengali text with BGE-M3, indexes it in view-specific Qdrant collections, and has Gemini generate schema-constrained JSON, with validation and at most one repair attempt. The authors build a synthetic dataset of 500 records (1,500 retrieval documents) and compare single-combined retrieval with multi-view retrieval. Code and data are public.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026

  43. Enhancing RAG-based Medical VQA with Gated Multimodal Representations

    This paper presents a multimodal retrieval-augmented generation framework for Medical Visual Question Answering. A Gated Multimodal Unit learns a joint query representation from the medical image and the clinical question, so evidence retrieval uses both modalities while the Med-LVLM stays frozen. On benchmark datasets it consistently beats a reference Med-LVLM and stays competitive with state-of-the-art methods. The page gives no dataset names or numbers.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026

  44. PrairieFire: Igniting High-Throughput Updates in Large-Scale Approximate Nearest Neighbor Search

    PrairieFire is an SSD-based approximate nearest neighbor search system for billion-scale vectors, built for high update throughput. It uses buffered updates and batched local rebuilds, with cascaded adjustments, concurrency control and CPU-GPU-SSD cooperation. Against state-of-the-art systems it reports about 3-35x update throughput, 3-5x search throughput and 1.5-8.7x cost efficiency. It has run in RedNote production for two months.

    arxiv.orgpaperAdded 20 Oct 2026, published 16 Oct 2026

  45. Private Retrieval Augmented Generation via Random Projection

    Proposes protecting the retrieval datastore in RAG systems by applying the same random projection to datastore embeddings and query embeddings. This provably preserves query-item semantic similarity while substantially mitigating data extraction attacks. Across multiple RAG architectures and datasets it beats prior differential-privacy-based methods on retrieval and generation quality, with comparable empirical privacy under strong attacks, making it a practical baseline for privacy-preserving RAG.

    arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026

  46. Librarian Agents: Training LLMs to Curate Long-Context Workspaces that Anticipate Future Queries

    Introduces Librarian Agents, where a builder agent turns raw unstructured documents into a hierarchical filesystem of synthetic files and reference links, forming a workspace for a downstream answering agent. Workspace construction is cast as a Markov decision process and the builder policy is trained with reinforcement learning to maximize downstream answering accuracy. It beats the strongest retrieval and precomputation baselines by 33 points on BrowseComp-Plus, amortizes construction cost over repeated queries, and generalizes zero-shot to BRIGHT with a 31-point average gain.

    arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026

  47. Multi-sourced AI Tutor for Non-Native English Speaker Students

    Describes a general-purpose LLM-based AI tutor for computing courses that accepts questions in Mandarin and replies bilingually, also generating glossaries of technical terms. It uses a specialized multi-source RAG pipeline with a novel question extraction mechanism to draw on diverse course materials. Evaluated on 91 Piazza posts: 83.52% answered correctly and helpfully, 76.92% of questions got high-quality translations, and 64.47% got glossaries.

    arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026

  48. GACC-Bench: Benchmarking Goal-Adaptive Context Compression Ability across Large Language Models

    GACC-Bench is a benchmark for Goal-Adaptive Context Compression, testing how well LLMs retain goal-relevant information when compressing a source context under a length budget before downstream questions are known. It has 500 goals and 2,571 human-reviewed questions over 281 document and agent-trace contexts from seven collections; a fixed reader answers the withheld questions from the compressed context. Ten LLM compressors show large gaps to full-context performance, especially in answering every question tied to a goal. Target-goal conditioning improves accuracy over goal-agnostic compression, while mismatched goals hurt it.

    arxiv.orgpaperAdded 17 Oct 2026, published 15 Oct 2026

  49. Show HN: Graphicle, a Rust port of Graphify with memory for coding agents

    Graphicle is a local-first Rust program that parses a repository into a tree-sitter code graph (a port of Graphify) and adds project memory: docs, reviewed decisions and captured Claude Code/Codex sessions. It serves cited file-and-line excerpts within a token budget via one MCP server, CLI and browser app, backed by a single SQLite file, with no API key or telemetry. The README reports a code-only extract on Kubernetes (31k files) in 3m18s versus 26m38s for Graphify 0.9.88, and a memory comparison against seven systems. Agent-proposed memories need user approval and go stale when the code they reference changes.

    github.comrepoPublished and added 14 Oct 2026

  50. Legal-R1: Agentic Retrieval for Evidence-Based Legal Reasoning

    Legal-R1 is an agentic retrieval framework for evidence-based legal question answering that splits reasoning across three agents. A Lawyer agent decides when to retrieve, which legal source to query, what evidence to seek and when it has enough. A Legal Assistant retrieves statutes and precedent cases with authority-aware and diversity-aware selection, and a Judge agent writes the final answer from the full evidence trajectory. Only the Lawyer agent is post-trained, using masked supervised fine-tuning and trajectory-aware reinforcement learning. The paper reports gains over general-purpose, legal-specific and retrieval-augmented baselines on several Chinese legal benchmarks.

    arxiv.orgpaperAdded 14 Oct 2026, published 13 Oct 2026

  51. Configuring RAG Systems: What Breaks, Where Originates, and How to Fix

    First large-scale empirical study of RAG configuration issues, covering 654 real-world issues collected from 10 diverse RAG systems. It categorizes symptoms, root causes, affected pipeline stages and fix patterns. It finds that symptoms mostly appear at early or late stages, while the root cause often sits in a different stage from where the symptom shows. It closes with nine actionable insights for testing, localizing and fixing RAG configuration problems.

    arxiv.orgpaperAdded 14 Oct 2026, published 13 Oct 2026

  52. How to engineer an AI harness for game development

    Blog adaptation of an Indie Rodeo talk arguing that LLMs struggle with games because much of a game is opaque non-code, and that this is a context problem. It prescribes concrete architecture so a game becomes its own agent harness: seeded randomness, a single "Thing" fat-struct object model, serializable commands, external data editable without recompiling, a standalone simulation core, odiff image diffing for screenshot evaluation, and samply text profiling. The aim is an agentic loop that runs in seconds per change.

    kylekukshtel.comwriteupPublished and added 13 Oct 2026

  53. AI Agents for Cybersecurity: A Guided Tour of a Repository with Tons of Resources and Examples

    A guided tour of a GitHub repository of resources and examples for building AI agents, published on the Becoming a Hacker blog. Per the routing note, it covers LangChain 1.x, LCEL, RAG, LangGraph, CrewAI, DeepAgents, MCP servers and token-cost control such as caching, routing and budget guards. The fetched page held only a LinkedIn redirect notice, so the article text was not read.

    linkedin.comarticleAdded 13 Oct 2026

  54. santosomar/AI-agents-for-cybersecurity

    Companion repository for Omar Santos's Pearson and O'Reilly trainings and books. It has eight parts of runnable Python labs: chat models, embeddings, prompt templates, LCEL prompt chaining, Chroma-based RAG, ReAct/LangGraph/CrewAI/DeepAgents agents, and FastMCP servers (nmap, CISA KEV, Shodan). It also includes guides to six agentic frameworks (OpenClaw, Hermes, Agent Zero, OpenHands, Paperclip, Buzz), a tokenomics module on agent cost (context compounding, prompt caching, model routing, token budget guards, batch API, cost per accepted outcome), and a vendor-neutral design spec for a human-gated multi-agent assessment harness. It is a current, practical curriculum for building and operating agents. Some examples act on real systems and should only be run in an authorized lab.

    github.comrepoAdded 13 Oct 2026

  55. google/embeddinggemma-2

    Model card for EmbeddingGemma 2, an open (Apache 2.0) 740M-parameter multimodal embedding model from Google DeepMind built on Gemma 4. It maps text, code, images, video and audio into one 768-d space, with a 270M text backbone and optionally loadable 170M vision and 300M audio encoders, an 8K context, and Matryoshka truncation to 128/256/512/768 dims. The card gives practical guidance: task instruction prefixes, re-normalising after truncation, avoiding float16 (NaN or degraded embeddings), interleaved multimodal inputs with placeholder tokens, and vision token budgets. It targets on-device search, RAG, classification and clustering.

    huggingface.corepoAdded 12 Oct 2026

  56. Context Engineering for Application Security | Endor Labs

    Endor Labs whitepaper on using context engineering to make AI coding assistants produce secure code. It covers secure prompting (priming, decomposition, refinement with design-spec and test-first patterns), reusable system rules such as Cursor rules and the CSA R.A.I.L.G.U.A.R.D. framework, and external SAST/SCA tools wired in through MCP servers with a rule that triggers scans. It also covers the costs and risks: extra token use, models ignoring rules, untrusted community rules, and MCP server supply-chain threats. It cites figures such as 62% of AI-generated solutions containing flaws and a 77.5% reduction in weaknesses from recursive prompting.

    endorlabs.comarticlePublished and added 12 Oct 2026

  57. Igor Carron (@IgorCarron) on X

    Igor Carron's tweet highlights LightOn's open-source ColGrep-Agent-2B, a 2B model released on Hugging Face for code search and retrieval that works with Claude Code. LightOn reports 34% fewer API tokens and 40% lower API costs. It matters because usage limits and token costs are a pain point for coding agents. A reply thread in the same post notes quota exhaustion across Grok, Cursor, Devin, Claude and Codex, and argues for quota dashboards.

    x.comthreadPublished and added 12 Oct 2026

  58. bilawalsidhu/gods-eye-view

    God's Eye View is an open-source, vanilla JavaScript + CesiumJS + Vite 3D globe that fuses live public feeds (aircraft, ships, satellites, quakes, public cameras, weather) into one explorable scene. Its AI layer is a hands-free voice agent on the OpenAI Realtime API with 30 tools: camera fly-to, whiteboard annotations, analyst queries over live layers, and scene-context and screenshot grounding. Keys stay server-side and the browser gets only a short-lived session token. An experimental ChatGPT/Codex OAuth path is also supported. The app doubles as an MCP server, so Claude Desktop, Codex or ChatGPT can open the globe from a conversation.

    github.comrepoAdded 11 Oct 2026

  59. Talorys – A self-hosted personal AI agent on Cloudflare's free tier

    Talorys is an open-source, single-user personal AI assistant deployed with one command (npx create-talorys) into the user's own Cloudflare account. It uses a Cloudflare Agents SDK Durable Object with SQLite for conversations, memories, tasks, notes and automations, Workers AI (@cf/zai-org/glm-4.7-flash) for streaming chat with tool calling, and Durable Object alarms for reminders and scheduled AI routines. It stays within the Workers Free plan, with a private Worker behind a Pages Function service binding, owner-password auth, per-day AI usage guardrails, and fallback to non-AI features when quota runs out.

    github.comrepoPublished and added 10 Oct 2026

  60. Verifiable Retrieval for Legal Reasoning through Structure-driven Knowledge Graph

    The paper builds a Knowledge Graph from German Legal Code by structure-driven parsing, then uses it to navigate sources and retrieve from them in a RAG pipeline. It compares several KG-informed chunking and retrieval strategies and measures their effect on the accuracy of retrieved citations. The aim is verifiable, transparent retrieval for reliability-critical domains, where naive retrieval degrades as the number and size of sources grows.

    arxiv.orgpaperAdded 12 Oct 2026, published 9 Oct 2026

Showing 60 of 110

Show more