🎯 Grouped Query Attention

The items that name it 3

• Welcome Muse Spark Open: open-weight frontier multimodal mixture-of-experts model from Meta
  article2026-10-15It is written here as Grouped-query attention.
• The Roadmap to Mastering LLM Inference Optimization
  article2026-09-21It is written here as Grouped-query attention (GQA).

  GQA

• Granite 4.2 LLMs: How They're Built
  article2026-08-25It is written here as Grouped Query Attention (GQA).

  GQA