colibri: pure-C engine for running huge MoE models by streaming experts from disk
colibri is a pure-C, dependency-free inference engine that runs mixture-of-experts models of hundreds of billions of parameters on ordinary machines. It keeps the dense layers in RAM and streams routed experts from disk through a learning cache, with optional CUDA, Vulkan and Metal tiers. It supports GLM-5.2, Kimi K3, DeepSeek V4, Qwen3.6 and GGUF files, and serves OpenAI- and Anthropic-compatible APIs.
inference, modelsΒ· Added 3 Nov 2026






























-oOdUn61bDRSykk4H951SoDOHzqoOe1.png)







































































