llmspeed.devtoolShow HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware
Llmspeed is an open-source web tool that lets you get a feel for how fast a local LLM runs on a given device before buying hardware. It shows estimates for a short prompt on a single device, using measured numbers from community benchmarks (r/LocalLLaMA, localscore.ai) and filling gaps with figures derived from similar setups or projected from specs. It helps with local-LLM hardware purchasing decisions.
TL;DR Open-source tool that estimates and demonstrates local LLM speed on various hardware, based on community benchmarks and projections.
Organisations named here
- GitHub
- r/LocalLLaMA
Technologies named here
- Llmspeed
- LocalScore
- LLM
Related in inference
arxiv.orgpaperMinimally Invasive Steering of Language Models
x.comthreadSamuel Zeng (@SamuelZengML) on X
huggingface.coarticle