web-llm
High-performance In-browser LLM Inference Engine
Developer Tools
High-performance In-browser LLM Inference Engine
Open product
High-performance In-browser LLM Inference Engine. **High-Performance In-Browser LLM Inference Engine.** Documentation | Blogpost | Paper | Examples WebLLM is a high-performance in-browser LLM inference engine that brings language model inference directly onto web browsers with hardware acceleration. Everything runs inside the browser with no server support and is accelerated with WebGPU.
Disclosure. Listings are free. Boosted placement is a paid, clearly-labelled promotion and never affects editor's picks or the organic Top rated order.