Compare with similar tools:
Single-file executables for LLMs from Mozilla. Download one file, run any model β no install, no dependencies, works on every OS.
Teams & Solo Users
Whether you're flying solo or coordinating with a crew, this tool has you covered.
Share this tool
Ollama
Run large language models locally with a simple CLI and REST API. Supports Llama, Mistral, Gemma, and dozens of other models out of the box.
62/100
Jan
Open-source, offline-first alternative to ChatGPT. Runs 100%% on your computer with no data sent to the cloud.
61/100
LocalAI
Self-hosted, OpenAI-compatible API server for running AI models locally. Drop-in replacement for OpenAI β no GPU required.
59/100