Compare with similar tools:
Desktop app for running local LLMs with a ChatGPT-like interface. Supports GGUF models, model management, and a local API server compatible with OpenAI.
Teams & Solo Users
Great for the one-person operation today, and the team you'll build tomorrow.
Share this tool
Ollama
Run large language models locally with a simple CLI and REST API. Supports Llama, Mistral, Gemma, and dozens of other models out of the box.
62/100
Jan
Open-source, offline-first alternative to ChatGPT. Runs 100%% on your computer with no data sent to the cloud.
61/100
LocalAI
Self-hosted, OpenAI-compatible API server for running AI models locally. Drop-in replacement for OpenAI β no GPU required.
59/100