Compare with similar tools:
Run large language models locally with a simple CLI and REST API. Supports Llama, Mistral, Gemma, and dozens of other models out of the box.
Teams & Solo Users
Whether you're flying solo or coordinating with a crew, this tool has you covered.
Share this tool
Jan
Open-source, offline-first alternative to ChatGPT. Runs 100%% on your computer with no data sent to the cloud.
71/100
LocalAI
Self-hosted, OpenAI-compatible API server for running AI models locally. Drop-in replacement for OpenAI β no GPU required.
50/100
Open WebUI
Offline-capable, self-hosted web interface for Ollama and OpenAI-compatible APIs. ChatGPT-like UI that runs entirely on your own machine.
39/100