Compare with similar tools:
Feature-rich single-file LLM inference engine for local AI with support for text adventure, roleplay, and creative writing use cases.
Teams & Solo Users
Solopreneurs, startups, and established teams all find a home here.
Share this tool
Ollama
Run large language models locally with a simple CLI and REST API. Supports Llama, Mistral, Gemma, and dozens of other models out of the box.
62/100
Jan
Open-source, offline-first alternative to ChatGPT. Runs 100%% on your computer with no data sent to the cloud.
61/100
LocalAI
Self-hosted, OpenAI-compatible API server for running AI models locally. Drop-in replacement for OpenAI β no GPU required.
59/100