Self-hosted alternatives to AnythingLLM
200 self-hosted apps like AnythingLLM, closest match first.
Top picks
- D

Dot
LaunchDot is a local AI assistant that runs language models, retrieval over your documents and text-to-speech on your own device. It is built around Mistral 7B, a large language model, so it does not send your documents or questions to a remote s
FreeSelf-hosted
- K

Khoj
LaunchKhoj is a self-hostable AI assistant that connects to your documents and the web, so you can ask questions and get answers with citations. You can build agents, schedule automations, and run research across your notes and files. The site sa
FreeSelf-hosted
- L
Llocal
LaunchAiming to provide a seamless and privacy driven chatting experience with open-sourced technologies(Ollama), particularly open sourced LLM's(eg. Llama3, Phi-3, Mistral). Focused on ease of use. Available on both Windows and Mac.
FreeSelf-hosted
- T
Textgen
LaunchTextGen is an open-source desktop app for running large language models locally. It has a chat and generation interface, and an OpenAI- and Anthropic-compatible API. The project's own description says it has no telemetry and works fully off
FreeSelf-hosted
- O
overtchat
LaunchA polished, privacy-first Open WebUI alternative for local and hosted models, with multi-user accounts, realtime local voice, files, search, memory, and desktop and mobile apps.
FreeSelf-hosted
- O

Ollama
LaunchOllama is a tool for running open AI models on your own computer, from the terminal or through apps you build. It runs on macOS, Windows and Linux. When a model is too large for your hardware, cloud models are available too, paid for with u
Self-hosted
More like AnythingLLM
Self-Hosted AI Stack
Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…
About AnythingLLM
AnythingLLM
A desktop and self-hostable AI app for chatting
AnythingLLM is a desktop and self-hostable AI app for chatting with your documents, running local models and using AI agents without writing code. Every document you add becomes part of the knowledge base for your assistant, and the company says no data leaves your device. You can pick a model or let the app choose one, use dynamic model selection, and add custom agent skills, web scraping and search, and background jobs for recurring tasks. A meeting assistant transcribes and summarizes meetings on your computer, with action items and transcripts, and works with any meeting platform without a bot joining the call. There is also an Android app for local AI and a cloud version for teams. The site says the app is free and private, with no accounts, no API keys and no token limits, and it has a Docker image. The company is moving its local runtime to Lemonade and llama.cpp. The code is on GitHub.
- Price
- Freemium
- Category
- AI
- Website
- anythingllm.com





