Self-hosted alternatives to Needle 3
200 self-hosted apps like Needle 3, closest match first.
Top picks
- P
Picollm
LaunchProduction-grade on-device AI SDKs for voice, language, and vision. STT, wake word, TTS, translation, OCR, and more. Runs on mobile, web, desktop, and embedded.
FreeOpen sourceSelf-hosted
- M
Minion
LaunchA tiny single-file coding agent for self-hosted models (llama.cpp / vLLM / SGLang).
FreeOpen sourceSelf-hosted
- N
NadirClaw
LaunchSource-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, n
FreeOpen sourceSelf-hosted
- S

SourceWeft
LaunchOpen-source, self-hostable alternative to ChatGPT and NotebookLM — agents, skills, MCP, and cited knowledge in one AI workstation. Your models, your infrastructure. Free to use GPT 6: https://SourceWeft.com/
FreeOpen sourceSelf-hosted
- G

Guaardvark
LaunchSelf-hosted AI studio on your own GPU: chat with your files (RAG), screen and browser agents, coding swarms, LoRA training, an MCP server for Claude Code and Cursor, and local video, image, music and voice generation. No telemetry.
FreeOpen sourceSelf-hosted
- O
Openclaw.net
LaunchSelf-hosted Enterprise and Personal AI + agent runtime in .NET (NativeAOT-friendly)
FreeOpen sourceSelf-hosted
More like Needle 3
Self-Hosted AI Stack
Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…
About Needle 3
Needle 3
8-29 MB foundation model for tiny devices
Needle 3 is a foundation model from Cactus Compute, built for mobile devices, wearables, robots, smart home devices, cars and microcontrollers. The whole model is a single binary of 8 to 29 MB, based on the company's Simple Attention Network. It is built for three jobs. Tool calls pick the right functions from the ones your app exposes and fill in every argument from what the user said. Structured extraction takes messy text and returns typed fields for a shape you declare, such as an invoice, a booking, a notification or a form. Text embeddings return a vector for a sentence, so an app can search, match and route locally. The company says Needle 3 beats models ten times its size on mobile tool calls and matches models two to three times bigger on extraction, and that it gives up general chat ability to do so. The page lists a browser sandbox where you can try it, and a Python install with pip install cactus-needle.
- Category
- Productivity
- Website
- cactuscompute.com


