Skip to content
Needle 3

Self-hosted alternatives to Needle 3

200 self-hosted apps like Needle 3, closest match first.

Top picks

  1. P

    Picollm

    Launch

    Production-grade on-device AI SDKs for voice, language, and vision. STT, wake word, TTS, translation, OCR, and more. Runs on mobile, web, desktop, and embedded.

    FreeOpen sourceSelf-hosted

  2. M

    Minion

    Launch

    A tiny single-file coding agent for self-hosted models (llama.cpp / vLLM / SGLang).

    FreeOpen sourceSelf-hosted

  3. N

    NadirClaw

    Launch

    Source-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, n

    FreeOpen sourceSelf-hosted

  4. S

    SourceWeft

    Launch

    Open-source, self-hostable alternative to ChatGPT and NotebookLM — agents, skills, MCP, and cited knowledge in one AI workstation. Your models, your infrastructure. Free to use GPT 6: https://SourceWeft.com/

    FreeOpen sourceSelf-hosted

  5. G

    Guaardvark

    Launch

    Self-hosted AI studio on your own GPU: chat with your files (RAG), screen and browser agents, coding swarms, LoRA training, an MCP server for Claude Code and Cursor, and local video, image, music and voice generation. No telemetry.

    FreeOpen sourceSelf-hosted

  6. O

    Openclaw.net

    Launch

    Self-hosted Enterprise and Personal AI + agent runtime in .NET (NativeAOT-friendly)

    FreeOpen sourceSelf-hosted

More like Needle 3

7
S

Sipp

AI inference, packed simply

Launch
8
T

TurboLLM

Run any local LLM engine, auto-tuned to your GPU

Launch
9
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
10
L

Llmaker

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Launch
11
P

Pocketpaw

Your AI agent in 30 seconds

Launch
12
L

Local-Multimodal-AI-Chat

Self-hostable multimodal chat with local LLMs

Launch
13
M

Marm Memory

Local-first 3-in-1 AI memory layer & MCP server for Claude Code, Codex, Grok

Launch
14
O

overtchat

A simpler self-hosted alternative to Open WebUI

Launch
15
P

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs

Launch
16
M

MultitaskAI

Master Your AI, Maximize Your Productivity!

Launch
17
A

Agentic Signal

Visual AI agent workflow automation platform with local LLM integration

Launch
18
M

Muxi

Deploy intelligence. Open-source infrastructure for AI agents in production

Launch
19
S

Self-Hosted AI Stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…

Launch
20
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
21
N

Nosia

Self-hosted AI RAG + MCP Platform

Launch
22
M

MOVO

Turn DeepSeek Harness into a self-hosted enterprise Agent platform

Launch
23
O

OpenAgentCore

Open-source, self-hosted implementation of the OpenAI Agents API

Launch
24
S

Streamcore Server

Open-source realtime voice agent server in Go with WebRTC

Launch
25
A

AsrServe

Self-hosted realtime and offline ASR

Launch
26
J

Jenny Android AI Agent

A local-first personal AI agent that lives on your Android phone

Launch
27
N

Netron

Visualizer for neural network and machine learning models

Launch
28
C

Clawsify

Deploy OpenClaw inside your infrastructure in one click

Launch
29
G

GrayMatter

30 sec to give your AI agents persistent memory

Launch
30
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
31
O

Orbit

Self-hosted AI gateway for private RAG, natural-language data access

Launch
32
P

Py Idp

AI-enabled Intelligent Document Processing for Python: 12+ LLM backends

Launch
33
D

Dot

Text-To-Speech, RAG, and LLMs. All local!

Launch
34
W

Webchat2api

OpenAI-compatible Web Chat API proxy

Launch
35
L

LMRing

Open-source, self-hostable LLM arena

Launch
36
A

Airunner

Offline inference engine for art, real-time voice conversations

Launch
37
A

Agenvoy

Self-hosted 24/7 personal AI agent that runs on your own machine

Launch
38
O

Openclaw Nerve

Real-time web cockpit for OpenClaw: voice conversations

Launch
39
R

Rag.computer

Self-hostable RAG platform - document ingestion, embedding, and vector search…

Launch
40
M

Memory OS

A 7-layer memory operating system for Hermes Agent

Launch
41
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
42
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
43
S

Synapse

Self-hosted AI workspace with shareable AI teammates, shared conversations

Launch
44
O

Open Responses

Self-hosted alternative to OpenAI's Responses API compatible

Launch
45
N

Nautilo

AI goes multiplayer. A self-hosted workspace for people and machine people

Launch
46
M

Mnemory

A self-hosted, secure, feature-rich memory system for AI agents and assistants

Launch
47
G

GoModel

AI gateway written in Go with a unified OpenAI-compatible API

Launch
48
Y

Yepanywhere

Self-hosted web UI for Claude and Codex

Launch
49
R

Riffado

Self-hosted AI transcription interface for Plaud Note devices

Launch
50
O

OpenCode Superapp

Native, local-first AI workspace for Mac

Launch

About Needle 3

N

Needle 3

8-29 MB foundation model for tiny devices

Needle 3 is a foundation model from Cactus Compute, built for mobile devices, wearables, robots, smart home devices, cars and microcontrollers. The whole model is a single binary of 8 to 29 MB, based on the company's Simple Attention Network. It is built for three jobs. Tool calls pick the right functions from the ones your app exposes and fill in every argument from what the user said. Structured extraction takes messy text and returns typed fields for a shape you declare, such as an invoice, a booking, a notification or a form. Text embeddings return a vector for a sentence, so an app can search, match and route locally. The company says Needle 3 beats models ten times its size on mobile tool calls and matches models two to three times bigger on extraction, and that it gives up general chat ability to do so. The page lists a browser sandbox where you can try it, and a Python install with pip install cactus-needle.

Category
Productivity
Website
cactuscompute.com