Skip to content
Crawl4AI

Self-hosted alternatives to Crawl4AI

200 self-hosted apps like Crawl4AI, closest match first.

Top picks

  1. M

    Maxun

    Launch

    Turn any website into structured data using a visual recorder, natural language prompts, or API. Includes proxy rotation, scheduling, and webhook integrations.

    Self-hosted

  2. S

    Searcharvester

    Launch

    Self-hosted search + markdown harvester for AI agents. SearXNG (100+ engines) + FastAPI + trafilatura. Tavily-compatible /search plus /extract with size presets and pagination. One-command Docker Compose.

    FreeSelf-hosted

  3. S

    Sosse

    Launch

    Selenium search engine for crawling and archiving

    FreeSelf-hosted

  4. H

    HeadlessX

    Launch

    Self-hosted scraping platform with 0% detection rate powered by Camoufox. Extract websites, Google AI Search, YouTube, Tavily, Exa with queued jobs, API keys, and remote MCP support.

    FreeSelf-hosted

  5. P

    Perplexideez

    Launch

    Search the web and your self-hosted apps using local AI agents.

    FreeSelf-hosted

  6. C

    Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-

    FreeSelf-hosted

More like Crawl4AI

7
A

Ask Search

Self-hosted web search skill for AI agents

Launch
8
O

Owl Browser

Self-hosted Chromium browser automation engine built for AI agents

Launch
9
C

Canonry

Agent-first AI SEO (AEO/GEO) operating platform

Launch
10
M

Marreta

Tool for analyzing, cleaning, and tidying up web URLs

Launch
11
W

wigolo

The go-to web for your AI coding agent

Launch
12
M

MCP Searxng

Private web search for AI assistants via SearXNG

Launch
13
G

GoGogot

Lightweight self-hosted AI agent. Open-source OpenClaw alternative in Go

Launch
14
A

ArkhamMirror

Local-first AI-powered document intelligence platform

Launch
15
K

Kameleo

Anti-detect browser for web scraping and automation

Launch
16
S

ScrapeServ

A self-hosted API that takes a URL and returns a file with browser screenshots

Launch
17
B

BugTraceAI

Open-source, self-hosted web pentesting suite

Launch
18
D

Deep Research Web UI

AI deep-research agent that turns any question into a cited report: plans

Launch
19
E

Eclaire

Local-first, open-source AI assistant for your data

Launch
20
D

Degoog

Search engine aggregator with a comprehensive plugin/extension system

Launch
21
L

LLM Wiki V2

Turn your documents into a Markdown wiki you can read, that answers

Launch
22
F

FeedMe

😋 AI-powered, Lightweight RSS Reader

Launch
23
S

Searchmirror

Open-source, self-hosted rank tracker

Launch
24
O

OneGlanse

Open-source AI visibility, AEO & GEO tracker

Launch
25
C

CPA-Manager-Plus

A self-hosted CPA / CLIProxyAPI management panel

Launch
26
A

Agentic Signal

Visual AI agent workflow automation platform with local LLM integration

Launch
27
A

Anubis

Web AI firewall utility which protects upstream resources from scraper bots

Launch
28
P

Pullmd

Self-hosted URL- and file-to-Markdown service for humans and AI agents

Launch
29
O

OpenAgentCore

Open-source, self-hosted implementation of the OpenAI Agents API

Launch
30
H

HybridClaw

Enterprise-ready self-hosted AI assistant runtime

Launch
31
O

Orbit

Self-hosted AI gateway for private RAG, natural-language data access

Launch
32
A

Aleph

Tool for indexing large amounts of both documents

Launch
33
S

SapienAI

Self-hosted academic chatbot, research workspaces and editor

Launch
34
F

Flamehaven-Filesearch

Self-hosted RAG search engine — 34 formats, BM25+hybrid search, multi-LLM…

Launch
35
O

Open

Self-hosted AI visibility tracking (AEO / GEO / LLMO)

Launch
36
H

html2rss

Generate RSS feeds for any website

Launch
37
A

ArchiveBox

Create HTML & screenshot archives of sites from your bookmarks

Launch
38
A

Araa Search

A privacy-respecting, ad-free, self-hosted Google metasearch engine

Launch
39
P

Py Idp

AI-enabled Intelligent Document Processing for Python: 12+ LLM backends

Launch
40
M

MOVO

Turn DeepSeek Harness into a self-hosted enterprise Agent platform

Launch
41
O

Open Agent Connector

Open-source, self-hosted alternative to Composio, Nango, Merge.dev

Launch
42
F

FlareSolverr

Proxy server to bypass Cloudflare protection

Launch
43
C

ccLoad

Self-hosted AI API gateway for Claude Code

Launch
44
L

LoomFlow

Lightweight AI-native workflow builder for individuals and small teams

Launch
45
G

Go Away

[Mirror] Self-hosted abuse detection

Launch
46
K

Kortix Suna AI

Open-source AI Operating System: your agents, skills, memory

Launch
47
P

Petercat

A conversational Q&A agent configuration system

Launch
48
C

CatGPT-Gateway

Turn your ChatGPT or Claude account into a fully working OpenAI-compatible API

Launch
49
C

ClawFleet

Deploy a fleet of AI agents (OpenClaw, Hermes) on your machine in 10 minutes

Launch
50
O

Open Kritt

Open-source, self-hosted AI vulnerability research tool

Launch

About Crawl4AI

C

Crawl4AI

Open-source web crawler and scraper

Open-source web crawler and scraper that produces clean, structured output optimized for LLMs, RAG pipelines, and AI agents. Supports async crawling, CSS/XPath/LLM extraction, and stealth browser control.

Category
AI
Website
crawl4ai.com