Skip to content
Webcrawler API

Self-hosted alternatives to Webcrawler API

200 self-hosted apps like Webcrawler API, closest match first.

Top picks

  1. S

    Searcharvester

    Launch

    Self-hosted search + markdown harvester for AI agents. SearXNG (100+ engines) + FastAPI + trafilatura. Tavily-compatible /search plus /extract with size presets and pagination. One-command Docker Compose.

    FreeOpen sourceSelf-hosted

  2. M

    Maxun

    Launch

    Turn any website into structured data using a visual recorder, natural language prompts, or API. Includes proxy rotation, scheduling, and webhook integrations.

    Open sourceSelf-hosted

  3. S

    Sosse

    Launch

    Selenium search engine for crawling and archiving

    FreeOpen sourceSelf-hosted

  4. M

    Marreta

    Launch

    Tool for analyzing, cleaning, and tidying up web URLs

    FreeOpen sourceSelf-hosted

  5. P

    Perplexideez

    Launch

    Search the web and your self-hosted apps using local AI agents.

    FreeOpen sourceSelf-hosted

  6. C

    Canonry

    Launch

    Open-source tools to track AI search and site visits, then make changes you approve. Run Canonry on your own server with the AI agent you already use.

    FreeOpen sourceSelf-hosted

More like Webcrawler API

7
H

HeadlessX

The undetected self-hosted browser automation platform

Launch
8
A

Ask Search

Self-hosted web search skill for AI agents

Launch
9
F

FeedMe

😋 AI-powered, Lightweight RSS Reader

Launch
10
C

CRW

Fast, lightweight Firecrawl/Tavily alternative in Rust

Launch
11
H

html2rss

Generate RSS feeds for any website

Launch
12
P

Pullmd

Self-hosted URL- and file-to-Markdown service for humans and AI agents

Launch
13
M

MCP Searxng

Private web search for AI assistants via SearXNG

Launch
14
O

Open

Self-hosted AI visibility tracking (AEO / GEO / LLMO)

Launch
15
R

RSSbrew

Self-hosted, easy-to-deploy RSS tool

Launch
16
C

Core

AI-powered CMS core for personal blogs and creator websites

Launch
17
L

LLM Wiki V2

Turn your documents into a Markdown wiki you can read, that answers

Launch
18
W

WebwhizAI

Train ChatGPT on your website data and build an AI Chatbot

Launch
19
A

ArkhamMirror

Local-first AI-powered document intelligence platform

Launch
20
A

ArchiveBox

Create HTML & screenshot archives of sites from your bookmarks

Launch
21
S

Searchmirror

Open-source, self-hosted rank tracker

Launch
22
D

Deep Research Web UI

AI deep-research agent that turns any question into a cited report: plans

Launch
23
W

wigolo

The go-to web for your AI coding agent

Launch
24
S

ScrapeServ

A self-hosted API that takes a URL and returns a file with browser screenshots

Launch
25
D

Degoog

Search engine aggregator with a comprehensive plugin/extension system

Launch
26
A

Aleph

Tool for indexing large amounts of both documents

Launch
27
O

Owl Browser

Self-hosted Chromium browser automation engine built for AI agents

Launch
28
A

Araa Search

A privacy-respecting, ad-free, self-hosted Google metasearch engine

Launch
29
O

OneGlanse

Open-source AI visibility, AEO & GEO tracker

Launch
30
O

Oksskolten

The AI-native RSS reader

Launch
31
A

AI Workflow Automation

Build and host powerful AI agents inside your WordPress site with a few clicks

Launch
32
T

Txtdot

An HTTP proxy that parses only text

Launch
33
C

Cited

Open-source AI citation monitoring platform

Launch
34
C

changedetection.io

Stay up-to-date with web-site content changes

Launch
35
S

SerpBear

Search engine position tracking and keyword research

Launch
36
A

Anchr App

Open-source API for a self-hostable

Launch
37
M

Md.page

Instantly turn Markdown into a shareable web page

Launch
38
R

RSSMonster

RSS reader with local semantic processing

Launch
39
C

CPA-Manager-Plus

A self-hosted CPA / CLIProxyAPI management panel

Launch
40
W

Webcap

Web archiving and change detection

Launch
41
T

Tome

Beautiful documentation that doesn't cost a fortune

Launch
42
G

Gotenberg

Developer-friendly API to interact

Launch
43
E

Eclaire

Local-first, open-source AI assistant for your data

Launch
44
D

Docling-Studio

Visual document analysis studio powered by Docling

Launch
45
K

Knowledge Graph Extractor

Turn any document or a whole zip into an interactive knowledge graph

Launch
46
F

Flamehaven-Filesearch

Self-hosted RAG search engine — 34 formats, BM25+hybrid search, multi-LLM…

Launch
47
H

Hister

Personal web search engine with automatic indexing of visited websites

Launch
48
K

Kameleo

Anti-detect browser for web scraping and automation

Launch
49
B

Briefkasten

Self hosted bookmarking app

Launch
50
G

GoGogot

Lightweight self-hosted AI agent. Open-source OpenClaw alternative in Go

Launch

About Webcrawler API

W

Webcrawler API

Extract content from websites with powerful API or no-code

In the rapidly evolving landscape of artificial intelligence, access to high-quality data is paramount. Andrew, founder of WebCrawlerAPI, recognized a significant pain point for developers: the complexities of web crawling.

Price
Paid
Category
AI
Website
webcrawlerapi.com