Skip to content
42crawl.fyi

Self-hosted alternatives to 42crawl.fyi

200 self-hosted apps like 42crawl.fyi, closest match first.

Top picks

  1. C

    Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-

    FreeOpen sourceSelf-hosted

  2. C

    Canonry

    Launch

    Open-source tools to track AI search and site visits, then make changes you approve. Run Canonry on your own server with the AI agent you already use.

    FreeOpen sourceSelf-hosted

  3. R

    RankMeFast

    Launch

    RankMeFast is an open source SEO platform that you can use in its cloud at rankme.fast or self-host on your own server. It audits a website for technical SEO problems and explains how to fix them, tracks keyword rankings on Google, and chec

    Open sourceSelf-hosted

  4. C

    Cited

    Launch

    Cited monitors the AI questions you choose and records when your website becomes part of the answer. Track citations, mentions, recommendations, and missed opportunities in one focused inbox.

    FreeOpen sourceSelf-hosted

  5. S

    Sosse

    Launch

    Selenium search engine for crawling and archiving

    FreeOpen sourceSelf-hosted

  6. K

    Krawl

    Launch

    Krawl is a customizable, lightweight, cloud-native web deception server and anti-crawler that creates fake web applications with low-hanging vulnerabilities using realistic, randomly generated decoy data and AI-generated HTML templates.

    FreeOpen sourceSelf-hosted

More like 42crawl.fyi

7
W

wigolo

The go-to web for your AI coding agent

Launch
8
B

bisibility

Open-source SEO platform

Launch
9
B

BugTraceAI

Open-source, self-hosted web pentesting suite

Launch
10
A

Anubis

Web AI firewall utility which protects upstream resources from scraper bots

Launch
11
W

WebwhizAI

Train ChatGPT on your website data and build an AI Chatbot

Launch
12
O

Open

Self-hosted AI visibility tracking (AEO / GEO / LLMO)

Launch
13
S

Searchmirror

Open-source, self-hosted rank tracker

Launch
14
G

Go Away

[Mirror] Self-hosted abuse detection

Launch
15
W

Webcap

Web archiving and change detection

Launch
16
O

Owl Browser

Self-hosted Chromium browser automation engine built for AI agents

Launch
17
K

Kameleo

Anti-detect browser for web scraping and automation

Launch
18
S

Searcharvester

Self-hosted search + markdown harvester for AI agents

Launch
19
A

AI Workflow Automation

Build and host powerful AI agents inside your WordPress site with a few clicks

Launch
20
R

Ragrabbit

Open Source, Self-Hosted, AI Search and LLM.txt for your website

Launch
21
H

Hister

Personal web search engine with automatic indexing of visited websites

Launch
22
H

HeadlessX

The undetected self-hosted browser automation platform

Launch
23
A

Auto Browser

Give your AI agent a real browser — with a human in the loop

Launch
24
F

FCaptcha

Self-hosted, invisible CAPTCHA that detects AI agents driving real browsers

Launch
25
O

Open Kritt

Open-source, self-hosted AI vulnerability research tool

Launch
26
C

ClawFleet

Deploy a fleet of AI agents (OpenClaw, Hermes) on your machine in 10 minutes

Launch
27
K

Kibitzr

Personal Web Assistant

Launch
28
M

Marreta

Tool for analyzing, cleaning, and tidying up web URLs

Launch
29
O

OneGlanse

Open-source AI visibility, AEO & GEO tracker

Launch
30
P

Perplexideez

Search the web and your self-hosted apps using local AI agents

Launch
31
C

changedetection.io

Stay up-to-date with web-site content changes

Launch
32
A

Antigravity Phone Chat

Real-time mobile monitor & remote control for Antigravity AI sessions

Launch
33
C

CPA-Manager-Plus

A self-hosted CPA / CLIProxyAPI management panel

Launch
34
S

SerpBear

Search engine position tracking and keyword research

Launch
35
P

PrimeClaws

Reliable, affordable VPS & managed hosting optimized for OpenClaw

Launch
36
H

HybridClaw

Enterprise-ready self-hosted AI assistant runtime

Launch
37
P

Pocketpaw

Your AI agent in 30 seconds

Launch
38
A

Allama

🔥🔥🔥 AI security automation platform

Launch
39
M

Maxun

Turn any website into structured data

Launch
40
G

GoGogot

Lightweight self-hosted AI agent. Open-source OpenClaw alternative in Go

Launch
41
M

Mira

Self-hosted AI code reviewer with indexed PR reviews, walkthroughs…

Launch
42
C

Comma

Best free & open source AI personal assistant

Launch
43
R

Rakazo

Run persistent AI bots that sign into your tools, complete tasks autonomously

Launch
44
O

Openclaw Dashboard

Secure, real-time monitoring dashboard for OpenClaw AI agents

Launch
45
A

ArchiveBox

Create HTML & screenshot archives of sites from your bookmarks

Launch
46
T

Tianji

Self-hostable platform combining website analytics, uptime monitoring

Launch
47
E

Eclaire

Local-first, open-source AI assistant for your data

Launch
48
M

Moyai

A self-hosted coding agent for background work

Launch
49
O

Oh My Cpa

Self-hosted control plane & usage observability console for CLIProxyAPI (CPA)

Launch
50
C

Clawsify

Deploy OpenClaw inside your infrastructure in one click

Launch

About 42crawl.fyi

4

42crawl.fyi

The answer to web crawling. Period

42crawl is an AI-powered technical SEO and website crawling platform designed for modern search environments. It continuously monitors your site to detect crawl errors, indexing issues, broken links, redirect chains and internal linking gaps before they impact rankings. Unlike traditional desktop crawlers, 42crawl runs in the background and provides ongoing monitoring instead of one-time audits.

Price
Freemium
Category
AI
Website
42crawl.fyi