Skip to content
Crawl4AI

Alternatives to Crawl4AI

200 apps like Crawl4AI, closest match first.

More like Crawl4AI

151
F

firecrawl-knowledge-base

Build a knowledge base from web content with Firecrawl

Get
152
F

firecrawl-workflows

Run outcome-focused Firecrawl workflows

Get
153
L

Linkly AI

AI-Agent-First Local Document Search

Launch
154
B

build-with-exa

Build applications and agents

Get
155
C

CrawlReady

The AI interface layer between your site and AI crawlers

Launch
156
A

agent-browser-automation

Headless browser automation CLI for AI agents using native Rust binary

Get
157
O

olostep/olostep-mcp-server

Web scraping, crawling and search API: extract content as Markdown or JSON

Get
158
S

ScrapingBot

The API you need for efficient scraping!

Launch
159
B

browsing-with-playwright

Browser automation using Playwright MCP

Get
160
C

Crawlkit

CrawlKit provides a web crawling API for developers to extract data from any URL

Launch
161
B

blackwhite084/playwright-plus-python-mcp

Browser automation using Playwright, tailored for LLMs

Get
162
P

Phantombuster

Code free automations and data extraction

Launch
163
Q

QuickScraper

QuickScraper is an easy-to-use and powerful Proxy API for Web scraping

Launch
164
C

clone-website

Reverse-engineer and clone one or more websites in one shot

Get
165
D

Dumpling-AI/mcp-server-dumplingai

Access Dumpling AI's data, web scraping and document conversion APIs

Get
166
A

agent-browser

Fast, persistent browser automation

Get
167
P

ProxyShare

Provide intelligent web crawling and IP proxy services

Launch
168
B

bright-data-best-practices

Build production-ready Bright Data integrations with best practices baked in

Get
169
S

Sriram-PR/doc-scraper

Crawl documentation sites into local Markdown or JSONL corpora

Get
170
F

firecrawl/firecrawl-mcp-server

Firecrawl web scraping: search, scrape, crawl, map and extract structured data

Get
171
F

firecrawl-download

Download entire websites as organized local files in multiple formats

Get
172
W

web-search

Web search and content extraction with Tavily and Exa via inference.sh CLI

Get
173
B

browser-use

Fast, persistent browser automation

Get
174
M

mcp-duckgo

Skills for web search and content scraping via DuckDuckGo MCP Server

Get
175
M

Mydentify AI Crawler Access Checker

Checks robots.txt, page-level crawler directives

Launch
176
B

Browsertrix Crawler

Run a high-fidelity browser-based web archiving crawler in a single Docker

Launch
177
C

crawl

Crawl any website and save pages as local markdown files

Get
178
E

ego-browser

A browser, read this Skill by default

Get
179
C

CaptureKit

The Ultimate Web Scraping API for Developers

Launch
180
L

llm-context

RAG/LLM grounding. Returns pre-extracted web content

Get
181
Z

zcaceres/fetch-mcp

Fetch JSON, text and HTML data

Get
182
I

InterroBot

Web Crawler and Analyzer for Devs, SEOs, and CMS admins

Launch
183
A

Agent Browser

Execute complex automation scripts via remote cloud sessions , featuring…

Launch
184
F

firecrawl-search

Find web sources with query-relevant page excerpts

Get
185
R

robots-txt

Configure, audit, or optimize robots.txt

Get
186
A

Agenty

Web Scraping with AI

Launch
187
A

Apify

Thousands of tools to automate your business

Launch
188
R

Retio-ai/pagemap

Compress web page HTML into compact structured maps

Get
189
D

Dataminer

Easy to use web scraping

Launch
190
S

ScrapingBypass

ScrapingBypass API helps scraper easily bypass Cloudflare page scraping shield

Launch
191
P

Prerender

Get Your JavaScript Website Crawled, Indexed and Found

Launch
192
S

ScrapX

Monitor your competitors

Launch
193
C

crawler.sh

Crawl sites fast, extract Markdown and SEO insights

Launch
194
S

Surgeflow

Automate your browser tasks with a single command

Launch
195
W

Web Search MCP

Search and extract web content for LLM ingestion

Launch
196
G

Greenflare

Open Source SEO Web Crawler

Launch
197
Y

yinnho/aginxbrowser

Chromium-free agent browser

Get
198
S

SocialKit

Scrape any social media platform with one API

Launch
199
S

ScrapeBox

ScrapeBox the Ultimate Link Harvester

Launch
200
B

brave/llm-context

Return pre-extracted web content (text, tables, code) from Brave Search

Get