Skip to content
Crawl4AI

Free alternatives to Crawl4AI

200 free apps like Crawl4AI, closest match first.

More like Crawl4AI

101
A

Agent Browser

Execute complex automation scripts via remote cloud sessions , featuring…

Launch
102
F

firecrawl-crawl

Bulk extract content from entire websites or site sections

Get
103
F

firecrawl-search

Find web sources with query-relevant page excerpts

Get
104
C

Camofox Browser

Anti-detection browser server for AI agents

Launch
105
C

Catai

Run AI assistant locally! with simple API for Node.js

Launch
106
R

robots-txt

Configure, audit, or optimize robots.txt

Get
107
A

Ask.py

A simple Python program to implement the search-extract-summarize flow

Launch
108
W

web-crawler

Web scraping plus social data: YouTube, TikTok, Instagram (incl

Get
109
W

web-reader

Implement web page content extraction capabilities using the z-ai-web-dev-sdk

Get
110
A

agentkey

PROACTIVELY use whenever the user needs data outside your training set or

Get
111
A

AGiXT

JUST DO THINGS!

Launch
112
V

VectorVein

No-code AI workflow. Drag and drop workflow nodes and use your workflow

Launch
113
O

OpenAssistantGPT

Build a smart RAG chatbot with the OpenAI Assistant API

Launch
114
T

tavily-cli

Set up, authenticate, update, troubleshoot

Get
115
P

parallel-web-extract

Extract content from multiple URLs in parallel, token-efficiently

Get
116
F

firecrawl-scrape

Extract clean markdown from any URL

Get
117
M

migrate-to-parallel

Migrate Exa, Tavily, Perplexity

Get
118
L

Llm4free

All-in-one Python toolkit for web search, AI interaction

Launch
119
F

FSB

DOM-first AI browser automation for Chrome and MCP clients

Launch
120
I

Integuru

The first AI agent that builds permissionless integrations through reverse

Launch
121
W

Web Search MCP

Search and extract web content for LLM ingestion

Launch
122
S

Scrappey.com

The Most Versatile Web Scraping API

Launch
123
T

tavily-dynamic-search

Programmatic Tavily search with context isolation

Get
124
G

Greenflare

Open Source SEO Web Crawler

Launch
125
A

AICrawlable

Free llms.txt generator for any website

Launch
126
G

gemini-computer-use

Build and run Gemini 2.5 Computer Use browser-control agents with Playwright

Get
127
R

remote-browser

Controls an isolated Browser Use Cloud browser from a sandboxed machine

Get
128
A

Automated Business Analysis Workflow

n8n workflow - Scrapes any URL, uses AI to generate a comprehensive business…

Launch
129
C

Codex Chatgpt Web

Use ChatGPT Web (including Pro) as a native model in Codex

Launch
130
D

Doctra

Parse, extract, and analyze documents with ease

Launch
131
P

playwright-cli

Browser automation with 40+ commands for navigation, interaction, form filling

Get
132
C

Canonry

Agent-first AI SEO (AEO/GEO) operating platform

Launch
133
S

Stealth Browser MCP

Stealth browser automation for AI agents over MCP

Launch
134
L

lightpanda

Lightpanda browser, drop-in replacement

Get
135
C

crawlbase/crawl-markdown

Extract clean, LLM-ready Markdown from any URL, stripped of ads and boilerplate

Get
136
O

OpenFlux

Open-source AI Agent desktop client

Launch
137
M

Marreta

Tool for analyzing, cleaning, and tidying up web URLs

Launch
138
C

ChitChat

Discover bots, chat with PDFs, and create personalized chat buddies

Launch
139
N

N8n Skills

Designed specifically for AI assistants

Launch
140
R

Rdrr

Convert any URL to clean markdown for AI agents

Launch
141
T

tavily-best-practices

Web search API for LLMs with real-time data access, content extraction

Get
142
A

apify-ultimate-scraper

Universal AI-powered web scraper for 55+ platforms

Get
143
R

robotcheck

Score your website's readability for AI crawlers and search bots

Launch
144
F

firecrawl-knowledge-ingest

Ingest public or authenticated knowledge bases and docs portals

Get
145
K

KnockOutEZ/wigolo

Local web search, fetching, crawling, extraction and research

Get
146
P

Playwright Bot Bypass

Claude Code skill to bypass bot detection (Google CAPTCHA, etc.)

Launch
147
M

mymanus

Autonomous agent with planning, execution, and browser automation capabilities

Get
148
A

apify-actor-development

Develop, debug, and deploy Apify Actors

Get
149
S

Stealth-Requests

Undetected web-scraping & seamless HTML parsing in Python!

Launch
150
F

firecrawl-map

Discover and filter URLs on a website

Get