Skip to content
Crawl4AI

Free alternatives to Crawl4AI

200 free apps like Crawl4AI, closest match first.

More like Crawl4AI

151
F

FreeCrawl SEO Tool

A high-performance website crawler built for serious SEO audits

Launch
152
P

parallel-web

Uses Parallel CLI for web search, URL extraction, deep research

Get
153
P

playwright-cli

Automate browser interactions, test web pages and work with Playwright tests

Get
154
H

html-to-interaction-prompts

Convert a supplied HTML page or generated HTML reference into a

Get
155
A

autocli-skill

Browser-session automation for fetching real-time web data from social

Get
156
B

browserbase/browserbase-cli

CLI wrapper around the Browserbase platform

Get
157
G

GPT Master

ChatGPT Power Toolkit

Launch
158
C

City Scrapers

Scrape, standardize and share public meetings from local government websites

Launch
159
P

playwright-explore-website

Automated website exploration and test case generation using Playwright

Get
160
K

Kameleo

Anti-detect browser for web scraping and automation

Launch
161
C

caido-mode

Full Caido SDK integration for Claude Code

Get
162
S

Scrapemate

Golang Crawling and scraping framework

Launch
163
T

tavily-map

Discover and list all URLs on a website without extracting content

Get
164
S

Sitemap AI

Crawl websites and generate XML sitemaps, llms.txt & markdown

Launch
165
A

active-research

Deep research and analysis tool

Get
166
D

defuddle

Extract clean article content from web pages or local HTML files

Get
167
S

ScrapeServ

A self-hosted API that takes a URL and returns a file with browser screenshots

Launch
168
E

extract

Extract content from specific URLs using Tavily's extraction API

Get
169
O

open-websearch

Single entry skill for open-websearch setup and focused live retrieval

Get
170
B

browserbase/fetch

Fetch HTML, JSON, headers, and status codes through the Browserbase API

Get
171
A

apify-generate-output-schema

Generate output schemas (dataset_schema.json, output_schema.json

Get
172
F

firecrawl/firecrawl-build-search

Integrate Firecrawl /search for query-first discovery

Get
173
D

dev-browser

Browser automation with persistent page state

Get
174
F

firecrawl-map

Discover and list a site's URLs, with search filtering

Get
175
A

anti-detect-browser

Launch Chromium with real-device fingerprints for multi-account operations

Get
176
C

clawdirect-dev

Build agent-facing web experiences

Get
177
R

Redirect Bypasser (WebExtension)

Avoid redirects and has direct access to the sites you want to visit

Launch
178
T

tavily-extract

Extract clean markdown or text content from specific URLs via the Tavily CLI

Get
179
D

Degoog

Search engine aggregator with a comprehensive plugin/extension system

Launch
180
M

MinerU-HTML

An SLM-powered HTML main content extractor

Launch
181
S

Scraper

Web scraper for scraping, tracking and visualizing prices of products on various

Launch
182
U

use-tinyfish

Use TinyFish for web search, fetching URLs, reading pages, current information

Get
183
N

nemo-retriever

Searching, extracting, ingesting, or querying a document collection

Get
184
M

modelcontextprotocol/server-fetch

Web content fetching and processing for AI consumption

Get
185
P

pskill9/web-search

Web search using Google search results

Get
186
G

google-search-browser-use

Use browser-use to perform Google searches, open results

Get
187
A

anysearch

Real-time search engine supporting web search, vertical domain search

Get
188
P

playwriter

Control the user's currently open Chrome tab through the Playwriter CLI

Get
189
T

tavily-search

Tavily AI search API - Optimized search for AI agents

Get
190
F

firecrawl-download

Save a site or section as local files (markdown, screenshots)

Get
191
S

SiteSnapper

Archive webpages with high-quality screenshots, metadata, and full text content

Launch
192
Z

ziniao-page

A request concerns a webpage running inside an already-opened 紫鸟/ZClaw store

Get
193
B

bat-submit

Submit an AI tool to BAT AI Tools (bataitools.com) via bat-cli CLI

Get
194
D

Duck Duck Scrape

Search from DuckDuckGo and utilize its spice APIs in Node

Launch
195
S

Social Media Scraping Apis

A curated collection of social media scraping APIs and tools for Instagram

Launch
196
F

fetcher

Shared payment and setup skill for fetcher.sh

Get
197
I

identify-page-structure

Use this when the page-import pipeline needs to identify section boundaries

Get
198
P

Playwright With Fingerprints

Anonymous automation via playwright with fingerprint replacement technology

Launch
199
B

bestparse/api

Dynamic and reliable data extraction and parsing API

Launch
200
S

ScrapingIsNotACrime

Scrape Instagram, TikTok & YouTube public data with a developer-first API

Launch