Skip to content
Webcrawler API

Free alternatives to Webcrawler API

200 free apps like Webcrawler API, closest match first.

More like Webcrawler API

51
A

apify-sdk-integration

Integrate Apify into an existing JavaScript/TypeScript or Python application

Get
52
D

defuddle

Extract clean article content from web pages or local HTML files

Get
53
F

firecrawl-search

Find web sources with query-relevant page excerpts

Get
54
W

web-content-fetcher

Extract article content from any URL as clean Markdown

Get
55
C

crawlbase/crawl-markdown

Extract clean, LLM-ready Markdown from any URL, stripped of ads and boilerplate

Get
56
B

browserbase/search

Search the web via the Browserbase API with structured results

Get
57
G

Gpt4V-scraper

AI agent that can SEE , control, navigate, & do stuff for you on your browser

Launch
58
U

Ujeebu

Ujeebu offers a suite of products designed

Launch
59
D

data-scraper-agent

Build a fully automated AI-powered data collection agent for any public source

Get
60
T

Textweb

A text-grid web renderer for AI agents — see the web without screenshots

Launch
61
C

Crawlkit

CrawlKit provides a web crawling API for developers to extract data from any URL

Launch
62
F

firecrawl-browser

Cloud browser automation for pages requiring clicks, forms, login

Get
63
E

extract

Extract structured data from websites

Get
64
S

Saga Reader

🏻 Blazing-Fast and Extremely-Lightweight Internet Reader driven by AI

Launch
65
W

WebChatGPT: ChatGPT with internet access

Augment your ChatGPT prompts

Launch
66
C

crawl

Crawl any website and save pages as local markdown files

Get
67
O

Omniyond

The pay-per-use API toolbox for AI apps

Launch
68
R

Rdrr

Convert any URL to clean markdown for AI agents

Launch
69
M

MinerU-HTML

An SLM-powered HTML main content extractor

Launch
70
F

firecrawl-download

Download entire websites as organized local files in multiple formats

Get
71
A

agent-browser

Browser automation CLI for AI agents

Get
72
C

ChatWeb

ChatWeb can crawl web pages, read PDF, DOCX, TXT, and extract the main content

Launch
73
T

tavily-best-practices

Web search API for LLMs with real-time data access, content extraction

Get
74
G

Greenflare

Open Source SEO Web Crawler

Launch
75
M

mcp-duckgo

Skills for web search and content scraping via DuckDuckGo MCP Server

Get
76
F

FreeCrawl SEO Tool

A high-performance website crawler built for serious SEO audits

Launch
77
S

Scrapper

Web scraper with a simple REST API living in Docker

Launch
78
C

CrawlerCheck

Free crawler checker and website crawlability test for Googlebot, and AI bots

Launch
79
S

Sosse

Selenium Open Source Search Engine & crawler

Launch
80
S

scrapellm.com

We specialise in scraping products of public data, much like Brightdata

Launch
81
C

clone-website

Reverse-engineer and clone one or more websites in one shot

Get
82
C

Chatgpt Scraper

Easily collect responses from ChatGPT scraper by providing a prompt along

Launch
83
S

Sitemap AI

Crawl websites and generate XML sitemaps, llms.txt & markdown

Launch
84
W

web-crawler

Web scraping plus social data: YouTube, TikTok, Instagram (incl

Get
85
T

tavily-cli

Set up, authenticate, update, troubleshoot

Get
86
S

SiteSnapper

Archive webpages with high-quality screenshots, metadata, and full text content

Launch
87
M

modelcontextprotocol/server-fetch

Web content fetching and processing for AI consumption

Get
88
M

Marreta

Tool for analyzing, cleaning, and tidying up web URLs

Launch
89
A

AICrawlable

Free llms.txt generator for any website

Launch
90
W

web-scraping

Expert in web scraping and data extraction with Python tools

Get
91
T

tavily-dynamic-search

Programmatic Tavily search with context isolation

Get
92
P

Perplexideez

Search the web and your self-hosted apps using local AI agents

Launch
93
M

mini-browser

Browser automation skill for AI agents using the mb CLI

Get
94
A

apify-ultimate-scraper

Universal AI-powered web scraper for 55+ platforms

Get
95
P

playwright-scraper

Playwright web scraping: dynamic content, auth flows, pagination

Get
96
C

Canonry

Agent-first AI SEO (AEO/GEO) operating platform

Launch
97
C

Cpdown

Copy to clipboard any webpage content/youtube subtitle as clean

Launch
98
A

Automated Business Analysis Workflow

n8n workflow - Scrapes any URL, uses AI to generate a comprehensive business…

Launch
99
R

robotcheck

Score your website's readability for AI crawlers and search bots

Launch
100
F

firecrawl-knowledge-ingest

Ingest public or authenticated knowledge bases and docs portals

Get