Skip to content
Webcrawler API

Alternatives to Webcrawler API

200 apps like Webcrawler API, closest match first.

More like Webcrawler API

151
G

Gaffa

An API that makes scraping and automating data extraction

Launch
152
P

pragmar/mcp-server-webcrawl

Search and retrieve web crawler data from WARC, wget, Katana

Get
153
S

Scrapeless

A platform with web scraping toolkit to extracts data

Launch
154
M

MinerU-HTML

An SLM-powered HTML main content extractor

Launch
155
N

NBot

Track and summarize topic-based web content

Launch
156
F

firecrawl-download

Download entire websites as organized local files in multiple formats

Get
157
A

agent-browser

Browser automation CLI for AI agents

Get
158
P

pure.md

Global cache between LLMs and the web

Launch
159
T

tavily-best-practices

Web search API for LLMs with real-time data access, content extraction

Get
160
T

Tavily AI

Tavily is the real‑time search engine for AI agents

Launch
161
S

SocialKit

Scrape any social media platform with one API

Launch
162
G

Greenflare

Open Source SEO Web Crawler

Launch
163
S

Sriram-PR/doc-scraper

Crawl documentation sites into local Markdown or JSONL corpora

Get
164
M

mcp-duckgo

Skills for web search and content scraping via DuckDuckGo MCP Server

Get
165
F

FreeCrawl SEO Tool

A high-performance website crawler built for serious SEO audits

Launch
166
S

Scrapper

Web scraper with a simple REST API living in Docker

Launch
167
S

Sosse

Selenium Open Source Search Engine & crawler

Launch
168
F

Forage AI

Your AI-powered data extraction and automation partner

Launch
169
C

clone-website

Reverse-engineer and clone one or more websites in one shot

Get
170
P

Piloterr

Web scraping API handles headless browsers, rotates proxies for you

Launch
171
D

Deep Dive Duck

Monitor Website Changes for Competitor Insights

Launch
172
A

Agenty

Web Scraping with AI

Launch
173
S

Sitemap AI

Crawl websites and generate XML sitemaps, llms.txt & markdown

Launch
174
W

web-crawler

Web scraping plus social data: YouTube, TikTok, Instagram (incl

Get
175
T

tavily-cli

Set up, authenticate, update, troubleshoot

Get
176
S

SiteSnapper

Archive webpages with high-quality screenshots, metadata, and full text content

Launch
177
A

Ask

Get precise answers, refine search results

Launch
178
M

modelcontextprotocol/server-fetch

Web content fetching and processing for AI consumption

Get
179
M

Marreta

Tool for analyzing, cleaning, and tidying up web URLs

Launch
180
A

AICrawlable

Free llms.txt generator for any website

Launch
181
W

web-scraping

Expert in web scraping and data extraction with Python tools

Get
182
B

brave/llm-context

Return pre-extracted web content (text, tables, code) from Brave Search

Get
183
R

Retio-ai/pagemap

Compress web page HTML into compact structured maps

Get
184
S

ShowUpInAI

Get Cited in ChatGPT and more!

Launch
185
S

ScrapingBot

The API you need for efficient scraping!

Launch
186
T

tavily-dynamic-search

Programmatic Tavily search with context isolation

Get
187
L

lfnovo/content-core

Extract content from web pages, PDFs, Word documents, YouTube transcripts

Get
188
M

mini-browser

Browser automation skill for AI agents using the mb CLI

Get
189
P

playwright-scraper

Playwright web scraping: dynamic content, auth flows, pagination

Get
190
L

Locus

Find information on web pages, refer to sections in long documents

Launch
191
D

Dataminer

Easy to use web scraping

Launch
192
A

Apify

Thousands of tools to automate your business

Launch
193
P

profullstack/mcp-server

Developer utilities: SEO optimization, document conversion, domain lookup

Get
194
C

Capture

Automate the Web, One Pixel at a Time

Launch
195
C

Content Snare

Automate content gathering, pre-approve answers

Launch
196
P

ProxyShare

Provide intelligent web crawling and IP proxy services

Launch
197
S

ScrapX

Monitor your competitors

Launch
198
C

ChatWebpage

Ask questions, request info, instruct actions, engage deeply

Launch
199
B

Browserbase

Give your agents access to the whole web

Launch
200
U

UScraper

Design no-code web scraping visually

Launch