Skip to content
Webcrawler API

Open source alternatives to Webcrawler API

200 open source apps like Webcrawler API, closest match first.

Top picks

  1. C

    Crawl4AI

    Launch

    Open-source web crawler and scraper that produces clean, structured output optimized for LLMs, RAG pipelines, and AI agents. Supports async crawling, CSS/XPath/LLM extraction, and stealth browser control.

    Open source

  2. T

    Teracrawl

    Launch

    High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative

    FreeOpen source

  3. S

    Spider

    Launch

    The web data infrastructure for AI. Get clean markdown or JSON from any website in realtime, priced per page.

    FreeOpen source

  4. C

    Chatgpt Scraper API

    Launch

    Collect structured responses from a ChatGPT scraper by sending a prompt with valid ChatGPT scraping API credentials. Enable live search, inject HTML context, and automate intelligent scraper ChatGPT workflows in just a few parameters.

    FreeOpen source

  5. A

    Agent Fetch

    Launch

    Full-content web fetcher for AI agents — Chrome TLS fingerprinting, browser impersonation, multi-strategy article extraction, and web scraping.

    FreeOpen source

  6. S

    Scrapecraft

    Launch

    🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.

    FreeOpen source

More like Webcrawler API

7
G

GcrawlAI

Open-source web scraping API that converts sites to LLM-ready data

Launch
8
R

Reader

Open source web infrastructure for AI

Launch
9
S

Searcharvester

Self-hosted search + markdown harvester for AI agents

Launch
10
W

WebReaper

AI-native web scraper

Launch
11
M

Maxun

Turn any website into structured data

Launch
12
S

Spidercreator

Automated web scraping spider generation using Browser Use and LLMs

Launch
13
O

Openbrowser

Let AI agents browse the web. An autonomous toolkit for browser-based AI agents

Launch
14
W

Web Scout MCP

An MCP server providing web search and content extraction capabilities

Launch
15
G

Gpt4V-scraper

AI agent that can SEE , control, navigate, & do stuff for you on your browser

Launch
16
T

Textweb

A text-grid web renderer for AI agents — see the web without screenshots

Launch
17
S

Skyvern

Transform manual browser tasks into automated workflows using AI

Launch
18
S

Saga Reader

🏻 Blazing-Fast and Extremely-Lightweight Internet Reader driven by AI

Launch
19
W

WebChatGPT: ChatGPT with internet access

Augment your ChatGPT prompts

Launch
20
R

Rdrr

Convert any URL to clean markdown for AI agents

Launch
21
M

MinerU-HTML

An SLM-powered HTML main content extractor

Launch
22
C

ChatWeb

ChatWeb can crawl web pages, read PDF, DOCX, TXT, and extract the main content

Launch
23
F

FreeCrawl SEO Tool

A high-performance website crawler built for serious SEO audits

Launch
24
S

Scrapper

Web scraper with a simple REST API living in Docker

Launch
25
S

Sosse

Selenium Open Source Search Engine & crawler

Launch
26
C

Chatgpt Scraper

Easily collect responses from ChatGPT scraper by providing a prompt along

Launch
27
M

Marreta

Tool for analyzing, cleaning, and tidying up web URLs

Launch
28
P

Perplexideez

Search the web and your self-hosted apps using local AI agents

Launch
29
C

Canonry

Agent-first AI SEO (AEO/GEO) operating platform

Launch
30
C

Cpdown

Copy to clipboard any webpage content/youtube subtitle as clean

Launch
31
D

Ditto

Clones any public website into clean Next.js or Vite code

Launch
32
A

Automated Business Analysis Workflow

n8n workflow - Scrapes any URL, uses AI to generate a comprehensive business…

Launch
33
S

Seo-Promt-Master

Google SEO's full docs as an AI prompt machine

Launch
34
B

Bux

Browser Use Box: a 24/7 Claude Code agent

Launch
35
A

Ask.py

A simple Python program to implement the search-extract-summarize flow

Launch
36
G

Geo Optimizer Skill

Open-source Answer Engine Optimization (AEO) & Generative Engine Optimization

Launch
37
G

Getcito Worlds First Open Source Aio Aeo Or Geo Tool

GetCito the World's First Open Source AI Search Optimization

Launch
38
D

Doctra

Parse, extract, and analyze documents with ease

Launch
39
O

Ocbot

Your Web4 Agent

Launch
40
R

Rayobrowse

Stealth Chromium browser for web scraping and AI agents

Launch
41
A

AI-MarkDone

ChatGPT directory navigation, Reader source copy, Dynamic Annotation, bookmarks

Launch
42
G

Gemini-API

Reverse-engineered Python API for Google Gemini web app

Launch
43
H

HeadlessX

The undetected self-hosted browser automation platform

Launch
44
A

Ask Search

Self-hosted web search skill for AI agents

Launch
45
F

FeedMe

😋 AI-powered, Lightweight RSS Reader

Launch
46
C

CRW

Fast, lightweight Firecrawl/Tavily alternative in Rust

Launch
47
H

html2rss

Generate RSS feeds for any website

Launch
48
H

Hanzi Browse

let any ai agent use the local browser

Launch
49
S

SearchGPT

Grounded search engine (i.e. with source reference) based on LLM / ChatGPT /…

Launch
50
P

Parchi

Your AI friend right in your browser

Launch

About Webcrawler API

W

Webcrawler API

Extract content from websites with powerful API or no-code

In the rapidly evolving landscape of artificial intelligence, access to high-quality data is paramount. Andrew, founder of WebCrawlerAPI, recognized a significant pain point for developers: the complexities of web crawling.

Price
Paid
Category
AI
Website
webcrawlerapi.com