Skip to content
Web Scraper

Open source alternatives to Web Scraper

200 open source apps like Web Scraper, closest match first.

Top picks

  1. T

    Teracrawl

    Launch

    High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative

    Open source

  2. S

    Spider

    Launch

    The web data infrastructure for AI. Get clean markdown or JSON from any website in realtime, priced per page.

    Open source

  3. M

    Maxun

    Launch

    Turn any website into structured data using a visual recorder, natural language prompts, or API. Includes proxy rotation, scheduling, and webhook integrations.

    Open sourceSelf-hosted

  4. G

    GcrawlAI

    Launch

    Turn any website into LLM-ready Markdown or JSON. Open-source scraping API: JS rendering, stealth and proxies in every request. 50 free requests monthly.

    Open source

  5. R

    Rdrr

    Launch

    Convert any URL to clean markdown for AI agents.

    Open source

  6. C

    Crawl4AI

    Launch

    Open-source web crawler and scraper that produces clean, structured output optimized for LLMs, RAG pipelines, and AI agents. Supports async crawling, CSS/XPath/LLM extraction, and stealth browser control.

    Open source

More like Web Scraper

7
S

Scrapecraft

AI-powered web scraping editor with visual workflow builder

Launch
8
P

Pullmd

Self-hosted URL- and file-to-Markdown service for humans and AI agents

Launch
9
C

Chatgpt Scraper API

Collect structured responses from a ChatGPT scraper by sending a prompt

Launch
10
R

Reader

Open source web infrastructure for AI

Launch
11
C

Cpdown

Copy to clipboard any webpage content/youtube subtitle as clean

Launch
12
D

Docsify This

Turn your Markdown files into shareable web pages, embeddable content

Launch
13
S

Searcharvester

Self-hosted search + markdown harvester for AI agents

Launch
14
M

Md.page

Instantly turn Markdown into a shareable web page

Launch
15
G

Gotenberg

Developer-friendly API to interact

Launch
16
C

Chappe

Developer Docs builder

Launch
17
S

Spidercreator

Automated web scraping spider generation using Browser Use and LLMs

Launch
18
D

Ditto

Clones any public website into clean Next.js or Vite code

Launch
19
M

Marreta

Tool for analyzing, cleaning, and tidying up web URLs

Launch
20
M

Mdflux

Turn any document into clean, AI-ready Markdown

Launch
21
P

Pdf3md

A modern, user-friendly web application

Launch
22
W

Web Scout MCP

An MCP server providing web search and content extraction capabilities

Launch
23
S

ScreenshotOne

Turn websites into screenshots via API

Launch
24
A

Agent Fetch

Full-content web fetcher for AI agents

Launch
25
O

Openbrowser

Let AI agents browse the web. An autonomous toolkit for browser-based AI agents

Launch
26
G

Gpt4V-scraper

AI agent that can SEE , control, navigate, & do stuff for you on your browser

Launch
27
T

Textweb

A text-grid web renderer for AI agents — see the web without screenshots

Launch
28
S

Skyvern

Transform manual browser tasks into automated workflows using AI

Launch
29
L

LLM Wiki V2

Turn your documents into a Markdown wiki you can read, that answers

Launch
30
A

Anymd

Any file → clean Markdown for AI agents: PDF, Word, PowerPoint, Excel, EPUB

Launch
31
S

Saga Reader

🏻 Blazing-Fast and Extremely-Lightweight Internet Reader driven by AI

Launch
32
M

MinerU-Skill

AI-Native document parser: PDF, Office & images → clean Markdown

Launch
33
M

MinerU-HTML

An SLM-powered HTML main content extractor

Launch
34
A

AI-MarkDone

ChatGPT directory navigation, Reader source copy, Dynamic Annotation, bookmarks

Launch
35
L

Lazydocs

Generate markdown API documentation from Google-style Python docstring

Launch
36
S

Svelte Markdown

Markdown and HTML renderer for Svelte 5

Launch
37
V

vivekvells/mcp-pandoc

Document format conversion using Pandoc: Markdown, HTML, PDF, DOCX, CSV and more

Get
38
A

Ask.py

A simple Python program to implement the search-extract-summarize flow

Launch
39
M

microsoft/markitdown

Convert many file formats, local or remote, to Markdown for LLMs

Get
40
I

Idoc

Generate beautiful interactive documentation and Open-API 3.0 spec file

Launch
41
T

Tavily

Search engine for AI agents (search + extract) powered by Tavily

Get
42
O

Oranda

generate beautiful landing pages for your developer tools

Launch
43
C

Compiiile

The most convenient way to render and deploy a folder containing markdown files

Launch
44
R

Rocketnotes

✨ AI-powered markdown editor - leverage LLMs with your documents - 100% local…

Launch
45
F

Flink

Create QR Codes, embeddable link previews for your website

Launch
46
T

Text Extract API

Document (PDF, Word, PPTX ...) extraction and parse API

Launch
47
B

Browsertrix Crawler

Run a high-fidelity browser-based web archiving crawler in a single Docker

Launch
48
P

Perplexideez

Search the web and your self-hosted apps using local AI agents

Launch
49
S

Sosse

Selenium Open Source Search Engine & crawler

Launch
50
A

Anchr App

Open-source API for a self-hostable

Launch

About Web Scraper

W

Web Scraper

Web Scraper

A Python Gradio application that scrapes websites, converts content to markdown, and generates sitemaps from page links. Available both as a web interface and as an MCP (Model Context Protocol) server for AI integration.

Price
Free
Made by
Agents-MCP-Hackathon
Category
Developer Tools
Website
huggingface.co/spaces/agents-mcp-hackathon/web-scraper