Skip to content
Webcrawler API

Open source alternatives to Webcrawler API

200 open source apps like Webcrawler API, closest match first.

More like Webcrawler API

51
P

Pullmd

Self-hosted URL- and file-to-Markdown service for humans and AI agents

Launch
52
G

Gemini Web To API

Reverse-engineered API for Gemini web app

Launch
53
B

Browsertrix Crawler

Run a high-fidelity browser-based web archiving crawler in a single Docker

Launch
54
T

Tavily

Search engine for AI agents (search + extract) powered by Tavily

Get
55
G

Geoptimize

Deterministic content-readiness lint

Launch
56
S

Save my Chatbot - AI Conversation Exporter

Download your ChatGPT, Claude

Launch
57
M

MCP Searxng

Private web search for AI assistants via SearXNG

Launch
58
N

Nango

Open-source product integrations for 100+ APIs

Launch
59
R

Rsslookup

A free tool to find the RSS feed for any URL

Launch
60
O

Open

Self-hosted AI visibility tracking (AEO / GEO / LLMO)

Launch
61
U

UglyFeed

Retrieve, aggregate, filter, evaluate, rewrite and serve RSS feeds

Launch
62
S

Social Media Scraping Apis

A curated collection of social media scraping APIs and tools for Instagram

Launch
63
D

DocsGPT

Private AI platform for agents, assistants and enterprise search

Launch
64
A

Agentset

Open-source local Semantic Search + RAG for your data

Launch
65
R

RSSbrew

Self-hosted, easy-to-deploy RSS tool

Launch
66
C

Codex Chatgpt Web

Use ChatGPT Web (including Pro) as a native model in Codex

Launch
67
C

Core

AI-powered CMS core for personal blogs and creator websites

Launch
68
A

AI Browser

An AI-powered desktop automation agent built with Electron & Next.js

Launch
69
C

Camofox Browser

Stealth headless browser for AI agents

Launch
70
L

LLM Wiki V2

Turn your documents into a Markdown wiki you can read, that answers

Launch
71
E

EGEOagents

Open-source Generative Engine Optimization (GEO) & Answer Engine Optimization

Launch
72
W

WebwhizAI

Train ChatGPT on your website data and build an AI Chatbot

Launch
73
I

Integuru

The first AI agent that builds permissionless integrations through reverse

Launch
74
O

OmniParse

Ingest, parse, and optimize any data format from documents to multimedia

Launch
75
L

Llm4free

All-in-one Python toolkit for web search, AI interaction

Launch
76
A

ArkhamMirror

Local-first AI-powered document intelligence platform

Launch
77
O

OpenAssistantGPT

Build a smart RAG chatbot with the OpenAI Assistant API

Launch
78
A

ArchiveBox

Create HTML & screenshot archives of sites from your bookmarks

Launch
79
S

Searchmirror

Open-source, self-hosted rank tracker

Launch
80
D

Deep Research Web UI

AI deep-research agent that turns any question into a cited report: plans

Launch
81
R

Reddit_Scrapper

Scrape Reddit for marketing pain points using GPT

Launch
82
W

wigolo

The go-to web for your AI coding agent

Launch
83
D

Degoog

Search engine aggregator with a comprehensive plugin/extension system

Launch
84
V

VectorVein

No-code AI workflow. Drag and drop workflow nodes and use your workflow

Launch
85
A

Agent Browser

Execute complex automation scripts via remote cloud sessions , featuring…

Launch
86
C

Chat On Steroids

Cross-platform local MCP capabilities for ChatGPT

Launch
87
C

Camofox Browser

Anti-detection browser server for AI agents

Launch
88
C

Catai

Run AI assistant locally! with simple API for Node.js

Launch
89
C

City Scrapers

Scrape, standardize and share public meetings from local government websites

Launch
90
S

saurabhsharma2u/search-console-mcp

Interact with Google Search Console and Bing Webmaster Tools

Get
91
P

Pdfstract

Extract, Chunking and Embedding Layer in Your RAG Pipeline

Launch
92
I

Invisible Playwright MCP

Playwright MCP server undetected by anti-bots

Launch
93
G

Google Search

A Playwright-based Node.js tool that bypasses search engine anti-scraping…

Launch
94
A

AlchemyLanguage By IBM Watson

Extract insights, identify entities, detect sentiment

Launch
95
A

Aleph

Tool for indexing large amounts of both documents

Launch
96
L

LLM Scraper

Turn any webpage into structured data using LLMs

Launch
97
P

pskill9/web-search

Web search using Google search results

Get
98
D

Deepcrawl

100% free and full open-source edge Firecrawl alternative

Launch
99
A

Anymd

Any file → clean Markdown for AI agents: PDF, Word, PowerPoint, Excel, EPUB

Launch
100
A

Araa Search

A privacy-respecting, ad-free, self-hosted Google metasearch engine

Launch