Skip to content
WebCrawler

Free alternatives to WebCrawler

200 free apps like WebCrawler, closest match first.

More like WebCrawler

151
V

valyu-best-practices

Complete Valyu API toolkit for AI agents

Get
152
A

autocli-skill

Browser-session automation for fetching real-time web data from social

Get
153
D

Deep Research Web UI

AI deep-research agent that turns any question into a cited report: plans

Launch
154
D

deep-research

Conduct comprehensive research on any topic

Get
155
C

Chat On Steroids

Cross-platform local MCP capabilities for ChatGPT

Launch
156
A

anti-detect-browser

Launch Chromium with real-device fingerprints for multi-account operations

Get
157
R

robots-txt

Configure, audit, or optimize robots.txt

Get
158
D

Dogeub

Tools, Apps, Entertainment, Private Browsing, all in one place

Launch
159
L

llm-context

RAG/LLM grounding. Returns pre-extracted web content

Get
160
S

Sigma AI Browser

Chat with AI, generate images, summarize articles - for free. All In one Browser

Launch
161
A

agent-browser-automation

Headless browser automation CLI for AI agents using native Rust binary

Get
162
G

Google Search

A Playwright-based Node.js tool that bypasses search engine anti-scraping…

Launch
163
D

data-scraper-agent

Build a fully automated AI-powered data collection agent for any public source

Get
164
F

firecrawl-knowledge-base

Build a knowledge base from web content with Firecrawl

Get
165
T

tavily-research

Comprehensive AI-powered research with multi-source synthesis and citations

Get
166
C

Chatgpt Scraper

Easily collect responses from ChatGPT scraper by providing a prompt along

Launch
167
A

AgentRunner.ai

Create autonomous AI agents, browse the web with AI, and automate actions

Launch
168
B

browser-cdp

Control a Chrome browser via CDP

Get
169
T

TG Search Bot

A smart AI telegram bot for searching and auto-saving

Launch
170
M

Mydentify AI Crawler Access Checker

Checks robots.txt, page-level crawler directives

Launch
171
C

clawdirect-dev

Build agent-facing web experiences

Get
172
S

Spidercreator

Automated web scraping spider generation using Browser Use and LLMs

Launch
173
B

BuddyBeep

AI All in one place

Launch
174
A

Amgix

Hybrid search engine built for flexible deployment and real-world messy data

Launch
175
C

clone-website

Reverse-engineer and clone one or more websites in one shot

Get
176
F

FSB

DOM-first AI browser automation for Chrome and MCP clients

Launch
177
P

playwriter

Control the user's currently open Chrome tab through the Playwriter CLI

Get
178
C

ChitChat

Discover bots, chat with PDFs, and create personalized chat buddies

Launch
179
R

research

Comprehensive research grounded in web data with explicit citations

Get
180
G

Genspark.ai

Save time. Better results

Launch
181
E

eyalzh/browser-control-mcp

Control the user's Firefox browser via a companion extension

Get
182
I

investigate-anything

Start-here router and tradecraft baseline for any investigation into a person

Get
183
G

Getcito Worlds First Open Source Aio Aeo Or Geo Tool

GetCito the World's First Open Source AI Search Optimization

Launch
184
C

claude-for-safari

Control the user's real Safari browser on macOS through AppleScript

Get
185
B

BGPT MCP API

Give your AI daily-updated scientific evidence you can verify before you trust

Launch
186
Z

ZotSeek

AI semantic search for Zotero, with a built-in MCP server for AI agents

Launch
187
B

brightdata-cli

Guide for using the Bright Data CLI

Get
188
R

Rayobrowse

Stealth Chromium browser for web scraping and AI agents

Launch
189
N

NeuralDeskApp

Versatile Almost Local, Eventually Reasonable Assistant

Launch
190
G

GPT Master

ChatGPT Power Toolkit

Launch
191
A

Auto Page Indexer

Automatically index all of your websites' web pages

Launch
192
P

PilotCite

Monitor brand visibility and citations across ChatGPT, Google AI, Gemini

Launch
193
W

Web Scraper

Web Scraper

Launch
194
W

Wispra

AI search optimization made simple. Get recommended by ChatGPT & co

Launch
195
B

Bagoodex

AI Web Search & Chat

Launch
196
G

Gemini CLI

Google's open-source AI agent for the command line

Launch
197
H

Hystruct

Extract structured data from the web

Launch
198
D

deep-research (Gemini)

Autonomous multi-step research via the Gemini Deep Research agent

Get
199
A

AgentsKB

Knowledge base with 39K+ researched technical Q&As accessible

Launch
200
A

AI Chat

ChatGPT, Gemini, Claude, Husky, Grok & more - all in one app

Launch