Skip to content
Webcrawler API

Free alternatives to Webcrawler API

200 free apps like Webcrawler API, closest match first.

More like Webcrawler API

101
S

Seo-Promt-Master

Google SEO's full docs as an AI prompt machine

Launch
102
H

html-to-interaction-prompts

Convert a supplied HTML page or generated HTML reference into a

Get
103
B

Bux

Browser Use Box: a 24/7 Claude Code agent

Launch
104
A

Ask.py

A simple Python program to implement the search-extract-summarize flow

Launch
105
T

tavily-map

Discover and list all URLs on a website without extracting content

Get
106
G

Geo Optimizer Skill

Open-source Answer Engine Optimization (AEO) & Generative Engine Optimization

Launch
107
G

Getcito Worlds First Open Source Aio Aeo Or Geo Tool

GetCito the World's First Open Source AI Search Optimization

Launch
108
R

read

Fetches URLs and PDFs, then summarizes or returns clean Markdown

Get
109
F

firecrawl/firecrawl-build-search

Integrate Firecrawl /search for query-first discovery

Get
110
C

CodeAnswr

Make AI conversations searchable

Launch
111
S

steel-browser

Any web task where WebFetch or curl would fail or be insufficient

Get
112
D

Doctra

Parse, extract, and analyze documents with ease

Launch
113
F

firecrawl-map

Discover and filter URLs on a website

Get
114
B

BuddyBeep

AI All in one place

Launch
115
A

autocli-skill

Browser-session automation for fetching real-time web data from social

Get
116
A

agentkey

PROACTIVELY use whenever the user needs data outside your training set or

Get
117
R

reverse-api-engineer

Reverse engineer APIs from websites

Get
118
F

Fast Browser Use

A fast browser-use skill powered by local LLMs via single-token reflexes

Launch
119
B

browser-pilot

Chrome DevTools Protocol (CDP) browser automation, web scraping

Get
120
O

Ocbot

Your Web4 Agent

Launch
121
P

parallel-web

Uses Parallel CLI for web search, URL extraction, deep research

Get
122
F

firecrawl-map

Discover and list a site's URLs, with search filtering

Get
123
R

Rayobrowse

Stealth Chromium browser for web scraping and AI agents

Launch
124
R

robots-txt

Configure, audit, or optimize robots.txt

Get
125
M

migrate-to-parallel

Migrate Exa, Tavily, Perplexity

Get
126
A

AI-MarkDone

ChatGPT directory navigation, Reader source copy, Dynamic Annotation, bookmarks

Launch
127
I

identify-page-structure

Use this when the page-import pipeline needs to identify section boundaries

Get
128
S

seo-drift

SEO drift monitoring: capture baselines of SEO-critical elements

Get
129
H

HeadlessX

The undetected self-hosted browser automation platform

Launch
130
A

Ask Search

Self-hosted web search skill for AI agents

Launch
131
G

Genspark.ai

Save time. Better results

Launch
132
S

Scrappey.com

The Most Versatile Web Scraping API

Launch
133
F

FeedMe

😋 AI-powered, Lightweight RSS Reader

Launch
134
B

browser-mcp-agent

Give an AI agent its own real browser over MCP tool calls

Get
135
U

URL to Any

An All-in-One Web Content Conversion Tool

Launch
136
A

Ask AI widget

Let visitors ask AI about your site with your pre-set prompt

Launch
137
U

use-tinyfish

Use TinyFish for web search, fetching URLs, reading pages, current information

Get
138
B

brightdata-cli

Guide for using the Bright Data CLI

Get
139
H

html2rss

Generate RSS feeds for any website

Launch
140
G

GetNovaTool

Free online tools PDF, AI, SEO, Image & QR Fast & Private

Launch
141
H

Hanzi Browse

let any ai agent use the local browser

Launch
142
A

agent-browser

Browser automation for AI agents via inference.sh

Get
143
M

Mydentify AI Crawler Access Checker

Checks robots.txt, page-level crawler directives

Launch
144
O

openai/playwright

Automate real browser interactions for navigation, forms, and scraping

Get
145
S

SitemapToLLMs

Convert Any Sitemap to llms.txt

Launch
146
S

Sigma AI Browser

Chat with AI, generate images, summarize articles - for free. All In one Browser

Launch
147
S

seo-optimizer

Should be used when analyzing HTML/CSS websites for SEO optimization

Get
148
B

baoyu-url-to-markdown

Fetch any URL and convert to clean markdown using Chrome CDP

Get
149
K

KnockOutEZ/wigolo

Local web search, fetching, crawling, extraction and research

Get
150
S

SerpSidekick

Give your AI real SEO data

Launch