Skip to content
CrawlSpider

Open source alternatives to CrawlSpider

200 open source apps like CrawlSpider, closest match first.

Top picks

  1. S

    Seo-Promt-Master

    Launch

    πŸ” Google SEO's full docs as an AI prompt machine β€” drop it into your AI assistant to map every public route, audit each page against Google's rules, and fix the gaps step by step.

    FreeOpen source

  2. G

    Geo Optimizer Skill

    Launch

    Open-source Answer Engine Optimization (AEO) & Generative Engine Optimization (GEO) toolkit β€” audit, optimize & track whether ChatGPT, Perplexity, Gemini & Google AI Overviews cite your site. AI SEO / LLM SEO. CLI, Python, MCP, Astro.

    FreeOpen source

  3. F

    FreeCrawl SEO Tool

    Launch

    A high-performance website crawler built for serious SEO audits. Targets 1M+ URLs on a single machine, with a dense Screaming Frog–style UI, 172 SEO issue checks, and zero native dependencies.

    FreeOpen source

  4. G

    Getcito Worlds First Open Source Aio Aeo Or Geo Tool

    Launch

    GetCito the World's First Open Source AI Search Optimization (AIO) / Answer Engine Optimization (AEO) or Generative Engine Optimization (GEO) and AI Visibility Tracking Tool.

    FreeOpen source

  5. L

    LinkResearchTools

    Launch

    Perform advanced, comprehensive and most important correct analysis of links, redirects, and REL-canonicals. Use this extension for your SEO analysis, On page SEO, Off page SEO, competitor analysis and more. Here are some of the things you

    FreeOpen source

  6. C

    Canonry

    Launch

    Open-source tools to track AI search and site visits, then make changes you approve. Run Canonry on your own server with the AI agent you already use.

    FreeOpen sourceSelf-hosted

More like CrawlSpider

7
S

saurabhsharma2u/search-console-mcp

Interact with Google Search Console and Bing Webmaster Tools

Get
8
S

Searchmirror

Open-source, self-hosted rank tracker

Launch
9
O

Open

Self-hosted AI visibility tracking (AEO / GEO / LLMO)

Launch
10
S

SerpBear

Search engine position tracking and keyword research

Launch
11
E

EGEOagents

Open-source Generative Engine Optimization (GEO) & Answer Engine Optimization

Launch
12
A

AIPRM

Identify risks quickly, automate risk assessment & monitoring

Launch
13
A

Automated Business Analysis Workflow

n8n workflow - Scrapes any URL, uses AI to generate a comprehensive business…

Launch
14
C

Core

AI-powered CMS core for personal blogs and creator websites

Launch
15
G

Geoptimize

Deterministic content-readiness lint

Launch
16
S

Search Solved Public SEO

SEO Python scripts and Apps by Lee Foot

Launch
17
A

AI Directories

Submit Your AI Tool to 100+ Directories

Launch
18
S

seo-monster

SEOMonster: a local, user-credential-driven MCP server

Get
19
B

bisibility

Open-source SEO platform

Launch
20
G

Google Analytics MCP

Google Analytics 4 data to AI agents, agentic workflows, and MCP clients

Launch
21
C

Cited

Open-source AI citation monitoring platform

Launch
22
C

Crawl4AI

Open-source web crawler and scraper

Launch
23
B

Botonic

Create conversational experiences, measure bot performance

Launch
24
M

Marreta

Tool for analyzing, cleaning, and tidying up web URLs

Launch
25
S

Shortlink

Self-hosted short link and live QR platform

Launch
26
N

NotFair

Open-source Claude Code skills for SEO, Google Ads, and Meta Ads

Get
27
O

OneGlanse

Open-source AI visibility, AEO & GEO tracker

Launch
28
O

Openbrowser

Let AI agents browse the web. An autonomous toolkit for browser-based AI agents

Launch
29
S

StatusScout

Monitor website uptime, detect security vulnerabilities, find broken links

Launch
30
S

Slugy

Open-source URL shortener with analytics, custom domains, QR codes

Launch
31
G

Google Ads Meta Ads MCP

Google Ads MCP server + Meta Ads MCP (Facebook Ads MCP) + Google Analytics MCP

Launch
32
N

Ninelytics

Open source web analytics platform

Launch
33
W

WriteText.ai for Magento

From keyword analysis to published content, every product page optimized

Launch
34
I

INK

AI content assistant that combines SEO optimization with writing tools

Launch
35
A

Ansvisor

Open-source AI Search Intelligence Platform

Launch
36
C

Content Pipeline

AI-powered content production pipeline for creators

Launch
37
L

Lettertrace

Monitors how AI assistants like ChatGPT mention your brand

Launch
38
S

Spidercreator

Automated web scraping spider generation using Browser Use and LLMs

Launch
39
C

CPA-Manager-Plus

A self-hosted CPA / CLIProxyAPI management panel

Launch
40
R

Reader

Open source web infrastructure for AI

Launch
41
O

OpenAssistantGPT

Build a smart RAG chatbot with the OpenAI Assistant API

Launch
42
C

Chatgpt Scraper API

Collect structured responses from a ChatGPT scraper by sending a prompt

Launch
43
A

Ai-Website-Builder

Instantly create beautiful, responsive websites with AI

Launch
44
S

Scrapecraft

AI-powered web scraping editor with visual workflow builder

Launch
45
T

Teracrawl

High-performance web crawler API optimized for LLMs

Launch
46
G

Growchief

The Ultimate all-in social media automation (outreach) tool

Launch
47
P

Parchi

Your AI friend right in your browser

Launch
48
D

Ditto

Clones any public website into clean Next.js or Vite code

Launch
49
B

Business Leads AI Automation

Open-source AI sales & marketing OS: find leads

Launch
50
Y

Youtube Automation Agent

Fully automated YouTube channel management with AI agents

Launch

About CrawlSpider

C

CrawlSpider

SEO,WordPress,WooCommerce,internal links, broken link checker,link building

CrawlSpider revolutionizes SEO with automated internal linking for WordPress. Boost rankings effortlessly, save time, and get detailed reports. CrawlSpider empowers WordPress site owners, bloggers, and SEO professionals to effortlessly optimize their internal linking structure.

Price
Paid
Category
AI
Website
crawlspider.com