Skip to content
Mydentify AI Crawler Access Checker

Open source alternatives to Mydentify AI Crawler Access Checker

200 open source apps like Mydentify AI Crawler Access Checker, closest match first.

Top picks

  1. C

    Crawl4AI

    Launch

    Open-source web crawler and scraper that produces clean, structured output optimized for LLMs, RAG pipelines, and AI agents. Supports async crawling, CSS/XPath/LLM extraction, and stealth browser control.

    Open source

  2. F

    FreeCrawl SEO Tool

    Launch

    A high-performance website crawler built for serious SEO audits. Targets 1M+ URLs on a single machine, with a dense Screaming Frog–style UI, 172 SEO issue checks, and zero native dependencies.

    Open source

  3. S

    StatusScout

    Launch

    Monitor website uptime, detect security vulnerabilities, find broken links, and simulate user flows. Get instant alerts when issues arise. Free tier available.

    Open source

  4. O

    Openbrowser

    Launch

    Let AI agents browse the web. An autonomous toolkit for browser-based AI agents.

    Open source

  5. R

    Reader

    Launch

    Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.

    Open source

  6. M

    Maxun

    Launch

    Turn any website into structured data using a visual recorder, natural language prompts, or API. Includes proxy rotation, scheduling, and webhook integrations.

    Open sourceSelf-hosted

More like Mydentify AI Crawler Access Checker

7
P

Playwright Bot Bypass

Claude Code skill to bypass bot detection (Google CAPTCHA, etc.)

Launch
8
H

HeadlessX

The undetected self-hosted browser automation platform

Launch
9
C

Chatgpt Scraper API

Collect structured responses from a ChatGPT scraper by sending a prompt

Launch
10
C

Camofox Browser

Stealth headless browser for AI agents

Launch
11
S

Sosse

Selenium Open Source Search Engine & crawler

Launch
12
C

Camofox Browser

Anti-detection browser server for AI agents

Launch
13
S

Skyvern

Transform manual browser tasks into automated workflows using AI

Launch
14
A

Agent Browser

Execute complex automation scripts via remote cloud sessions , featuring…

Launch
15
R

Rayobrowse

Stealth Chromium browser for web scraping and AI agents

Launch
16
A

Agent Fetch

Full-content web fetcher for AI agents

Launch
17
S

Spidercreator

Automated web scraping spider generation using Browser Use and LLMs

Launch
18
S

Scrapecraft

AI-powered web scraping editor with visual workflow builder

Launch
19
M

Marreta

Tool for analyzing, cleaning, and tidying up web URLs

Launch
20
B

Bux

Browser Use Box: a 24/7 Claude Code agent

Launch
21
T

Teracrawl

High-performance web crawler API optimized for LLMs

Launch
22
S

Spider

Foundational low latency web data collecting in Rust

Launch
23
D

Dstp

Run common networking tests against any site

Launch
24
O

Ocbot

Your Web4 Agent

Launch
25
B

Browsertrix Crawler

Run a high-fidelity browser-based web archiving crawler in a single Docker

Launch
26
G

Gpt4V-scraper

AI agent that can SEE , control, navigate, & do stuff for you on your browser

Launch
27
S

Seo-Promt-Master

Google SEO's full docs as an AI prompt machine

Launch
28
S

Scrapper

Web scraper with a simple REST API living in Docker

Launch
29
R

Recognizer

Gracefully face reCAPTCHA challenge

Launch
30
U

Uptime Monitor

Uptime monitor powered by GitHub Actions

Launch
31
S

Searchmirror

Open-source, self-hosted rank tracker

Launch
32
H

Hanzi Browse

let any ai agent use the local browser

Launch
33
C

Chatgpt Scraper

Easily collect responses from ChatGPT scraper by providing a prompt along

Launch
34
P

Perplexideez

Search the web and your self-hosted apps using local AI agents

Launch
35
B

BotBrowser

Advanced Privacy Browser Core with Unified Fingerprint Defense: Cloudflare…

Launch
36
A

Antibot-Detector

Real-time detection of anti-bot systems, captchas & fingerprinting techniques

Launch
37
I

Invisible Playwright MCP

Playwright MCP server undetected by anti-bots

Launch
38
R

requestrepo

Analyze HTTP, DNS and SMTP requests and create custom responses

Launch
39
P

Playwright With Fingerprints

Anonymous automation via playwright with fingerprint replacement technology

Launch
40
B

Browser Echo

Stream browser logs to terminal, zero setup, perfect for Ai Agents

Launch
41
W

WhatCMS

CMS Detection and Exploit Kit based on Whatcms.org API

Launch
42
S

Stealth Browser MCP

Stealth browser automation for AI agents over MCP

Launch
43
S

SneakerBot

All-in-one bot, with auto captcha-solving and proxy management

Launch
44
A

Araa Search

A privacy-respecting, ad-free, self-hosted Google metasearch engine

Launch
45
F

FlareSolverr

Proxy server to bypass Cloudflare protection

Launch
46
T

Trafficbot

This script generates traffic for websites

Launch
47
R

Redirect Bypasser (WebExtension)

Avoid redirects and has direct access to the sites you want to visit

Launch
48
P

Parchi

Your AI friend right in your browser

Launch
49
W

Web Check

All-in-one OSINT tool, for quickly checking a websites data

Launch
50
S

saurabhsharma2u/search-console-mcp

Interact with Google Search Console and Bing Webmaster Tools

Get

About Mydentify AI Crawler Access Checker

M

Mydentify AI Crawler Access Checker

Checks robots.txt, page-level crawler directives

Find out whether ChatGPT and Claude can reach the pages you want them to use. Spot access rules that may be keeping your product out of AI discovery.

Price
Free
Category
Developer Tools
Website
mydentify.com