Skip to content
store
R

robots-txt

Configure, audit, or optimize robots.txt

by kostja94Free

Launch
#8695in AI Skills
0In stores

Description

When the user wants to configure, audit, or optimize robots.txt. Also use when the user mentions "robots.txt," "crawler rules," "block crawl…

Ratings & Reviews

No ratings yet

Be the first to rate robots-txt.

People also visit

F

frontend-design

Instructs Claude to avoid "AI slop" or generic aesthetics

AI Skills
Launch
A

artifacts-builder

Suite of tools for creating elaborate

AI Skills
Launch
C

canvas-design

Design beautiful visual art in .png and .pdf formats using design philosophies

AI Skills
Launch
M

mcp-builder

Guide for creating high-quality MCP servers to integrate external APIs

AI Skills
Launch
P

pdf

Extract text, tables, metadata, merge & annotate PDFs

AI Skills
Launch
W

webapp-testing

Test local web applications using Playwright for UI verification and debugging

AI Skills
Launch
See all robots-txt alternatives

robots-txt FAQ

What is robots-txt?

When the user wants to configure, audit, or optimize robots.txt. Also use when the user mentions "robots.txt," "crawler rules," "block crawlers," "AI

Is robots-txt free?

Yes. robots-txt is free to use.

Do I need to download robots-txt?

No. robots-txt runs in your browser at skills.sh, so there's nothing to install.

Who makes robots-txt?

robots-txt is made by kostja94.

What are the best robots-txt alternatives?

Popular alternatives to robots-txt include frontend-design, artifacts-builder and canvas-design. See all robots-txt alternatives

Developer Stuff

Badges