firecrawl-knowledge-base
Build a knowledge base from web content with Firecrawl
by firecrawlFree
Description
firecrawl-knowledge-base is an agent skill that builds a knowledge base from web content using Firecrawl. It turns a set of URLs or a topic into organised, LLM-ready content, which can serve as local reference documents, chunks ready for retrieval-augmented generation, a dataset for fine-tuning, a mirror of documentation, or a topic collection. The skill begins with a short onboarding step. It infers the source, the goal, the depth and where the output should go from the conversation, and proceeds straight away when those are clear. It asks no more than one to three short questions, and only when it is blocked, such as for the source URL or topic, whether the output is for reference, retrieval, training or documentation, or the training format if training is wanted. The collection plan uses Firecrawl's search and scrape tools to gather the pages and then organises them. It is part of Firecrawl's workflows repository and is added to a compatible agent with the skills command. Its audits show Gen Agent Trust Hub and Socket passed, with Snyk showing a warning. It suits people who want a large body of web documentation prepared for an assistant or a search index.…
Highlights
- Turns URLs or topics into organised content
- Outputs for reference, RAG, fine-tuning or docs
- Short onboarding with few questions
- Uses Firecrawl search and scrape
Ratings & Reviews
No ratings yet
Be the first to rate firecrawl-knowledge-base.
People also visit
firecrawl-interact
Live browser interaction on scraped pages using natural language prompts or code
firecrawl-knowledge-ingest
Ingest public or authenticated knowledge bases and docs portals
data-scraper-agent
Build a fully automated AI-powered data collection agent for any public source
lark-wiki
Manage Lark Wiki spaces, members, nodes, and document organization hierarchies
firecrawl-knowledge-base FAQ
What does firecrawl-knowledge-base do?
It gathers web content from URLs or a topic with Firecrawl and organises it into an LLM-ready knowledge base.
What can the output be used for?
Local reference docs, retrieval-augmented generation chunks, fine-tuning datasets, documentation mirrors and topic collections.
Does it ask many questions first?
No. It infers what it can and asks at most one to three short questions when blocked.
How do I install it?
Run: npx skills add https://github.com/firecrawl/firecrawl-workflows --skill firecrawl-knowledge-base
What security audits has it passed?
Gen Agent Trust Hub and Socket passed. Snyk shows a warning.
What are the best firecrawl-knowledge-base alternatives?
Popular alternatives to firecrawl-knowledge-base include firecrawl-interact, firecrawl-knowledge-ingest and data-scraper-agent. See all firecrawl-knowledge-base alternatives