firecrawl-map

Discover and list all URLs on a website, with optional search filtering. Use this skill when the user wants to find a specific page on a large site, list all…

npx skills add https://github.com/firecrawl/firecrawl-codex-plugin --skill firecrawl-map

firecrawl map

Discover URLs on a site. Use --search to find a specific page within a large site.

When to use

  • You need to find a specific subpage on a large site
  • You want a list of all URLs on a site before scraping or crawling
  • Step 3 in the workflow escalation pattern: search → scrape → map → crawl → interact

Quick start

# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt

# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json

Options

OptionDescription
--limit <n>Max number of URLs to return
--search <query>Filter URLs by search query
--sitemap <include|skip|only>Sitemap handling strategy
--include-subdomainsInclude subdomain URLs
--jsonOutput as JSON
-o, --output <path>Output file path

Tips

  • Map + scrape is a common pattern: use map --search to find the right URL, then scrape it.
  • Example: map https://docs.example.com --search "auth" → found /docs/api/authentication → scrape that URL.

See also

More skills from firecrawl

firecrawl-research-index
firecrawl
Find the papers that answer a research query with Firecrawl Research, using semantic search, semantic and structural expansion, and in-body verification. Always use this skill for any literature-finding / paper-retrieval task — single-paper lookups or full multi-paper sets.
data-analysisresearchweb-scraping
oracle
firecrawl
Best practices for using the oracle CLI (prompt + file bundling, engines, sessions, and file attachment patterns).
pinecone
firecrawl
Managed vector database for production AI applications. Fully managed, auto-scaling, with hybrid search (dense + sparse), metadata filtering, and namespaces.…
wpds
firecrawl
Use when building UIs leveraging the WordPress Design System (WPDS) and its components, tokens, patterns, etc.
audiocraft-audio-generation
firecrawl
PyTorch library for audio generation including text-to-music (MusicGen) and text-to-sound (AudioGen). Use when you need to generate music from text…
skypilot-multi-cloud-orchestration
firecrawl
Multi-cloud orchestration for ML workloads with automatic cost optimization. Use when you need to run training or batch jobs across multiple clouds, leverage…
firecrawl-seo-audit
firecrawl
Audit a website's SEO with Firecrawl. Use when the user asks for an SEO audit, metadata and heading review, sitemap/site-structure analysis, keyword opportunities, competitor SERP comparison, or prioritized search optimization recommendations.
data-analysisresearchweb-scraping
gh-issues
firecrawl
Fetch GitHub issues, spawn sub-agents to implement fixes and open PRs, then monitor and address PR review comments. Usage: /gh-issues [owner/repo] [--label…