firecrawl-maptarafından firecrawl

Discover URLs on a site. Use --search to find a specific page within a large site.

npx skills add https://github.com/firecrawl/firecrawl-cli --skill firecrawl-map

firecrawl map

Discover URLs on a site. Use --search to find a specific page within a large site.

When to use

  • You need to find a specific subpage on a large site
  • You want a list of all URLs on a site before scraping or crawling
  • Step 3 in the workflow escalation pattern: search → scrape → map → crawl → interact

Quick start

# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt

# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json

Options

OptionDescription
--limit <n>Max number of URLs to return
--search <query>Filter URLs by search query
--sitemap <include|skip|only>Sitemap handling strategy
--include-subdomainsInclude subdomain URLs
--jsonOutput as JSON
-o, --output <path>Output file path

Tips

  • Map + scrape is a common pattern: use map --search to find the right URL, then scrape it.
  • Example: map https://docs.example.com --search "auth" → found /docs/api/authenticationscrape that URL.

See also

NotebookLM Web Importer

Web sayfalarını ve YouTube videolarını tek tıkla NotebookLM'e aktarın. 200.000'den fazla kullanıcı tarafından güveniliyor.

Chrome Eklentisini Yükle