firecrawl-map

作者: firecrawl

探索並篩選網站上的URL,可選擇搜尋以定位特定頁面。支援透過搜尋查詢來過濾大型網站中符合關鍵字的頁面。包含網站地圖處理策略(包含、跳過或僅使用)以及可選的子域名包含功能。輸出結果為純文字或JSON格式,並可設定URL數量限制。通常與firecrawl-scrape搭配使用:先使用地圖搜尋功能找到目標URL,再進行抓取。

npx skills add https://github.com/firecrawl/cli --skill firecrawl-map

firecrawl map

Discover URLs on a site. Use --search to find a specific page within a large site.

When to use

  • You need to find a specific subpage on a large site
  • You want a list of all URLs on a site before scraping or crawling
  • Step 3 in the workflow escalation pattern: search → scrape → map → crawl → interact

Quick start

# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt

# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json

Options

OptionDescription
--limit <n>Max number of URLs to return
--search <query>Filter URLs by search query
--sitemap <include|skip|only>Sitemap handling strategy
--include-subdomainsInclude subdomain URLs
--jsonOutput as JSON
-o, --output <path>Output file path

Tips

  • Map + scrape is a common pattern: use map --search to find the right URL, then scrape it.
  • Example: map https://docs.example.com --search "auth" → found /docs/api/authenticationscrape that URL.

See also

來自 firecrawl 的更多技能