firecrawl-download

作者: firecrawl

將整個網站下載為多種格式的組織化本地檔案。首先映射網站結構,然後將每個發現的頁面抓取到 .firecrawl/ 下的巢狀目錄中,支援 Markdown、連結、螢幕截圖及自訂格式組合。透過路徑模式(--include-paths、--exclude-paths)、搜尋查詢、子網域包含及頁面限制來過濾頁面以控制範圍。所有標準抓取選項均適用於下載:格式選擇、全頁螢幕截圖、主要內容...

npx skills add https://github.com/firecrawl/cli --skill firecrawl-download

firecrawl download

Experimental. Convenience command that combines map + scrape to save an entire site as local files.

Maps the site first to discover pages, then scrapes each one into nested directories under .firecrawl/. All scrape options work with download. Always pass -y to skip the confirmation prompt.

When to use

  • You want to save an entire site (or section) to local files
  • You need offline access to documentation or content
  • Bulk content extraction with organized file structure

Quick start

# Interactive wizard (picks format, screenshots, paths for you)
firecrawl download https://docs.example.com

# With screenshots
firecrawl download https://docs.example.com --screenshot --limit 20 -y

# Multiple formats (each saved as its own file per page)
firecrawl download https://docs.example.com --format markdown,links --screenshot --limit 20 -y
# Creates per page: index.md + links.txt + screenshot.png

# Filter to specific sections
firecrawl download https://docs.example.com --include-paths "/features,/sdks"

# Skip translations
firecrawl download https://docs.example.com --exclude-paths "/zh,/ja,/fr,/es,/pt-BR"

# Full combo
firecrawl download https://docs.example.com \
  --include-paths "/features,/sdks" \
  --exclude-paths "/zh,/ja" \
  --only-main-content \
  --screenshot \
  -y

Download options

OptionDescription
--limit <n>Max pages to download
--search <query>Filter URLs by search query
--include-paths <paths>Only download matching paths
--exclude-paths <paths>Skip matching paths
--allow-subdomainsInclude subdomain pages
-ySkip confirmation prompt (always use in automated flows)

Scrape options (all work with download)

-f <formats>, -H, -S, --screenshot, --full-page-screenshot, --only-main-content, --include-tags, --exclude-tags, --wait-for, --max-age, --country, --languages

See also

來自 firecrawl 的更多技能