firecrawl-download

작성자: firecrawl

전체 웹사이트를 여러 형식의 정리된 로컬 파일로 다운로드합니다. 먼저 사이트 구조를 매핑한 후, 발견된 각 페이지를 .firecrawl/ 아래의 중첩 디렉토리로 스크래핑하며, 마크다운, 링크, 스크린샷 및 사용자 정의 형식 조합을 지원합니다. 경로 패턴(--include-paths, --exclude-paths), 검색 쿼리, 서브도메인 포함 여부 및 페이지 제한을 통해 페이지를 필터링하여 범위를 제어합니다. 모든 표준 스크래핑 옵션은 다운로드와 함께 작동합니다: 형식 선택, 전체 페이지 스크린샷, 주요 콘텐츠...

npx skills add https://github.com/firecrawl/cli --skill firecrawl-download

ZIP 다운로드 GitHub

586

firecrawl download

Experimental. Convenience command that combines map + scrape to save an entire site as local files.

Maps the site first to discover pages, then scrapes each one into nested directories under .firecrawl/. All scrape options work with download. Always pass -y to skip the confirmation prompt.

When to use

You want to save an entire site (or section) to local files
You need offline access to documentation or content
Bulk content extraction with organized file structure

Quick start

# Interactive wizard (picks format, screenshots, paths for you)
firecrawl download https://docs.example.com

# With screenshots
firecrawl download https://docs.example.com --screenshot --limit 20 -y

# Multiple formats (each saved as its own file per page)
firecrawl download https://docs.example.com --format markdown,links --screenshot --limit 20 -y
# Creates per page: index.md + links.txt + screenshot.png

# Filter to specific sections
firecrawl download https://docs.example.com --include-paths "/features,/sdks"

# Skip translations
firecrawl download https://docs.example.com --exclude-paths "/zh,/ja,/fr,/es,/pt-BR"

# Full combo
firecrawl download https://docs.example.com \
  --include-paths "/features,/sdks" \
  --exclude-paths "/zh,/ja" \
  --only-main-content \
  --screenshot \
  -y

Download options

Option	Description
`--limit <n>`	Max pages to download
`--search <query>`	Filter URLs by search query
`--include-paths <paths>`	Only download matching paths
`--exclude-paths <paths>`	Skip matching paths
`--allow-subdomains`	Include subdomain pages
`-y`	Skip confirmation prompt (always use in automated flows)

Scrape options (all work with download)

-f <formats>, -H, -S, --screenshot, --full-page-screenshot, --only-main-content, --include-tags, --exclude-tags, --wait-for, --max-age, --country, --languages