firecrawl-scrape

作者: firecrawl

從任何URL提取乾淨的Markdown,包括JavaScript渲染的單頁應用程式。當使用者提供URL並希望取得其內容,或說出「scrape」時,使用此技能。

npx skills add https://github.com/firecrawl/firecrawl-codex-plugin --skill firecrawl-scrape

firecrawl scrape

Scrape one or more URLs. Returns clean, LLM-optimized markdown. Multiple URLs are scraped concurrently.

When to use

  • You have a specific URL and want its content
  • The page is static or JS-rendered (SPA)
  • Step 2 in the workflow escalation pattern: search → scrape → map → crawl → interact

Quick start

# Basic markdown extraction
firecrawl scrape "<url>" -o .firecrawl/page.md

# Main content only, no nav/footer
firecrawl scrape "<url>" --only-main-content -o .firecrawl/page.md

# Wait for JS to render, then scrape
firecrawl scrape "<url>" --wait-for 3000 -o .firecrawl/page.md

# Multiple URLs (each saved to .firecrawl/)
firecrawl scrape https://example.com https://example.com/blog https://example.com/docs

# Get markdown and links together
firecrawl scrape "<url>" --format markdown,links -o .firecrawl/page.json

# Ask a question about the page
firecrawl scrape "https://example.com/pricing" --query "What is the enterprise plan price?"

Options

OptionDescription
-f, --format <formats>Output formats: markdown, html, rawHtml, links, screenshot, json
-Q, --query <prompt>Ask a question about the page content (5 credits)
-HInclude HTTP headers in output
--only-main-contentStrip nav, footer, sidebar — main content only
--wait-for <ms>Wait for JS rendering before scraping
--include-tags <tags>Only include these HTML tags
--exclude-tags <tags>Exclude these HTML tags
-o, --output <path>Output file path

Tips

  • Prefer plain scrape over --query. Scrape to a file, then use grep, head, or read the markdown directly — you can search and reason over the full content yourself. Use --query only when you want a single targeted answer without saving the page (costs 5 extra credits).
  • Try scrape before interact. Scrape handles static pages and JS-rendered SPAs. Only escalate to interact when you need interaction (clicks, form fills, pagination).
  • Multiple URLs are scraped concurrently — check firecrawl --status for your concurrency limit.
  • Single format outputs raw content. Multiple formats (e.g., --format markdown,links) output JSON.
  • Always quote URLs — shell interprets ? and & as special characters.
  • Naming convention: .firecrawl/{site}-{path}.md

See also

來自 firecrawl 的更多技能

firecrawl-research-index
firecrawl
使用 Firecrawl Research 進行語義搜尋、語義與結構擴展以及內文驗證,找出能回答研究查詢的論文。對於任何文獻查找或論文檢索任務(無論是單篇論文查詢還是完整的多論文集合),一律使用此技能。
data-analysisresearchweb-scraping
oracle
firecrawl
使用 oracle CLI 的最佳實踐(提示與檔案捆綁、引擎、會話及檔案附加模式)。
pinecone
firecrawl
專為生產級AI應用設計的受管向量資料庫。全受管、自動擴展,具備混合搜尋(密集+稀疏)、元資料過濾與命名空間功能。…
wpds
firecrawl
在構建利用WordPress設計系統(WPDS)及其組件、標記、模式等的用戶界面時使用。
audiocraft-audio-generation
firecrawl
用於音訊生成的 PyTorch 函式庫,包含文字轉音樂(MusicGen)和文字轉音效(AudioGen)。當需要從文字生成音樂時使用…
skypilot-multi-cloud-orchestration
firecrawl
針對機器學習工作負載的多雲編排,具備自動成本優化功能。當您需要跨多個雲端執行訓練或批次作業、利用…時使用。
firecrawl-seo-audit
firecrawl
使用 Firecrawl 審查網站的 SEO。適用於使用者要求進行 SEO 審查、中繼資料與標題檢視、網站地圖/網站結構分析、關鍵字機會、競爭對手 SERP 比較,或優先搜尋最佳化建議時。
data-analysisresearchweb-scraping
gh-issues
firecrawl
擷取 GitHub 問題,生成子代理來實作修復並開啟 PR,然後監控並處理 PR 審查意見。用法:/gh-issues [owner/repo] [--label…