Arachne MCP Server

🕷️ 9 個 MCP 工具，用於網頁爬取、瀏覽器自動化、視覺、轉錄與 RAG 查詢

文件

🕷️ Arachne MCP Server

🌐 English · 🇧🇷 Português

49 MCP tools for web scraping, browser automation, computer vision, audio transcription, RAG, Social Sentiment Research, and Visual Regression Testing (VRT) — the Oito Olhos (Spider's Eight Eyes) — all through the Arachne API.

Backed by Arachne. Works with Claude Desktop, Cursor, Codex CLI, Hermes, and any MCP client.

✨ Tools (49)

🔍 Web & Data

Tool	What it does	Best for
`arachne_search`	Web search via DuckDuckGo	Research, lead collection
`arachne_scrape`	Clean markdown from URLs	Static pages, blogs, docs
`arachne_extract`	Extracts ANY format (audio, video, PDF, YouTube)	Swiss-army knife
`arachne_browser_extract`	Real browser with Cloudflare/CAPTCHA evasion	Sites that block scrapers
`arachne_browser_run`	Browser actions (click, type, login)	Form automation
`arachne_screenshot`	Screenshot of a URL (full page or viewport)	Visual evidence
`arachne_record`	Records a screencast of a page (.webm)	Interactions, demos
`arachne_torrent_extract`	Extracts magnet links from BR torrent sites	Torrent acquisition
`arachne_download`	Universal download (URL, repo, PyPI, npm)	Fetch any artifact
`arachne_query`	Ask your RAG knowledge base	Chatbot with your data

🔍 Social Sentiment Research

Tool	What it does	Best for
`arachne_social_research`	Searches what people REALLY say (HN/Reddit/YouTube, last N days) + AI judge via local VLM	Hype vs reality, complaints, market sentiment

👁️ Vision & Audio

Tool	What it does	Best for
`arachne_vision`	Image analysis: OCR, colors, faces, AI description	Text extraction from photos
`arachne_screenshot_vision`	Screenshot + full vision pipeline	Visual page inspection
`arachne_pdf_vision`	Extracts images from PDF + vision analysis	Scanned PDFs
`arachne_analyze_video`	Video metadata: colors, OCR, geometry, VQA, audio	Video understanding
`arachne_transcribe`	Audio/video/YouTube transcription with Whisper	Podcast, meeting, video

🕷️ Oito Olhos — Visual Regression Testing (VRT)

Tool	What it does	Best for
`arachne_visual_snapshot`	Captures URL → creates baseline (1st time) or compares	Idempotent visual tests
`arachne_visual_diff`	Compares with baseline → diff + semantic verdict	Post-deploy verification
`arachne_visual_gates`	Deterministic audit: overflow, text collision, JS errors	Key-free, no baseline
`arachne_visual_report`	Test suite → HTML side-by-side	Consolidated review
`arachne_visual_approve`	Promotes current → new baseline	Accept an expected change
`arachne_visual_list`	Lists baselines + status	Monitor what exists
`arachne_visual_video`	Video VRT: records screencast + compares (animations)	Hover, carousels, transitions
`arachne_visual_video_report`	Video suite → interactive HTML report	Animation regression review

🤖 Desktop & Agentic

Tool	What it does	Best for
`arachne_desktop`	Desktop control (windows, type, key, click)	OS automation
`arachne_desktop_os`	Desktop agentic with VLM "eye" (screenshot + describe)	See before acting
`arachne_observe`	Screenshot + numbered clickable bounding boxes	GUI agent navigation

📦 GitHub / GitLab / Packages

Tool	What it does
`arachne_repo_download`	Download GitHub repo as zip (branch/token)
`arachne_repo_fork`	Fork a GitHub repo
`arachne_repo_forks`	List forks by stars
`arachne_repo_index`	Download + index repo into RAG
`arachne_releases`	List GitHub releases with assets
`arachne_release_download`	Download a release asset
`arachne_pypi_download`	Download PyPI package (sdist/wheel)
`arachne_npm_download`	Download npm package tarball
`arachne_gitlab_download`	Download GitLab project archive
`arachne_github_trending`	GitHub trending repos + developers (period/language, zero cost)
`arachne_github_user_prs`	PRs authored by a user (since/until filters)
`arachne_github_user_activity`	Monthly activity + event types for a user
`arachne_github_repo_metadata`	Full repo metadata (stars/forks/issues/license)

🧠 Code Knowledge Graph

Tool	What it does
`code_graph`	Explore code structure: stats, search, routes, files, deps
`kg_context`	Ranked BFS code context (~2K tokens)
`kg_communities`	Community detection (Leiden/greedy)
`kg_god_nodes`	Most influential code entities (PageRank)
`kg_watch`	Git watcher — incremental change detection

🧭 Utilities

Tool	What it does
`arachne_capabilities`	Auto-discover capabilities
`arachne_ping`	Health check
`arachne_metrics`	Server metrics (CPU, RAM, disk)
`arachne_plan`	Goal analysis → tool chain suggestion
`arachne_calc`	Safe math calculator (AST-sandboxed)
`arachne_format_converter`	Universal converter (65+ formats)
`arachne_sandbox_status`	Check ai-jail sandbox availability

VRT with local LLM: Oito Olhos uses pixel diff + DOM pairing + CLIP semantic triage + local VLM (Qwen2.5-VL via Douglas, Samuel mirror fallback) — classifying changes as regression | expected | noise, with a fix suggestion (CORRECAO:) when it detects a bug. No third-party API key for the verdict.

Social Research with local AI judge: arachne_social_research searches Hacker News (Algolia), Reddit (JSON API + browser_agent/Camoufox fallback) and YouTube (yt-dlp) in the last N days, scores by real engagement (upvotes/points/views), and synthesizes a hype vs reality report with a local VLM (no third-party API keys).

🚀 Quick Start

1. Get an API key

Create one at arachne.seu.pet/dev (Free plan: 500 req/month).

2. Configure in Claude Desktop

{
  "mcpServers": {
    "arachne": {
      "command": "python3",
      "args": ["-m", "arachne_mcp"],
      "env": {
        "ARACHNE_API_KEY": "arn_your_key_here",
        "ARACHNE_API_URL": "https://arachne.seu.pet"
      }
    }
  }
}

3. Or run directly

pip install arachne-mcp
export ARACHNE_API_KEY="arn_your_key_here"
python3 -m arachne_mcp

🪟 Windows install (works out of the box)

arachne-mcp is a pure-Python client (only httpx) — no Linux-only dependencies, no WSL required. Install it on Windows with:

pip install arachne-mcp

Then configure it in any MCP client using the console-script entry point (arachne-mcp is on your PATH after install):

{
  "mcpServers": {
    "arachne": {
      "command": "arachne-mcp",
      "args": [],
      "env": {
        "ARACHNE_API_KEY": "arn_your_key_here",
        "ARACHNE_API_URL": "https://arachne.seu.pet"
      }
    }
  }
}

⚠️ Do not point command at a Linux path (e.g. /home/user/.../venv/bin/arachne-mcp) — that only exists on the machine where the Arachne server runs. On Windows (and any other client machine) use the pip package + API key: the server does all heavy work (browser, VLM, vision, RAG) behind https://arachne.seu.pet.

📡 Architecture

The MCP server is a thin proxy: it forwards each tool call to the Arachne API (POST /api/mcp/proxy), which executes the tool server-side and returns the result. This keeps the client light (only httpx), while all heavy work — browser, VLM, vision, RAG — runs on the Arachne server.

Claude Desktop / Cursor / Codex
        │  MCP (stdio)
        ▼
arachne-mcp (thin proxy, 49 tools)
        │  HTTP + X-API-Key
        ▼
Arachne API (arachne.seu.pet) → executes tool → returns JSON

🔐 Security

API key auth: every request carries X-API-Key (create at /dev)
Rate limits enforced server-side per plan
No code runs client-side — the proxy only forwards arguments