Arachne MCP Server

🕷️ 9 công cụ MCP cho việc thu thập dữ liệu web, tự động hóa trình duyệt, thị giác máy tính, phiên âm và truy vấn RAG

GitHubDùng thử MCP nàyĐược tài trợ

Tài liệu

🕷️ Arachne MCP Server

🌐 English · 🇧🇷 Português

49 MCP tools for web scraping, browser automation, computer vision, audio transcription, RAG, Social Sentiment Research, and Visual Regression Testing (VRT) — the Oito Olhos (Spider's Eight Eyes) — all through the Arachne API.

Backed by Arachne. Works with Claude Desktop, Cursor, Codex CLI, Hermes, and any MCP client.

✨ Tools (49)

🔍 Web & Data

ToolWhat it doesBest for
arachne_searchWeb search via DuckDuckGoResearch, lead collection
arachne_scrapeClean markdown from URLsStatic pages, blogs, docs
arachne_extractExtracts ANY format (audio, video, PDF, YouTube)Swiss-army knife
arachne_browser_extractReal browser with Cloudflare/CAPTCHA evasionSites that block scrapers
arachne_browser_runBrowser actions (click, type, login)Form automation
arachne_screenshotScreenshot of a URL (full page or viewport)Visual evidence
arachne_recordRecords a screencast of a page (.webm)Interactions, demos
arachne_torrent_extractExtracts magnet links from BR torrent sitesTorrent acquisition
arachne_downloadUniversal download (URL, repo, PyPI, npm)Fetch any artifact
arachne_queryAsk your RAG knowledge baseChatbot with your data

🔍 Social Sentiment Research

ToolWhat it doesBest for
arachne_social_researchSearches what people REALLY say (HN/Reddit/YouTube, last N days) + AI judge via local VLMHype vs reality, complaints, market sentiment

👁️ Vision & Audio

ToolWhat it doesBest for
arachne_visionImage analysis: OCR, colors, faces, AI descriptionText extraction from photos
arachne_screenshot_visionScreenshot + full vision pipelineVisual page inspection
arachne_pdf_visionExtracts images from PDF + vision analysisScanned PDFs
arachne_analyze_videoVideo metadata: colors, OCR, geometry, VQA, audioVideo understanding
arachne_transcribeAudio/video/YouTube transcription with WhisperPodcast, meeting, video

🕷️ Oito Olhos — Visual Regression Testing (VRT)

ToolWhat it doesBest for
arachne_visual_snapshotCaptures URL → creates baseline (1st time) or comparesIdempotent visual tests
arachne_visual_diffCompares with baseline → diff + semantic verdictPost-deploy verification
arachne_visual_gatesDeterministic audit: overflow, text collision, JS errorsKey-free, no baseline
arachne_visual_reportTest suite → HTML side-by-sideConsolidated review
arachne_visual_approvePromotes current → new baselineAccept an expected change
arachne_visual_listLists baselines + statusMonitor what exists
arachne_visual_videoVideo VRT: records screencast + compares (animations)Hover, carousels, transitions
arachne_visual_video_reportVideo suite → interactive HTML reportAnimation regression review

🤖 Desktop & Agentic

ToolWhat it doesBest for
arachne_desktopDesktop control (windows, type, key, click)OS automation
arachne_desktop_osDesktop agentic with VLM "eye" (screenshot + describe)See before acting
arachne_observeScreenshot + numbered clickable bounding boxesGUI agent navigation

📦 GitHub / GitLab / Packages

ToolWhat it does
arachne_repo_downloadDownload GitHub repo as zip (branch/token)
arachne_repo_forkFork a GitHub repo
arachne_repo_forksList forks by stars
arachne_repo_indexDownload + index repo into RAG
arachne_releasesList GitHub releases with assets
arachne_release_downloadDownload a release asset
arachne_pypi_downloadDownload PyPI package (sdist/wheel)
arachne_npm_downloadDownload npm package tarball
arachne_gitlab_downloadDownload GitLab project archive
arachne_github_trendingGitHub trending repos + developers (period/language, zero cost)
arachne_github_user_prsPRs authored by a user (since/until filters)
arachne_github_user_activityMonthly activity + event types for a user
arachne_github_repo_metadataFull repo metadata (stars/forks/issues/license)

🧠 Code Knowledge Graph

ToolWhat it does
code_graphExplore code structure: stats, search, routes, files, deps
kg_contextRanked BFS code context (~2K tokens)
kg_communitiesCommunity detection (Leiden/greedy)
kg_god_nodesMost influential code entities (PageRank)
kg_watchGit watcher — incremental change detection

🧭 Utilities

ToolWhat it does
arachne_capabilitiesAuto-discover capabilities
arachne_pingHealth check
arachne_metricsServer metrics (CPU, RAM, disk)
arachne_planGoal analysis → tool chain suggestion
arachne_calcSafe math calculator (AST-sandboxed)
arachne_format_converterUniversal converter (65+ formats)
arachne_sandbox_statusCheck ai-jail sandbox availability

VRT with local LLM: Oito Olhos uses pixel diff + DOM pairing + CLIP semantic triage + local VLM (Qwen2.5-VL via Douglas, Samuel mirror fallback) — classifying changes as regression | expected | noise, with a fix suggestion (CORRECAO:) when it detects a bug. No third-party API key for the verdict.

Social Research with local AI judge: arachne_social_research searches Hacker News (Algolia), Reddit (JSON API + browser_agent/Camoufox fallback) and YouTube (yt-dlp) in the last N days, scores by real engagement (upvotes/points/views), and synthesizes a hype vs reality report with a local VLM (no third-party API keys).

🚀 Quick Start

1. Get an API key

Create one at arachne.seu.pet/dev (Free plan: 500 req/month).

2. Configure in Claude Desktop

{
  "mcpServers": {
    "arachne": {
      "command": "python3",
      "args": ["-m", "arachne_mcp"],
      "env": {
        "ARACHNE_API_KEY": "arn_your_key_here",
        "ARACHNE_API_URL": "https://arachne.seu.pet"
      }
    }
  }
}

3. Or run directly

pip install arachne-mcp
export ARACHNE_API_KEY="arn_your_key_here"
python3 -m arachne_mcp

🪟 Windows install (works out of the box)

arachne-mcp is a pure-Python client (only httpx) — no Linux-only dependencies, no WSL required. Install it on Windows with:

pip install arachne-mcp

Then configure it in any MCP client using the console-script entry point (arachne-mcp is on your PATH after install):

{
  "mcpServers": {
    "arachne": {
      "command": "arachne-mcp",
      "args": [],
      "env": {
        "ARACHNE_API_KEY": "arn_your_key_here",
        "ARACHNE_API_URL": "https://arachne.seu.pet"
      }
    }
  }
}

⚠️ Do not point command at a Linux path (e.g. /home/user/.../venv/bin/arachne-mcp) — that only exists on the machine where the Arachne server runs. On Windows (and any other client machine) use the pip package + API key: the server does all heavy work (browser, VLM, vision, RAG) behind https://arachne.seu.pet.

📡 Architecture

The MCP server is a thin proxy: it forwards each tool call to the Arachne API (POST /api/mcp/proxy), which executes the tool server-side and returns the result. This keeps the client light (only httpx), while all heavy work — browser, VLM, vision, RAG — runs on the Arachne server.

Claude Desktop / Cursor / Codex
        │  MCP (stdio)
        ▼
arachne-mcp (thin proxy, 49 tools)
        │  HTTP + X-API-Key
        ▼
Arachne API (arachne.seu.pet) → executes tool → returns JSON

🔐 Security

  • API key auth: every request carries X-API-Key (create at /dev)
  • Rate limits enforced server-side per plan
  • No code runs client-side — the proxy only forwards arguments