Socialcrawl MCP

Single API key to access 21 + real time social media data

Documentation

socialcrawl-mcp

Give your AI agent access to 44 platforms — social media, commerce & product reviews, app stores, places & travel, business reputation, web research, full web scraping & browser automation, prediction markets, search trends, cross-platform Prism composites, and a universal cross-platform meta-search — through a single API

Overview

socialcrawl-mcp is an MCP (Model Context Protocol) server that connects AI agents to the SocialCrawl API — a unified data API covering 44 platforms and 357 endpoints.

Retrieve profiles, posts, comments, search results, trending content, and analytics from TikTok, Instagram, YouTube, Twitter/X, LinkedIn, Reddit, GitHub, Hacker News, Polymarket, and 30 more platforms. Pull products, reviews, and sellers from Amazon and Google Shopping; apps, charts, and reviews from Google Play and the Apple App Store; places, hotels, and traveler reviews from Tripadvisor and Google Business; brand reputation from Trustpilot; Korean search across 11 Naver corpora; cross-web brand mentions with sentiment via Content Analysis; Google News headlines and Google Finance quotes — plus web research via Tavily and Perplexity, AI-powered X search via Grok, and a single /search/everywhere endpoint that fans out across 12+ sources in one call.

New in this release: a major LinkedIn expansion (44 endpoints — full profiles & company pages, posts/reposts/reactions, comments & replies, people & company-people search, structured profile sub-resources, jobs, company insights, and groups), deeper Instagram coverage (followers/following, similar accounts, post likers, stories, tagged & location feeds, post-reshare stats, engagement analytics, and one-call reels/posts feeds with per-item share counts), and new YouTube capabilities (trending & advanced search, autocomplete suggestions, playlist items, and downloadable media files — audio, video, subtitles, thumbnails). Alongside the Prism family — server-side composite endpoints that fan out across many platforms and fold the results into one report (universal URL lookup, full comments harvesting, cross-source reputation, share-of-voice, brand-mention and consumer-demand nowcasts, AI consensus answers, crisis radar, creator vetting, and video/app/product intelligence). One API key, one consistent response format, every platform.

What the MCP server does:

Discovers available platforms and endpoints dynamically
Fetches live social media data on your behalf
Validates requests locally before making API calls (saves credits)
Provides built-in API documentation the agent can query on demand

Installation

Remote server (hosted — no install)

Connect straight to the hosted Streamable HTTP endpoint — nothing to install or run:

Claude Code (works in the CLI and Claude Code on the web / cloud sandboxes)

claude mcp add --scope user --transport http socialcrawl https://mcp.socialcrawl.dev/mcp \
  --header "Authorization: Bearer sc_your_key_here"

Any client that reads .mcp.json

{
  "mcpServers": {
    "socialcrawl": {
      "type": "http",
      "url": "https://mcp.socialcrawl.dev/mcp",
      "headers": { "Authorization": "Bearer ${SOCIALCRAWL_API_KEY}" }
    }
  }
}

Cursor / Windsurf / VS Code — choose the HTTP ("streamable-http") server type with the same URL and header. x-api-key: sc_your_key_here works as an alternative header.

The discovery tools (socialcrawl_list_platforms, socialcrawl_list_endpoints, socialcrawl_get_docs) work without a key, so you can explore before signing up. claude.ai custom connectors (Settings → Connectors) require OAuth, which ships in a follow-up release — use the header-based setup above in the meantime.

Prefer running it locally? Every stdio option below works exactly as before.

npm

npm install -g socialcrawl-mcp

Available on npm. Most users don't need this — the MCP client configs below use npx and auto-install on first run.

Claude Code (quickest)

claude mcp add --scope user socialcrawl -- npx -y socialcrawl-mcp

Then set your API key:

claude mcp add-env socialcrawl SOCIALCRAWL_API_KEY sc_your_key_here

Claude Desktop

Add to ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows):

{
  "mcpServers": {
    "socialcrawl": {
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

Cursor

Add to .cursor/mcp.json in your project root or ~/.cursor/mcp.json globally:

{
  "mcpServers": {
    "socialcrawl": {
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

VS Code (Claude Code)

Add to .vscode/mcp.json in your project or your user settings:

{
  "servers": {
    "socialcrawl": {
      "type": "stdio",
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

Windsurf

Add to your Windsurf MCP configuration:

{
  "mcpServers": {
    "socialcrawl": {
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

Other MCP-compatible clients

Any MCP client that supports stdio transport can use this server. The general pattern is:

Command: npx
Args: ["-y", "socialcrawl-mcp"]
Environment: SOCIALCRAWL_API_KEY set to your API key

Restart your AI client after saving the configuration.

Setup

1. Get your API key

Sign up at socialcrawl.dev and grab your API key from the dashboard. Every account starts with 100 free credits — no credit card required.

2. Add the key to your config

Replace sc_your_key_here in the installation config above with your actual API key (starts with sc_).

[!TIP] You can also set SOCIALCRAWL_API_KEY as a system environment variable instead of putting it in the MCP config. The discovery and documentation tools work even without a key — only actual API requests need one.

Usage

Ask your AI agent in natural language. The MCP server handles the rest.

Fetch a profile

Get the TikTok profile for @charlidamelio

The agent calls socialcrawl_request with platform: "tiktok", resource: "profile", params: { handle: "charlidamelio" } and returns structured profile data including followers, bio, verification status, and engagement metrics.

Search across platforms

Search YouTube for "machine learning tutorials"

Get post comments

Get the comments on this Instagram post: https://instagram.com/p/CwA1234abcd

Cross-platform research

Compare the follower counts of @mkbhd on TikTok, Instagram, YouTube, and Twitter

The agent makes 4 sequential API calls — one per platform — and compiles the results into a comparison.

Explore available endpoints

What social media platforms can you access?

Show me all the TikTok endpoints

Access documentation

How does the SocialCrawl credit system work?

Example response

Every response follows a unified envelope format:

{
  "success": true,
  "platform": "tiktok",
  "endpoint": "/v1/tiktok/profile",
  "data": {
    "content": { "text": "...", "media_urls": ["..."] },
    "author": { "username": "charlidamelio", "followers": 156000000 },
    "engagement": { "likes": 5200, "engagement_rate": 0.045 },
    "metadata": { "language": "en", "content_category": "entertainment" }
  },
  "credits_used": 1,
  "credits_remaining": 99
}

[!NOTE] The same response structure is returned for every platform — no per-platform parsing logic needed.

Available Tools

The MCP server exposes 7 tools:

Tool	Description	Needs API key?
`socialcrawl_list_platforms`	Discover all 44 platforms with their endpoints and capabilities	No
`socialcrawl_list_endpoints`	See all endpoints, required parameters, and credit costs for a platform	No
`socialcrawl_request`	Make any SocialCrawl API call — profiles, posts, comments, search, trends, analytics, Prism composites. GET endpoints take query `params`; POST batch endpoints (e.g. youtube/videos, prism/profiles) take their array/object `body`. Supports an optional `idempotencyKey` for retry-safe calls.	Yes
`socialcrawl_check_balance`	Check remaining credits and recent deduction summary. Calls `/v1/credits/balance` — costs 0 credits.	Yes
`socialcrawl_monitors`	Create and manage stateful monitors that re-run any recipe on a cadence, deliver results to a signed webhook, and accumulate a time-series. Actions: create, list, get, runs, timeseries, pause, resume, delete.	Yes
`socialcrawl_web`	Full web scraping & browser automation (the `web` platform). Sync scrape/search/map/extract; async crawl/batch_scrape/agent jobs with poll/cancel; stateful monitors; interactive browser sessions. One `action` per endpoint.	Yes
`socialcrawl_get_docs`	Access detailed API documentation by topic or platform	No

Three of the seven tools work without an API key — they query local bundled data. socialcrawl_request, socialcrawl_check_balance, socialcrawl_monitors, and socialcrawl_web require a key.

Monitors — schedule any recipe

socialcrawl_monitors wraps any registry endpoint or Prism composite in a scheduled, stateful monitor (/v1/monitors/*). It re-runs the recipe hourly/daily/weekly (or on a cron), delivers each result to an HMAC-signed webhook, raises alerts on metric thresholds or changes, and keeps a per-run time-series you can read back. "Prism answers once; monitors watch it for you." Managing monitors costs 0 credits; each scheduled run bills the recipe's normal cost plus a 1-credit scheduling premium. See socialcrawl_get_docs topic monitors for the full contract.

Web — scrape, crawl, browse

socialcrawl_web drives the full web-scraping and browser-automation surface (the web platform, /v1/web/*) through a single action parameter:

Sync reads — scrape (URL → markdown/HTML/screenshot/links), search (web search with page content), map (discover a site's URLs), extract (LLM structured data from a page).
Async jobs — crawl a whole site, batch_scrape many URLs, or agent (autonomous multi-step web task); each returns a job you poll with job_get/job_list and stop with job_cancel.
Monitors — monitor_create/list/get/update/delete/checks re-check a URL on a cadence and deliver changes to a webhook.
Sessions — session_create/get/list, session_execute (run code in the live page), session_close.

Pricing varies by action (scrape 1cr, search 2cr, extract & session_create 5cr, agent 25cr; job/monitor/session management 0cr). See socialcrawl_get_docs topic web.

Smart validation

Before making any API call, socialcrawl_request validates locally that the platform exists, the endpoint exists, and all required parameters are present. If something is wrong, it tells the agent exactly how to fix it — without consuming any credits.

Retry-safe requests

Pass an idempotencyKey to socialcrawl_request (UUIDv4 recommended) to make the call retry-safe. If the request is replayed within 24h, the server returns the original response and deducts 0 credits (X-Idempotent-Replay: true).

Supported Platforms

Platform	Endpoints	Data Available
LinkedIn	44	Profiles & company pages, posts, reposts, reactions, comments & replies, people/company-people search, profile sub-resources (experience, education, skills, certifications…), jobs (search, company jobs, details), company insights, groups, transcripts, Ad Library, profile-360
Instagram	33	Profiles, posts, reels, comments (incl. single-comment lookup), highlights, stories, tagged & location feeds, followers/following, similar accounts, post likers, reshare stats, one-call reels/posts feeds with share counts, engagement analytics, search (reels/hashtag/profile/location/music), trending, transcripts, profile-360
Prism	33	Cross-platform composites — URL lookup, comment harvesting, batch comment-lookup & profile-lookup, handle-audit, brand mentions, demand signals, AI visibility, crisis radar/post-mortem, reputation, share-of-voice, creator vetting, AI consensus answers, video/app/product intelligence
YouTube	28	Channels, videos, shorts, comments & replies, sponsors, playlists & items, community posts, search (advanced + autocomplete), trending, live streams, media files (audio/video/subtitles/thumbnails), transcripts, batch videos/channels/transcripts, profile-360
Facebook	22	Pages, posts, comments, groups, photos, reels, events, Marketplace, transcripts, full Ad Library
Web Scraping	22	Scrape, web search, site map, LLM extract, async crawl/batch-scrape/agent jobs, change monitors, interactive browser sessions, document parse — driven by `socialcrawl_web`
TikTok	20	Profiles, videos, comments & replies (incl. single-comment lookup), search, trending, audience, followers, live, songs, transcripts, profile-360
GitHub	12	Users, repos, issues, PRs, READMEs, releases, search, repo dossier, user profile-velocity
Naver	12	Korea's #1 portal — blog, news, book, encyclopedia, cafe, KiN, local, shopping, doc, image, web search, brief
Content Analysis	10	Cross-web brand mentions, sentiment, rating distributions, phrase/category trends
Google	10	Web search, Ads Transparency, Business Profile (info, reviews, updates, Q&A), Travel hotels
Apple App Store	9	App search, search suggestions, app details, reviews, charts, listings database, reference data
Google Play	9	App search, search suggestions, app details, reviews, charts, listings database, reference data
Twitter/X	8	Profiles, tweets, communities, video transcripts, AI search via Grok, profile-360
Reddit	7	Subreddits, posts, comments, search, transcripts, omni-search VoC sweep
Spotify	6	Artists, tracks, albums, podcasts, episodes, search
Amazon	5	Product search, ASIN details, reviews, sellers, shop pages
Pinterest	5	Pins, boards, search, URL save-counts
Rumble	5	Search, channel videos, video details, comments, transcripts
Threads	5	Profiles, posts, keyword search, user search
TikTok Shop	5	Products, reviews, listings, search, creator showcases
Google Shopping	4	Product search, product details, cross-retailer reviews, sellers
Hacker News	4	Story search, story, comment tree, profile
Tavily	4	Web search (with LLM answer), URL extraction, sitemap, full crawl
Twitch	4	Profiles, clips, videos, schedules
Bluesky	3	Profiles, posts
Google Finance	3	Instrument quotes, markets overview, ticker search
Kwai	3	Profiles, posts
Truth Social	3	Profiles, posts
Google Trends	2	Interest-over-time (explore) + rising/breakout related queries
Tripadvisor	2	Place search, traveler reviews
Trustpilot	2	Business search, company reviews
Universal Search	2	One query fanned out across 12+ platforms (20cr); forums lane
Google News	1	Real-time Google News SERP search
Kick	1	Clips
Komi	1	Link pages
Linkbio	1	Link pages
Linkme	1	Link pages
Linktree	1	Link pages
Perplexity	1	Sonar web research with cited sources
Pillar	1	Link pages
Polymarket	1	Prediction-market research — multi-query fan-out + ranking
Snapchat	1	Profiles
Utility	1	Age & gender detection

Total: 357 endpoints across 44 platforms.

Error Handling

The MCP server handles errors gracefully and gives the agent actionable guidance:

Error	What the agent sees
Missing API key	Prompts to set `SOCIALCRAWL_API_KEY` with link to sign up
Invalid API key	Asks to check the key configuration
Insufficient credits	Shows balance and links to billing page
Bad platform/resource	Suggests using discovery tools to find the right endpoint
Missing parameters	Lists exactly what's missing with examples
Resource not found (404)	Reports the upstream resource doesn't exist; credits auto-refunded (BIL-01)
Idempotency-Key conflict (409)	Tells the agent the key was used by another account — generate a fresh one
Idempotency-Key payload mismatch (422)	Tells the agent the same key was reused with different params
Method not allowed (405)	Reminds the caller that `/v1/*` is GET-only
Concurrency limit (429)	Asks the caller to back off (50 concurrent/key max)
Upstream error (502)	Reports the failure; credits refunded automatically
Platform unavailable (503)	Circuit breaker open; credits refunded; retry in 30s