Web Scraping MCP Servers — Page 12

Enables powerful, detection-resistant browser automation for AI assistants using puppeteer-real-browser.

Scrape webpages and convert them to markdown using Puppeteer. Features AI-driven interaction capabilities.

13 MCP tools for AI agents: scrape, extract, crawl, map, search, academic papers (arXiv + Crossref), batch scrape, deep research, monitor page changes, persistent browser session, cache control. 3-tier auto-fallback ladder with free Cloudflare bypass, no API keys. Self-hosted Firecrawl alternative. `uvx pyrecrawl serve`

A financial web table crawler using Playwright that queries data from multiple websites with fallback switching.

A Developers Tool — Scrape entire documentation recursively and ask questions using AI

Over 70M+ premium IPs via Rapidproxy - Enjoy easy data extraction, avoiding CAPTCHAs, IP blocks with 220+ locations targeting, non-expiring traffic.

One API for AI agents to screenshot, PDF, read (clean Markdown), extract (JSON), crawl, batch, and monitor any URL. Drop-in for Urlbox/ScreenshotOne at $0.90/1k. Animated-banner tools (delay, wait_for, settle, GIF and MP4 export), direct S3 upload, async jobs with signed webhooks, per-call USDC on Base for keyless agent payments.

Extracts and transforms webpage content into clean, LLM-optimized Markdown using the Readability algorithm.

Extracts web content from a URL and converts it to clean Markdown format.

Fast, token-efficient web content extraction that converts websites to clean Markdown. Features Mozilla Readability, smart caching, polite crawling with robots.txt support, and concurrent fetching with minimal dependencies.

Property search and market analysis from Redfin with neighborhood insights

Structured rows from public sources: SEC filings, clinical trials, papers, npm packages, job listings.

Search five recipe sites at once, in French and English, and scale quantities. No API key.

An automated tool to search notes, analyze content, and post AI-generated comments on Xiaohongshu (Redbook) using Playwright.

Twitter/X, YouTube, Reddit, Google and more - 100+ endpoints in total. No account, no OAuth, no subscription. Pay per call in USDC, or top up once and spend one balance across all of them.

A server to browse, search, and read content on Reddit using the Reddit API.

Redfin for-sale, for-rent and sold listings plus full property pages, as structured JSON.

Property search, price history, comparable sales, and neighborhood analysis

An MCP server that integrates your private Redlib instance, allowing AI assistants access to utilize Redlib.

Access and interact with content from Xiaohongshu (RedNote).

One MCP server for 160+ live web-data APIs (search, social, e-commerce, real estate, jobs, finance) — clean JSON, free tier.

A faster, parallel browser for AI agents: it drives your own Chrome from Claude Desktop or any MCP client, on fewer round trips and tokens than Playwright MCP.

Drop-in upgrade to Claude's WebFetch that auto-detects JS-rendered pages and fetches them with Playwright headless browser

Capture website screenshots as PNG/JPEG via AI agents. Full-page capture, dark mode, ad blocking, custom viewports. Edge-deployed on Cloudflare Workers, free tier included.

LLM-driven HTTP/HTTPS capture proxy with MCP tools to inspect traffic, script behavior, and modify requests and responses.

MCP-server that provides LLMs with easy access to open data from the Swedish Government Offices and Parliament.

YouTube transcript extraction for AI agents. Clean text, timestamps, or structured JSON from any video. No API keys required.

Fetches RSS feeds and returns entries as formatted text, with support for OPML configuration.

Access academic grades from the Sakarya University SABIS system via automated web scraping.

Native Safari browser automation for AI agents — 80 tools via AppleScript, zero Chrome overhead, keeps logins. macOS only.