WebforAI Text Extractor
Extracts plain text from web pages using WebforAI.
WebforAI Text Extractor - MCP Server
A Cloudflare Workers-based Model Context Protocol (MCP) server that extracts plain text from web pages using WebforAI.
🌟 What is WebforAI?
WebforAI is a powerful library designed to make web content accessible to AI models. It provides tools to:
- Convert HTML to clean, structured Markdown
- Extract meaningful content from web pages
- Process tables, links, and images intelligently
- Prepare web content for AI consumption
This MCP server leverages WebforAI's capabilities to extract plain text from any web page URL, making it easy to feed web content into AI models through the Model Context Protocol.
📋 Features
- Simple API: Extract text from any web page with a single API call
- Clean Output: Receive well-formatted Markdown text without HTML noise
- Error Handling: Robust error handling for failed requests
- Cloudflare Workers: Serverless deployment with global distribution
- MCP Compatible: Works with any MCP client like Claude Desktop or Cloudflare AI Playground
🚀 Getting Started
Deploy to Cloudflare Workers
This will deploy your MCP server to a URL like: webforai-mcp-server.<your-account>.workers.dev/sse
Local Development
-
Clone this repository:
git clone https://github.com/yutakobayashidev/webforai-mcp-server.git cd webforai-mcp-server
-
Install dependencies:
pnpm install
-
Start the development server:
pnpm dev
-
Your server will be available at
http://localhost:8787
🔧 Using the Text Extraction Tool
The extractWebPageText
tool accepts a URL to a web page and returns the extracted text content in markdown format:
{
"url": "https://example.com/page"
}
The response will contain the extracted text in Markdown format, with:
- Links converted to plain text
- Tables converted to plain text
- Images hidden
🔌 Connecting to MCP Clients
Cloudflare AI Playground
- Go to Cloudflare AI Playground
- Enter your deployed MCP server URL (
webforai-mcp-server.<your-account>.workers.dev/sse
) - You can now use your text extraction tool directly from the playground!
Claude Desktop
To connect to your MCP server from Claude Desktop:
- Follow Anthropic's Quickstart
- In Claude Desktop go to Settings > Developer > Edit Config
- Update with this configuration:
{
"mcpServers": {
"webforaiExtractor": {
"command": "npx",
"args": [
"mcp-remote",
"http://localhost:8787/sse" // or webforai-mcp-server.your-account.workers.dev/sse
]
}
}
}
- Restart Claude and you should see the text extraction tool become available
📚 Learn More
📄 License
MIT
Related Servers
Hyperbrowser
Hyperbrowser is the next-generation platform empowering AI agents and enabling effortless, scalable browser automation.
MCP Image Downloader
A server for downloading and optimizing images from the web.
Documentation Crawler
Crawl websites to generate Markdown documentation and make it searchable through an MCP server.
Amazon MCP Server
Scrapes and searches for products on Amazon.
PlayMCP Browser Automation Server
A server for browser automation using Playwright, providing powerful tools for web scraping, testing, and automation.
Reddit MCP
A server to browse, search, and read content on Reddit using the Reddit API.
ScreenshotOne
Render website screenshots with ScreenshotOne
Shufersal MCP Server
Automates shopping on the Shufersal website, enabling LLMs to search for products, create shopping lists, and manage the cart.
Crawl MCP
An MCP server for crawling WeChat articles. It supports single and batch crawling with multiple output formats, designed for AI tools like Cursor.
Chrome MCP Server
Exposes Chrome browser functionality to AI assistants for automation, content analysis, and semantic search via a Chrome extension.