Enable AI agents to get structured data from unstructured web with AgentQL.
This is a Model Context Protocol (MCP) server that integrates AgentQL's data extraction capabilities.
extract-web-data
- extract structured data from a given 'url', using 'prompt' as a description of actual data and its fields to extract.To use AgentQL MCP Server to extract data from web pages, you need to install it via npm, get an API key from our Dev Portal, and configure it in your favorite app that supports MCP.
npm install -g agentql-mcp
⌘
+,
(don't confuse with Claude Account Settings)claude_desktop_config.json
fileagentql
server inside mcpServers
dictionary in the config file{
"mcpServers": {
"agentql": {
"command": "npx",
"args": ["-y", "agentql-mcp"],
"env": {
"AGENTQL_API_KEY": "YOUR_API_KEY"
}
}
}
}
Read more about MCP configuration in Claude here.
env AGENTQL_API_KEY=YOUR_API_KEY npx -y agentql-mcp
Read more about MCP configuration in Cursor here.
~/.codeium/windsurf/mcp_config.json
directlyagentql
server inside mcpServers
dictionary in the config file{
"mcpServers": {
"agentql": {
"command": "npx",
"args": ["-y", "agentql-mcp"],
"env": {
"AGENTQL_API_KEY": "YOUR_API_KEY"
}
}
}
}
Read more about MCP configuration in Windsurf here.
Give your agent a task that will require extracting data from the web. For example:
Extract the list of videos from the page https://www.youtube.com/results?search_query=agentql, every video should have a title, an author name, a number of views and a url to the video. Make sure to exclude ads items. Format this as a markdown table.
[!TIP] In case your agent complains that it can't open urls or load content from the web instead of using AgentQL, try adding "use tools" or "use agentql tool" hint.
Install dependencies:
npm install
Build the server:
npm run build
For development with auto-rebuild:
npm run watch
If you want to try out development version, you can use the following config instead of the default one:
{
"mcpServers": {
"agentql": {
"command": "/path/to/agentql-mcp/dist/index.js",
"env": {
"AGENTQL_API_KEY": "YOUR_API_KEY"
}
}
}
}
[!NOTE] Don't forget to remove the default AgentQL MCP server config to not confuse Claude with two similar servers.
Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector, which is available as a package script:
npm run inspector
The Inspector will provide a URL to access debugging tools in your browser.
Web content fetching and conversion for efficient LLM usage
Browser automation and web scraping
Actors MCP Server: Use 3,000+ pre-built cloud tools to extract data from websites, e-commerce, social media, search engines, maps, and more
Automate browser interactions in the cloud (e.g. web navigation, data extraction, form filling, and more)
Extract web data with Firecrawl
Hyperbrowser is the next-generation platform empowering AI agents and enabling effortless, scalable browser automation.
Scrape websites with Oxylabs Web API, supporting dynamic rendering and parsing for structured data extraction.
Playwright MCP server
Render website screenshots with ScreenshotOne
Automate your local browser