Apify Public Data MCP

25 genel veri kazıyıcı (Google Maps, iş ilanları, SEC EDGAR, kayıtlar) MCP araçları olarak

GitHubBu MCP'yi deneyinSponsorlu

Dokümantasyon

mcp-name: io.github.jlucasmcrell/apify-scrapers

Apify Public Data MCP: 25 Production Scrapers & Public Records

Python 3.10+ Node.js 18+ Apify Verified Glama MCP Server License: MIT Smithery One MCP server gives an AI agent 25 production public-data extractors - Google Maps business leads, LinkedIn and Glassdoor jobs, SEC EDGAR, USAspending, FEC, EPA, ClinicalTrials.gov, openFDA, Europe PMC, GLEIF, CMS providers, Census geocoding, state business registries, contractor licences, Airbnb, YouTube, Twitch and Google Play - each running as an Actor on your own Apify account. Install with uvx apify-data-scrapers (Claude Desktop, Cursor, any MCP client), or call the same Actors directly from Python, Node.js or no-code tools.

Each actor is built with strict schema validation, deterministic field mapping, self-healing DOM selectors, and pay-per-event pricing (per-result rates from $0.00015, Actor-start from $0.0005; the live Apify Store price is authoritative).

Quick Navigation

Use-case guides

One page per question an agent gets asked, each listing the tools, arguments, returned fields and prices for that job:

Available Extractors & Store Listings

Every extractor below is both an Apify Store listing and an MCP tool of the same server; the sections are the questions buyers arrive with.

Business intelligence & lead generation

ToolStore LinkKey Output FieldsBest For
Google Maps Business Leadscaptainhandsome/google-maps-business-searchName, phone, website, rating, reviews, address, coordinates, hoursB2B lead generation, local agency prospecting
Website Tech Stack & Ecommerce Scannercaptainhandsome/tech-stack-detectortechnologies, cms, ecommerce_platform, payments, emailsBest for competitive tech research and B2B lead qualification across a batch of company websites.
US Business Entity Registriescaptainhandsome/us-business-entity-searchLegal entity name, filing number, jurisdiction, statusLegal due diligence, corporate registration checks
Alabama Business Entity Searchcaptainhandsome/al-business-entity-searchentity id, entity name, location, entity type, statusSearch Alabama business entities by company name and export entity IDs
Florida Sunbiz Business Entity Searchcaptainhandsome/fl-sos-new-filingsentity name, document number, status, entity type, date filedSearch Florida Sunbiz company-name results and export legal entity nam
Florida Sunbiz Officer & Registered Agent Searchcaptainhandsome/fl-sunbiz-officer-searchofficer name, entity name, document number, detail url, entity typeSearch Florida Sunbiz by officer or registered-agent name and export o
French Company Searchcaptainhandsome/french-company-searchsiren, name, legal name, acronym, statusSearch France's official company register by name, activity, postcode,
GLEIF LEI Lookupcaptainhandsome/gleif-lei-searchlei, legal_name, registered_as, legal_form_name, statusBest for KYC and counterparty due diligence: resolving a company's Legal Entity Identifier, registration status, and own national registry number before onboarding.
US Contractor Licensescaptainhandsome/us-contractor-license-searchContractor name, license number, classification, status, stateTrades verification, subcontractor diligence
California Contractor License Searchcaptainhandsome/ca-contractor-license-searchcontractor name, name type, license number, city, statusSearch California CSLB contractor records by contractor name and expor

Jobs, market & consumer intelligence

ToolStore LinkKey Output FieldsBest For
Glassdoor Jobs & Salariescaptainhandsome/glassdoor-jobs-scraperTitle, company, salary estimate, rating, location, job URL, posting dateHiring intelligence, compensation benchmarking
LinkedIn Public Jobscaptainhandsome/linkedin-public-jobs-searchJob title, employer, location, direct apply URL, posting ageRecruitment, tech talent monitoring
Airbnb Vacation Rentalscaptainhandsome/airbnb-listings-searchTitle, room type, nightly price, rating, reviews count, listing URLReal estate research, market rate tracking
Google Play App Reviewscaptainhandsome/google-play-reviews-scraperReview text, star score, thumbs up, date, reviewer nameApp store sentiment, competitor feedback
YouTube Video Searchcaptainhandsome/youtube-search-scraperTitle, video URL, channel, views count, duration, publish dateContent tracking, creator outreach
Twitch Live Streamscaptainhandsome/twitch-live-streams-scraperStreamer username, title, viewer count, language, categoryEsports analytics, live stream monitoring

Government & public records

ToolStore LinkKey Output FieldsBest For
SEC EDGAR Corporate Filingscaptainhandsome/sec-edgar-filings-searchTicker, CIK, form (10-K, 10-Q, 8-K), filing date, primary document URLFinancial diligence, equity research, compliance
USAspending Federal Awardscaptainhandsome/usaspending-federal-awardsRecipient vendor, award amount, awarding agency, description, datesGovernment contracting, procurement intel
FEC Campaign Finance Searchcaptainhandsome/fec-campaign-finance-searchrecord type, id, name, party, officeSearch US federal candidates, PACs and campaign contributions by state
EPA ECHO Facility Compliance & Violationscaptainhandsome/epa-echo-facility-searchregistry id, name, street, city, stateSearch EPA-regulated US facilities by state, ZIP, NAICS, name, program
US Census Address Geocodercaptainhandsome/us-census-geocodermatched_address, county_name, tract_geoid, block_geoid, congressional_district_geoidBest for appending census tract, county FIPS and district GEOIDs to US addresses for demographic joins and compliance reporting.

Research & health data

ToolStore LinkKey Output FieldsBest For
ClinicalTrials.gov Searchcaptainhandsome/clinical-trials-searchnct id, title, official title, acronym, org study idSearch the official ClinicalTrials.gov API by condition, intervention,
Europe PMC Paper Searchcaptainhandsome/europe-pmc-paper-searchtitle, doi, pmid, abstract, cited_by_countBest for biomedical literature reviews, citation tracking, and open-access discovery across PubMed and Europe PMC.
openFDA Drug Labels, Recalls & Adverse Eventscaptainhandsome/openfda-searchdataset, id, brand name, generic name, manufacturerSearch official FDA drug labels, approvals, adverse events, and drug,
CMS Healthcare Provider Searchcaptainhandsome/cms-healthcare-provider-searchname, provider_type, city, state, star_ratingCompare CMS-certified hospitals, nursing homes, and other Medicare providers by location, ownership, and star rating.

Python Quickstart

1. Install dependencies

pip install apify-client pandas python-dotenv

2. Export 50 Google Maps Leads to CSV

import os
from apify_client import ApifyClient
import pandas as pd

# Get your API token from https://console.apify.com/account/integrations
client = ApifyClient(os.getenv("APIFY_TOKEN"))

# Run the actor
run = client.actor("captainhandsome/google-maps-business-search").call(run_input={
    "search_query": "commercial electricians",
    "location": "Dallas, Texas",
    "max_items": 50,
    "include_details": True,
})

# Fetch dataset items and export to CSV
items = list(client.dataset(run["defaultDatasetId"]).iterate_items())
df = pd.DataFrame(items)
df.to_csv("dallas_electricians.csv", index=False)
print(f"Exported {len(df)} leads to dallas_electricians.csv")

See examples/google_maps_leads_to_csv.py for the full script.

Node.js Quickstart

1. Install dependencies

npm install apify-client

2. Query SEC EDGAR Filings

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: process.env.APIFY_TOKEN });

const run = await client.actor('captainhandsome/sec-edgar-filings-search').call({
  companies: ['AAPL', 'NVDA', 'MSFT'],
  forms: ['10-K'],
  max_items: 15,
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach(filing => {
  console.log(`[${filing.ticker}] ${filing.form} (${filing.filing_date}): ${filing.primary_document_url}`);
});

See examples/sec_filings.js for the full script.

No-Code & Automation Workflows

If you automate via n8n, Make, Zapier, or Google Sheets, ready-to-import blueprints are included in workflows/:

Pre-Built Example Tasks (Zero Code)

If you prefer runnable web UI tasks without writing any code, each actor includes pre-configured tasks published on Apify Store:

Google Maps Leads

Glassdoor Jobs

Airbnb Rentals

YouTube & Google Play

Free Sample Datasets

Looking for clean data to benchmark, analyze, or train models? Verified sample bundles with metadata schemas are available in datasets/ and hosted publicly on Hugging Face Datasets:

  1. Phoenix HVAC Contractor Leads: datasets/phoenix_hvac_leads/ | Hugging Face Hub (20 verified HVAC contractor profiles with ratings, addresses, and phone numbers).
  2. California Licensed Contractors: datasets/california_solar_contractors/ | Hugging Face Hub (Active C-46 and B licensed solar installers with state verification numbers).
  3. Austin Software Engineer Postings: datasets/austin_software_jobs/ | Hugging Face Hub (Normalized job listings with estimated posting dates and salary ranges).

AI Agent & MCP Integration

All actors in this repository conform to OpenAPI and JSON Schema standards, making them directly callable by AI agents via the Model Context Protocol (MCP):

Option 1: Claude Desktop / Cursor with UVX (Recommended)

Add this to your claude_desktop_config.json or Cursor MCP settings:

{
  "mcpServers": {
    "apify-data-scrapers": {
      "command": "uvx",
      "args": ["apify-data-scrapers"],
      "env": {
        "APIFY_TOKEN": "YOUR_APIFY_API_TOKEN"
      }
    }
  }
}

Option 2: Docker Container (Glama / Cloud)

Run via Docker:

{
  "mcpServers": {
    "apify-data-scrapers": {
      "command": "docker",
      "args": ["run", "-i", "--rm", "-e", "APIFY_TOKEN", "glcr.b-cdn.net/jlucasmcrell/apify-scrapers:latest"],
      "env": {
        "APIFY_TOKEN": "YOUR_APIFY_API_TOKEN"
      }
    }
  }
}

Option 3: Local Python Stdio Runner

Install via pip or run directly:

pip install apify-data-scrapers
export APIFY_TOKEN="your_token_here"
apify-data-scrapers

Or from local source:

python mcp_server.py

Agent Prompts That Work Out-of-the-Box:

  • "Search Google Maps for 50 commercial roofers in Atlanta with phone numbers and websites."
  • "Retrieve Apple and Microsoft Form 10-K filings from SEC EDGAR for the last 2 years."
  • "Search Glassdoor for remote product manager jobs with salary estimates."

In-Depth Engineering Guides

Technical case studies and problem-solution writeups are located in articles/:

Repository Structure

apify-scrapers/
 README.md                                # Documentation and quickstart
 LICENSE                                  # MIT License
 requirements.txt                         # Python client dependencies
 package.json                             # Node.js dependencies
 mcp.json                                 # MCP tool registry specification
 mcp_server.py                            # Native Python stdio MCP server
 articles/                                # In-depth engineering case studies
    airbnb_playwright_pagination_guide.md
    glassdoor_posting_dates_guide.md
    reddit_community_responses.md        # Reference technical answers for forums
 datasets/                                # Sample benchmark datasets
    phoenix_hvac_leads/
    california_solar_contractors/
    austin_software_jobs/
 workflows/                               # No-code automation templates
    n8n_google_maps_to_sheets.json
    n8n_sec_edgar_to_slack.json
    README.md
 examples/                                # Standalone developer scripts
     google_maps_leads_to_csv.py
     sec_edgar_filings_downloader.py
     glassdoor_jobs_tracker.py
     airbnb_market_scraper.py
     usaspending_defense_awards.py
     twitch_live_stream_monitor.py
     google_maps_leads.js
     sec_filings.js

Author & Support

Maintained by Joseph McRell.

License

This project is licensed under the MIT License - see the LICENSE file for details.