Stop Chatting. Start Acting.
The ScrapingBee MCP Server connects your AI models to the live web, empowering them to browse, search, and extract data using our robust API that handles proxies, CAPTCHAs, and JavaScript rendering.
The Power of a Universal Language for AI
The Model Context Protocol (MCP) is an open-source specification that allows AI models to reliably interact with external tools. It's a universal language between an AI (the client) and a tool provider like us (the server).
Instead of being limited to static training data, an MCP-enabled AI can request real-time actions and receive structured data back. This is the key to building powerful, autonomous agents.
Live Data Access
Access real-time information from any website.
Perform Actions
Go beyond text generation. Search, extract, and more.
Standardized & Reliable
A robust protocol ensures predictable results.
A Comprehensive Suite of Tools
Connect to Your AI in Minutes
Connect Cursor
Add the server to your Cursor MCP settings (Settings → Features → MCP → "Add New MCP Server", type streamableHttp), or use the JSON configuration:
// In Cursor MCP settings
{
"mcpServers": {
"scrapingbee": {
"url": "https://mcp.scrapingbee.com/mcp?api_key=<your_api_key>"
}
}
}
Connect Claude Desktop
Open Settings → Developer → MCP Servers → Edit Config, add the entry below, then restart Claude Desktop.
// In claude_desktop_config.json
{
"mcpServers": {
"scrapingbee": {
"url": "https://mcp.scrapingbee.com/mcp?api_key=<your_api_key>"
}
}
}
Connect ChatGPT
In ChatGPT, open Settings → Connected apps (MCP) → add a new MCP server, then enter the URL below, save, and enable the connection.
https://mcp.scrapingbee.com/mcp?api_key=<your_api_key>
Connect from Python
Use the official mcp Python SDK with its Streamable HTTP client:
import asyncio
from mcp import ClientSession
from mcp.client.streamable_http import streamablehttp_client
async def main():
url = "https://mcp.scrapingbee.com/mcp?api_key=<your_api_key>"
async with streamablehttp_client(url) as (read, write, _):
async with ClientSession(read, write) as session:
await session.initialize()
tools = await session.list_tools()
print(tools)
asyncio.run(main())
Frequently Asked Questions
How do I get a ScrapingBee API key?
An API key is required to use these tools. You can get a free key with 1,000 credits by registering here. The key should be passed as a query parameter in the MCP URL.
When should I use premium_proxy or stealth_proxy?
Start without them. If you get blocked (e.g., receive an error or CAPTCHA page), try premium_proxy: true. If you are still blocked, stealth_proxy: true will help you to unblock it.
Can I scrape more than just text?
Yes. The server provides tools to get the full `get_page_html`, take a `get_screenshot` of the page (or a specific element), and even download files like images or PDFs using the `get_file` tool.
How much does each request cost?
Each requests will be charged based on the proxy and features you are using. For more details, you can refer to this link.
Ready to Build?
Get your free API key with 1,000 credits to start building powerful AI agents today.
Start for Free