Back to MCP Servers

mcp-crawler

mcp-crawler

Public

orange-fruit01/MCP-Test-Run

Model Context Protocol service offering web crawling tools for Cursor and Claude applications, enabling seamless integration and content retrieval via a Docker-deployed API endpoint.

python

0 tools

May 30, 2025

Updated Jun 4, 2025

Supercharge Your AI with mcp-crawler

MCP Server

Unlock the full potential of mcp-crawler through LangDB's AI Gateway. Get enterprise-grade security, analytics, and seamless integration with zero configuration.

Unified API Access

Complete Tracing

Instant Setup

Get Started Now

Free tier available • No credit card required

Instant Setup

99.9% Uptime

10,000+Monthly Requests

Loading...

Publicly Shared Threads0

Discover shared experiences

Shared threads will appear here, showcasing real-world applications and insights from the community. Check back soon for updates!

Share your threads to help others

Related MCPs0

No related MCPs found.

This server doesn't have any related MCP connections.

MCP Service

This is a Model Control Protocol (MCP) service that provides tools for Cursor and Claude applications.

Connecting to the Service

For Cursor Users

Open Cursor
Go to Settings > AI > Advanced
Under "MCP Endpoint", enter: https://your-render-url.onrender.com
Save settings and restart Cursor

For Claude App Users

Open Claude App
Go to Settings > Advanced
Under "MCP Connection", enter: https://your-render-url.onrender.com
Save settings

Available Tools

Web Crawler: Crawls web pages and returns content as markdown

Deployment

This service is deployed on Render.com as a Docker container. The service is accessible at:

https://your-render-url.onrender.com

Replace your-render-url.onrender.com with the actual URL provided by Render after deployment.

Environment Variables

MCP_HOST: Host to bind the server (default: 0.0.0.0)
MCP_PORT: Port to bind the server (default: 8000)

Monitoring

A health endpoint is available at /health for monitoring the service status.