mcp-rss-crawler

# MCP-RSS-Crawler An MCP (Message Chain Protocol) server that fetches RSS feeds and shares them with LLMs. ## Features - Fetching and caching of RSS feeds (SQLite database) - MCP protocol implementation for seamless LLM integration - Support for filtering feeds by category, source, or keywords - Comprehensive API endpoints for feed management - Add, update, and delete feeds - Support for fetching articles from Firecrawl ## Requirements - Bun - Firecrawl API key - Claude Desktop or other MCP client ## Setup as MCP Server 1. Clone this repository 2. Create a `claude_desktop_config.json` file based on `claude_desktop_config.json.example` with your configuration ```json { "mcpServers": { "rss-crawler": { "command": "/path/to/bun", "args": ["run", "/path/to/mcp-rss-crawler/apps/mcp-server/src/mcp-cli.ts"], "cwd": "/path/to/mcp-rss-crawler", "env": { "PORT": "5556", "DB_DIR": "/path/to/mcp-rss-crawler", "FIRECRAWL_API_KEY": "fc-<YOUR_FIRECRAWL_API_KEY>" } } } } ``` 3. Install dependencies: ``` bun install ``` 4. Start Claude Desktop: ## MCP Protocol The server implements the Message Chain Protocol (MCP) which allows LLMs to access your latest RSS feeds. The MCP endpoint accepts POST requests with a JSON body containing a messages array and returns a response with the latest feed items. Example request: ```json { "messages": [ { "role": "user", "content": "What are the latest news from my RSS feeds?" } ] } ``` Example response: ```json { "messages": [ { "role": "assistant", "content": "Here are the latest articles from your RSS feeds:", "name": "rss-mcp" }, { "role": "tool", "content": "[{\"title\":\"Article Title\",\"summary\":\"Article summary...\",\"published\":\"2025-03-16T04:30:00.000Z\",\"origin\":\"Feed Name\",\"link\":\"https://example.com/article\"}]", "name": "rss-feeds" } ] } ``` ## Configuration Options The server can be configured through environment variables or a `.env` file: - `PORT` - Server port (default: 5556) - `FIRECRAWL_API_KEY` - Firecrawl API key - `DB_DIR` - Database directory (default: `~/.mcp-rss-crawler`) ## Troubleshooting - For connection issues, check your network settings and firewall configuration - Logs are available in the console and can be used to diagnose problems - For more detailed logging, set the `DEBUG=mcp-rss:*` environment variable