transcript-generator-agent

--- title: Transcript Generator Agent author: Enrique Cardoza sdk: gradio sdk_version: 5.33.0 app_file: app.py pinned: false short_description: A transcript generator agent powered by MCP servers tags: - transcript - agent - agent-demo-track - anthropic - groq - whisper - smolagents - text-to-speech - speech-to-text - modal demo_video: https://youtu.be/GL1jsfIGxXY --- # Claude 3.7 Sonnet Chat with Transcription Tools A powerful conversational agent that combines Claude 3.7 Sonnet's capabilities with specialized audio transcription tools. Built for the Gradio Agents & MCP Hackathon 2025 and hosted on Hugging Face Spaces. ## Demo Video [](https://youtu.be/GL1jsfIGxXY) Check out the [demo video](https://youtu.be/GL1jsfIGxXY) to see the agent in action! ### Agent Capabilities This agent can: - Generate transcripts from audio or video files via URL - Create audio from text using the Chatterbox model - Process both audio and video content for transcription - Generate specific text and then convert it to audio for download - Run on a GPU instance hosted on modal.com ## Overview This application integrates Claude 3.7 Sonnet with the Model Context Protocol (MCP) to enable audio transcription directly within a chat interface. Users can share audio URLs during conversation, and the agent will automatically transcribe the content using GROQ's transcription capabilities. ## Features - **Conversational AI**: Powered by Anthropic's Claude 3.7 Sonnet model - **Audio Transcription**: Transcribe audio from URLs shared in the chat - **Smart Tool Selection**: Automatically determines when to use transcription tools - **Streaming Responses**: Real-time feedback during processing - **API Key Management**: Supports both environment variables and user-provided API keys ## How It Works ### Architecture 1. **Gradio Interface**: Provides a user-friendly chat UI 2. **MCP Integration**: Connects to external tools via Model Context Protocol 3. **Tool Decision Logic**: Uses Claude to decide whether to invoke transcription 4. **Multi-phase Response**: Shows "thinking", tool usage, and final response phases ### Process Flow 1. **User Input**: User sends a message with an audio URL 2. **Decision Making**: The agent analyzes the message to determine if transcription is needed 3. **Transcription Processing**: If appropriate, the audio is sent to the transcription service 4. **Response Generation**: Claude responds to either the transcription or the original query ### MCP Integration The application connects to an MCP server at `https://agents-mcp-hackathon-transcript-generator.hf.space/gradio_api/mcp/sse` that provides access to specialized tools. This implementation uses the `transcript_generator_transcribe_audio_from_url` tool to process audio content. ## Requirements - **Anthropic API Key**: Required for Claude 3.7 Sonnet access - **GROQ API Key**: Required for audio transcription functionality ## Usage Examples ### Audio Transcription 1. Share an audio URL in the chat 2. The agent will automatically detect the URL and transcribe the content 3. You'll receive both the transcription and Claude's analysis ``` please, generate a transcription for this file: https://huggingface.co/spaces/anewryzm/transcript-generator-client/resolve/main/test_files/this%20people%203.m4a ``` ### General Conversation Simply chat with the agent as you would with Claude. The agent will only use transcription tools when appropriate. ## Technical Details ### Components - **Gradio UI**: Creates a responsive chat interface - **Anthropic Client**: Handles communication with Claude API - **MCPClient**: Connects to the Model Context Protocol server - **Tool Processing Logic**: Manages the transcription workflow ### Environment Variables The application supports setting API keys via environment variables: - `ANTHROPIC_API_KEY`: Your Anthropic API key - `GROQ_API_KEY`: Your GROQ API key If these are not provided as environment variables, the UI will prompt for them. ### Tool Decision Making The agent uses Claude itself to determine whether to use the transcription tool by analyzing: - Whether the message contains an audio URL - The context and intent of the user's request - The relevance of transcription to the current conversation ## Deployment This agent is hosted on Hugging Face Spaces, making it easily accessible via web browser without any installation requirements. ## Limitations - Only processes audio from publicly accessible URLs - Requires valid API keys for both Anthropic and GROQ - Transcription quality depends on the audio quality and GROQ's capabilities ## Future Improvements - Support for more audio formats and sources - Additional text processing tools for transcript analysis - Integration with more LLM providers ## About MCP (Model Context Protocol) MCP is a standardized way for language models to access external tools and capabilities. It allows models to: - Discover available tools - Understand tool parameters and requirements - Invoke tools with appropriate inputs - Process tool outputs in context