agentproxy

<div align="center"> <picture> <source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/agentgateway/agentgateway/refs/heads/main/img/banner-light.svg" alt="agentgateway" width="400"> <source media="(prefers-color-scheme: light)" srcset="https://raw.githubusercontent.com/agentgateway/agentgateway/refs/heads/main/img/banner-dark.svg" alt="agentgateway" width="400"> <img alt="agentgateway" src="https://raw.githubusercontent.com/agentgateway/agentgateway/refs/heads/main/img/banner-light.svg"> </picture> <div> <a href="https://opensource.org/licenses/Apache-2.0"> <img src="https://img.shields.io/badge/License-Apache2.0-brightgreen.svg?style=flat" alt="License: Apache 2.0"> </a> <a href="https://github.com/agentgateway/agentgateway"> <img src="https://img.shields.io/github/stars/agentgateway/agentgateway.svg?style=flat&logo=github&label=Stars" alt="Stars"> </a> <a href="https://discord.gg/BdJpzaPjHv"> <img src="https://img.shields.io/discord/1346225185166065826?style=flat&label=Join%20Discord&color=6D28D9" alt="Discord"> </a> <a href="https://github.com/agentgateway/agentgateway/releases"> <img src="https://img.shields.io/github/v/release/agentgateway/agentgateway?style=flat&label=Latest%20Release&color=6D28D9" alt="Latest Release"> </a> <a href="https://deepwiki.com/agentgateway/agentgateway"><img src="https://deepwiki.com/badge.svg" alt="Ask DeepWiki"></a> <a href='https://codespaces.new/agentgateway/agentgateway'> <img src='https://github.com/codespaces/badge.svg' alt='Open in Github Codespaces' style='max-width: 100%;' height="20"> </a> </div> <div> The <strong>first complete</strong> connectivity solution for Agentic AI. </div> </div> --- **Agentgateway** is an open source proxy built on AI-native protocols ([MCP](https://modelcontextprotocol.io/introduction) & [A2A](https://developers.googleblog.com/en/a2a-a-new-era-of-agent-interoperability/)) that provides drop-in security, observability, and governance for agent-to-LLM, agent-to-tool, and agent-to-agent communication across any framework and environment. <br> <div align="center"> <img alt="agentgateway UI" src="img/architecture.svg" width="800"> </div> <br> ## Intro to Agentgateway Video <br> <div align="center"> <a href="https://youtu.be/SomP92JWPmE"> <img alt="Agentgateway Intro Video" src="https://img.youtube.com/vi/SomP92JWPmE/hqdefault.jpg"> </a> </div> <br> ## Key Features - **LLM Gateway**<br> Route traffic to major LLM providers (OpenAI, Anthropic, Gemini, Bedrock, and more) through a unified OpenAI-compatible API with budget and spend controls, prompt enrichment, load balancing, and failover. - **MCP Gateway**<br> Connect LLMs to tools and external data sources via MCP with tool federation, stdio/HTTP/SSE/Streamable HTTP transports, OpenAPI integration, and OAuth authentication. - **A2A Gateway**<br> Enable secure agent-to-agent communication using A2A, with capability discovery, modality negotiation, and task collaboration. - **Inference Routing**<br> Intelligent routing to self-hosted models using Kubernetes Inference Gateway extensions, with decisions based on GPU utilization, KV cache, LoRA adapters, and queue depth. - **Guardrails**<br> Multi-layered content filtering with regex, OpenAI moderation, AWS Bedrock Guardrails, Google Model Armor, and custom webhooks. - **Security & Observability**<br> Auth (JWT, API keys, OAuth), fine-grained RBAC with CEL policy engine, rate limiting, TLS, and OpenTelemetry metrics/logs/tracing. <br> ## Getting Started - [Standalone Quickstart](https://agentgateway.dev/docs/standalone/latest/documentation/quickstart) — Get started with agentgateway in minutes. - [Kubernetes Quickstart](https://agentgateway.dev/docs/kubernetes/latest/documentation/quickstart) — Deploy on Kubernetes using the built-in controller and Gateway API. ## Documentation Depending on your deployment environment, check out the following docs: - [agentgateway.dev/docs](https://agentgateway.dev/docs/standalone/latest): For deployments without the full Kubernetes controller, driven by flat yaml config. - [agentgateway.dev/docs/kubernetes/latest](https://agentgateway.dev/docs/kubernetes/latest): For Kubernetes-based deployments using the built-in Kubernetes controller and Gateway API support. Agentgateway has a built-in UI for you to explore agentgateway connecting agent-to-agent or agent-to-tool: <div align="center"> <img alt="agentgateway UI" src="img/UI-homepage.png"> </div> ## Sponsors <table> <tr> <td align="center" width="33.3%"> <a href="https://blacksmith.sh/"> <picture> <source media="(prefers-color-scheme: light)" srcset="https://raw.githubusercontent.com/agentgateway/agentgateway/main/img/blacksmith-light.svg"> <img src="https://raw.githubusercontent.com/agentgateway/agentgateway/main/img/blacksmith.svg" alt="Blacksmith" height="48"> </picture> </a> </td> </tr> </table> Thank you to our sponsors for helping to fund the development of agentgateway! ## Contributing For instructions on how to contribute to the agentgateway project, see the [CONTRIBUTION.md](CONTRIBUTION.md) file. ## Community Meetings To join a community meeting, add the [agentgateway calendar](https://calendar.google.com/calendar/u/0?cid=Y18zZTAzNGE0OTFiMGUyYzU2OWI1Y2ZlOWNmOWM4NjYyZTljNTNjYzVlOTdmMjdkY2I5ZTZmNmM5ZDZhYzRkM2ZmQGdyb3VwLmNhbGVuZGFyLmdvb2dsZS5jb20) to your Google account. Then, you can find event details on the calendar. Recordings of the community meetings will be published on our [google drive](https://drive.google.com/drive/folders/138716fESpxLkbd_KkGrUHa6TD7OA2tHs?usp=sharing). ## Roadmap `agentgateway` is currently in active development. If you'd like a feature that's missing, open an issue in our [GitHub repo](https://github.com/agentgateway/agentgateway/issues). ## Contributors Thanks to all contributors who are helping to make agentgateway better. <a href="https://github.com/agentgateway/agentgateway/graphs/contributors"> <img src="https://contrib.rocks/image?repo=agentgateway/agentgateway" /> </a> --- <div align="center"> <img src="img/lf-stacked-color.png" width="300" alt="Linux Foundation logo"/> <p>Agentgateway is a <a href="https://www.linuxfoundation.org/">Linux Foundation</a> project.</p> </div>