agentgateway

Next Generation Agentic Proxy for AI Agents and MCP servers

★ 5K887 forksRustApache-2.0agentgateway

Rust-based AI-native proxy that sits in front of LLM providers, MCP servers, and A2A agents, adding auth, RBAC, guardrails, rate limiting, and OpenTelemetry. Runs standalone or on Kubernetes via Gateway API, with tool federation and inference-aware routing. Apache-2.0, Linux Foundation project.

Use Cases

Route LLM traffic across providers via one OpenAI-compatible APIFederate MCP tools and servers for agentsSecure agent-to-agent communication over A2AInference routing to self-hosted models on KubernetesApply guardrails and content moderation to prompts and responsesEnforce auth, RBAC, and rate limits on agent trafficEmit OpenTelemetry metrics, logs, and tracesBudget and spend controls for LLM usageLoad balancing and failover across model providersOAuth-protected tool access for MCP servers

Built With

Language: Rust
Frameworks: Kubernetes Gateway API · Istio · Envoy · controller-runtime · MCP Go SDK · gRPC · OpenTelemetry · CEL · Helm

agentgateway

Use Cases

Built With

Tags