Back to list
High-Potential
Rust

🧩 Plano: AI-Native Proxy for Agentic Apps

6,486 stars416 forksRust
ai-gatewayai-gateway-supportenvoyenvoyproxygatewaygenerative-aillm-gatewayllm-inferencellm-proxyllm-routingllmopsllms
Plano is an AI-native proxy and data plane written in Rust, designed specifically for agent-based applications. It features built-in orchestration, safety controls, observability, and smart LLM routing at the infrastructure level. In short, it tries to abstract away the network and scheduling infrastructure required to run agents. Instead of repeatedly handling retries, routing, and monitoring in business code, developers can offload these tasks to Plano. It explores what a dedicated network middleware looks like in the era of autonomous agents.