Agentic Data Plane

AI Gateway & LLM Providers

AI Gateway is the proxy that routes agent traffic to your LLM providers. Learn how it works, configure providers, and connect your agents to the gateway.

  • How AI Gateway Works

    AI Gateway is Agentic Data Plane's managed proxy for LLM APIs. Each provider gets a Redpanda-hosted URL with secrets, authentication, and observability.

  • Configure an LLM Provider

    Create an LLM provider to proxy requests to OpenAI, Anthropic, Google Gemini API, Amazon Bedrock, Gemini Enterprise Agent Platform, or any OpenAI-compatible endpoint through Agentic Data Plane.

  • Set Up Amazon Bedrock as an LLM Provider

    Create the IAM user, policy, and access keys required for AI Gateway to invoke Amazon Bedrock models, then register the provider in Agentic Data Plane.

  • Set Up Gemini Enterprise Agent Platform as an LLM Provider

    Set up the GCP service account, Claude access, and policies that AI Gateway needs, then register Gemini Enterprise Agent Platform (formerly Vertex AI).

  • Connect Your App to AI Gateway

    Point your app or AI agent at an AI Gateway proxy URL. Authenticate with rpk ai, OIDC client credentials, or an API key, then send requests with your SDK.