Skip to content

Architectures

Learn how you can use AI Gateway within your existing architecture.

Reference architectures

Explore the following reference architectures that use AI Gateway:

  • Multi-vendor AI observability and control : By shifting features such as rate limiting, caching, and error handling to the proxy layer, organizations can apply unified configurations across services and inference service providers.