- Build and evolve AI-aware gateway components that handle traffic in real time.
- Design and implement AI Gateway Traffic Policy Objects including rate limits, usage caps, and access rules.
- Maintain systems for accurately measuring AI usage, including requests, tokens, and related metadata.
- Expose clear signals regarding AI traffic to ensure observability and explainability.
- Collaborate with product and design teams to build AI-specific gateway primitives.
- Work with Gateway, Customer Data, and Platform teams to ensure alignment of usage data, policy enforcement, and billing signals.
AWSHTMLCSS+7 more