- Implement AI platform components including model serving layers, retrieval infrastructure, prompt management, and output evaluation services.
- Develop and maintain APIs for product teams to integrate AI capabilities.
- Build observability and monitoring to track output quality, latency, cost, and system health.
- Collaborate with product engineering teams to translate requirements into platform features.
- Define and enforce integration standards including API contracts and error handling patterns.
- Implement evaluation and monitoring pipelines to ensure AI output quality and model behavior.
- Design systems that handle PII, maintain audit trails, and meet data residency requirements.
Node.jsPythonJava+3 more