Principal Product Manager, AI Platform
New
A
AngiHome Services
Remote - United StatesFull-TimePrincipal
Salary$190,000 – $280,000
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years of experience in Product Management, with at least 4 years focused on infrastructure, platforms, ML/AI systems, or other technical products
- Required Skills
- Artificial IntelligenceCloud ComputingKubernetesMachine LearningProduct ManagementData scienceLLM
Requirements
- 8+ years of experience in Product Management.
- At least 4 years focused on infrastructure, platforms, ML/AI systems, or technical products serving internal customers.
- Proven track record scaling technical platforms from inception through maturity.
- Technical fluency across the modern AI/ML stack including model serving, inference, and API gateways.
- Familiarity with cloud and Kubernetes infrastructure.
- Ability to use telemetry and cost data to diagnose bottlenecks and drive strategy.
- Experience with LLM gateways/proxies like LiteLLM.
- Familiarity with evaluation and observability tooling such as Langfuse.
- Experience with model serving frameworks like KServe, SageMaker, Bedrock, or Ray.
- Experience with LLM fine-tuning or prompt management and versioning.
- Knowledge of agent governance, guardrails, and PII controls.
- Exceptional leadership skills with a history of influencing cross-functional teams.
Responsibilities
- Own the vision for a governed, model-agnostic AI gateway with cost attribution, model routing, and rate limiting.
- Define the roadmap for the eval engine, pass/fail gates, and agent accuracy scoring.
- Develop the trust-and-autonomy ladder to govern agent independence and accountability.
- Manage production paths for self-hosted LLM/open-weight model serving and traditional ML workloads.
- Define and instrument metrics for platform health and business impact.
- Establish partnerships with product engineering, architecture, and data science teams.
- Manage a complex platform backlog and communicate authoritative trade-off decisions.
- Interface with business stakeholders to translate infrastructure investments into outcomes.
View Full Description & ApplyYou'll be redirected to the employer's site
