Principal AI Platform Engineer
New
Based in United StatesFull-TimePrincipal
Salary$179,000 - $199,000 annually, plus bonus and benefits
Apply NowOpens the employer's application page
Job Details
- Required Skills
- KubernetesMLFlowCI/CD
Requirements
- Extensive experience designing, building, and maintaining AI platform infrastructure in production environments.
- Strong expertise with Kubernetes, containerized environments, and container security practices.
- Demonstrated experience with observability and monitoring frameworks, including technologies such as OpenTelemetry and MLflow.
- Hands-on experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI development environments.
- Strong understanding of authentication and authorization frameworks for secure AI platforms.
- Experience building scalable distributed systems and optimizing infrastructure performance.
- Familiarity with LLM inference frameworks such as vLLM, SGLang, or similar technologies is a plus.
- Experience with CI/CD pipelines, automation, and AI model deployment processes.
- Strong collaboration skills with the ability to work effectively across product, engineering, and technical teams.
Responsibilities
- Design, build, and maintain foundational AI platform components, including model gateways, prompt and version management systems, vector databases, and LLM evaluation frameworks.
- Develop secure platform architectures with integrated authentication, authorization, and access control mechanisms.
- Build and enhance observability solutions, including monitoring, logging, and performance tracking for AI workloads and infrastructure.
- Partner with product and engineering teams to integrate AI infrastructure with agent frameworks and downstream applications.
- Optimize AI platforms for scalability, reliability, availability, and cost efficiency in production environments.
- Establish best practices for AI platform operations, deployment workflows, and infrastructure management.
- Support continuous improvement of AI capabilities through strong engineering standards, automation, and technical leadership.
View Full Description & ApplyYou'll be redirected to the employer's site
