Machine Learning Engineer, Ops
New
C
Cantina LabsSocial AI
Remote (U.S. or Europe)Full-TimeMiddle
Salary$125,000-$165,000 (€110,000-€145,000)
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonKubernetesGoMLOps
Requirements
- Deep understanding of modern audio model architectures (e.g., TTS, ASR) and their specific inference requirements.
- Strong hands-on experience with Kubernetes (K8S), container orchestration, and implementing autoscaling strategies for production workloads.
- Solid background in MLOps, including CI/CD automation and managing scalable cloud infrastructure.
- Proficiency in software engineering principles and experience with Python or Go for infrastructure tooling and backend services.
- Experience with GPU-accelerated inference and performance profiling techniques.
Responsibilities
- Design and maintain inference infrastructure for generative audio model architectures.
- Implement and manage high-performance inference engines.
- Orchestrate service deployments using Kubernetes (K8S), implementing advanced autoscaling paradigms to handle varying traffic loads efficiently.
- Develop and automate robust CI/CD pipelines to streamline the testing and deployment of model artifacts and inference configurations.
- Monitor production systems, establishing observability practices to track latency, resource utilization, and overall model performance.
- Collaborate closely with research teams to optimize model serving paths and evaluate various inference strategies.
- Optimize inference performance for both streaming and batch applications.
View Full Description & ApplyYou'll be redirected to the employer's site
