Engineering Manager - AI Product
New
P
PragmatikeCloud and Infrastructure
Remote (Europe Time Zone), Europe Time ZoneFull-TimeManager
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Experience
- 7+ years
- Required Skills
- AWSPythonKubernetesTerraformDistributed Systems
Requirements
- 7+ years of experience in software engineering.
- 2+ years in a technical leadership or engineering management role.
- Proven experience building and operating AI/ML platform or inference infrastructure in production.
- Strong Python development skills; systems language (Go, Rust, or similar) is a plus.
- Hands-on familiarity with LLM stacks: model APIs, serving frameworks (vLLM, TGI, Triton), retrieval/vector databases, and prompt engineering.
- Strong grasp of AI product quality, evaluation frameworks, benchmarking, and observability.
- Strong expertise in cloud platforms (AWS preferred: EC2, ECS, Lambda, IAM, CloudWatch) and GPU compute.
- Familiarity with Kubernetes, containerization, and Infrastructure-as-Code (Terraform, Pulumi).
- Understanding of CI/CD automation and Linux systems networking/monitoring fundamentals.
- Excellent communication and leadership skills.
Responsibilities
- Lead, mentor, and grow a small, high-performing team of engineers focused on AI platform and product engineering.
- Drive architectural direction for the AI product with an emphasis on inference performance, reliability, cost efficiency, and developer experience.
- Contribute hands-on to design, implementation, and optimization of core AI systems including model serving, inference pipelines, retrieval, orchestration, and evaluation.
- Own the AI/ML platform end to end, including GPU capacity, model deployment, data pipelines, and monitoring.
- Collaborate closely with Product, Infrastructure, Security, and Backend teams to define priorities and ensure smooth integrations.
- Conduct regular 1:1s, performance reviews, and technical coaching.
- Foster a culture of ownership, engineering excellence, and continuous improvement.
View Full Description & ApplyYou'll be redirected to the employer's site
