Engineering Manager - AI Product
New
P
PragmatikeCloud and Infrastructure
Remote (Europe Time Zone), Europe Time ZoneFull-TimeManager
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Experience
- 7+ years
- Required Skills
- AWSPythonKubernetesGoRustTerraform
Requirements
- 7+ years of experience in software engineering.
- 2+ years in a technical leadership or engineering management role.
- Proven experience building and operating AI/ML platform or inference infrastructure in production.
- Strong Python skills, with systems language experience (Go, Rust, or similar) as a plus.
- Hands-on familiarity with modern LLM stacks: model APIs, open-weight models, and serving frameworks like vLLM, TGI, or Triton.
- Expertise in AI product quality including evaluation, benchmarking, and observability for non-deterministic systems.
- Strong expertise in cloud platforms (AWS preferred) and GPU compute.
- Familiarity with Kubernetes, containerization, and Infrastructure-as-Code (Terraform, Pulumi, AWS CDK).
- Understanding of CI/CD automation and Linux systems, networking, and monitoring best practices.
- Excellent communication and leadership skills.
Responsibilities
- Lead, mentor, and grow a small, high-performing team of engineers focused on AI platform and product engineering.
- Drive architectural direction for the AI product with an emphasis on inference performance, reliability, cost efficiency, and developer experience.
- Contribute hands-on to design, implementation, and optimization of core AI systems including model serving, inference pipelines, and retrieval.
- Own the AI/ML platform end to end including GPU capacity, model deployment, data pipelines, and monitoring.
- Collaborate closely with Product, Infrastructure, Security, and Backend teams to define priorities and ensure smooth integrations.
- Conduct regular 1:1s, performance reviews, and technical coaching.
View Full Description & ApplyYou'll be redirected to the employer's site
