Senior AI Product Engineer
New
P
Progress PartnersSaaS and mobile
European Union, Georgia, Serbia, Turkey, distributed across time zonesFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years in software engineering, AI product engineering, ML engineering, or a related technical role, plus 2+ years hands-on with LLMs, prompt engineering, or applied AI systems
- Required Skills
- Machine LearningProduct AnalyticsSoftware EngineeringA/B testingPrompt Engineering
Requirements
- 5+ years in software engineering, AI product engineering, ML engineering, or a related technical role.
- 2+ years hands-on with LLMs, prompt engineering, or applied AI systems.
- Proven experience improving AI features post-launch through analytics, experimentation, and structured evaluation.
- Strong grasp of product analytics, funnel metrics, and how to connect AI behavior to business outcomes.
- Ability to diagnose whether an AI quality issue stems from prompts, context, model limitations, UX, or data.
- Strong written communication skills.
- Ability to work autonomously in a remote, async environment.
- Comfort working closely with Product, Growth, Design, Engineering, QA, and Analytics teams.
Responsibilities
- Own the end-to-end quality of our AI-powered product experiences, improving response usefulness, consistency, and reliability in ways users actually notice.
- Build evaluation frameworks and repeatable test sets so we can measure AI quality objectively, not anecdotally.
- Design and run experiments on prompts, context strategies, and model settings, connecting every change to activation, conversion, retention, or satisfaction metrics.
- Monitor and reduce AI-related costs (tokens, latency, model choice, retrieval) without compromising the user experience.
- Translate AI failure patterns, hallucinations, inconsistent outputs, weak reasoning, into clear, prioritized fixes for Product and Engineering.
- Help Product, Growth, and Engineering teams understand where AI changes create real user and business impact.
View Full Description & ApplyYou'll be redirected to the employer's site
