Senior AI Product Analyst - Voice AI Agents
New
M
MEDvidiAI healthcare
Source API remote eligibility restrictions: Poland, Ability to work CET-overlapping hours.ContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Fluent Russian; English level B2 or higher.
- Experience
- 5+ years of experience in Product Analytics, Data Analytics, Operational Analytics, or analytics roles within complex production systems.
- Required Skills
- PythonSQLProduct AnalyticsData analytics
Requirements
- 5+ years of experience in Product Analytics, Data Analytics, Operational Analytics, or analytics roles within complex production systems.
- Strong SQL skills.
- Python for analytical investigations and working with large-scale text datasets.
- Experience working with ML pipelines or AI-powered products.
- Understanding of LLM limitations, hallucinations, evaluation challenges, prompt sensitivity, and AI failure modes.
- Experience building monitoring systems, analytical frameworks, or operational dashboards.
- Strong communication skills and ability to translate analysis into product decisions.
- Ability to work effectively in ambiguous and fast-changing environments.
- Fluent Russian.
- English level B2 or higher.
- Ability to work CET-overlapping hours.
Responsibilities
- Analyze production behavior of Voice AI Agents and conversational AI workflows.
- Investigate hallucinations, inconsistencies, silent failures, and quality degradation in AI-driven conversations.
- Analyze call transcripts, logs, generated outputs, and operational datasets to uncover patterns and actionable insights.
- Design evaluation frameworks to measure AI quality, reliability, and business impact.
- Build monitoring systems and dashboards for AI performance visibility.
- Measure the impact of AI systems on operational efficiency, business outcomes, and patient experience.
- Detect quality shifts, anomalies, and emerging failure modes in production environments.
- Partner with Product, Engineering, QA, and Operations teams on AI initiatives.
View Full Description & ApplyYou'll be redirected to the employer's site
