Senior AI Product Analyst
M
MEDvidiHealthcare AI
Source API remote eligibility restrictions: Spain, Ability to work CET-overlapping hoursContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Fluent Russian; English level B2 or higher
- Experience
- 5+ years of experience in Product Analytics/Operational Analytics/Data Analytics, or analytics roles within complex production systems.
- Required Skills
- PythonSQLArtificial IntelligenceMachine LearningProduct Analytics
Requirements
- Have 5+ years of experience in Product Analytics, Operational Analytics, Data Analytics, or analytics roles within complex production systems.
- Understand AI, ML, and LLM systems.
- Bring a strong product or operational analytics background and be comfortable owning metrics end-to-end.
- Write SQL and Python code against messy production data.
- Be fluent in Russian.
- Have English proficiency at B2 level or higher.
- Be able to work CET-overlapping hours in a B2B format.
- Communicate effectively in writing and verbally, producing decision-ready analysis for non-analysts.
- Be comfortable working in ambiguous, fast-changing environments where ground truth often has to be constructed.
- Hands-on experience evaluating LLM or AI output, prompt iteration, evaluation frameworks, or human-review pipelines is a plus.
Responsibilities
- Own product analytics for shipped features, including discovery, sizing, experiment design and analysis, funnel and adoption analysis, and post-release impact assessment.
- Analyze production behavior across AI and automation workflows in clinical and operational journeys.
- Investigate hallucinations, silent failures, and quality degradation in AI-generated output.
- Examine logs, transcripts, generated artifacts, and operational data to identify patterns dashboards miss.
- Design automated and human-review evaluations for AI quality and feed findings into prompt and product changes.
- Build monitoring and dashboards for AI and automation health and related operational metrics.
- Measure the business and operational impact of automation initiatives and surface associated risks.
- Partner with Product, Engineering, Clinical, MedOps, and Legal to support decisions.
View Full Description & ApplyYou'll be redirected to the employer's site
