Senior Product Quality Analyst - AI Voice
New
S
SpotifyAI voice
This role is based in LondonFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Generative AI
Requirements
- Experience in product quality, evaluation, data curation or a related field using human judgment to assess model or product performance.
- Ability to independently define evaluation criteria and turn subjective qualities into clear, repeatable rubrics.
- Experience designing and running qualitative evaluations.
- Experience designing and running MOS-style evaluations.
- Ability to synthesize evaluation results into actionable insights.
- Understanding of voice or audio quality, including naturalness, pacing, tone, accent and pronunciation, or ability to develop that expertise quickly.
- Strong judgment in maintaining a consistent quality bar while balancing product requirements, markets and stakeholder perspectives.
- Ability to work autonomously and establish evaluation processes and cadence.
- Clear communication across creative, technical and product teams, including serving as a point of contact for internal partners and external vendors.
- Curiosity about generative AI, speech technology and the evolving AI voice landscape.
Responsibilities
- Define the quality bar for Spotify’s AI voice models across products, audiences, languages and use cases.
- Design evaluation rubrics and approaches for naturalness, tone, pacing, pronunciation, accent, audio quality and overall experience.
- Plan and run evaluation campaigns, then turn qualitative and quantitative findings into recommendations.
- Establish an ongoing schedule and process for reassessing model quality.
- Benchmark Spotify’s AI voices against third-party models and competitors.
- Assess quality trade-offs as Spotify expands into additional languages and regions.
- Partner with voice experts, machine learning teams, product partners and vendors to maintain a consistent quality bar.
- Identify performance gaps and use evaluation insights to influence research and technical priorities.
View Full Description & ApplyYou'll be redirected to the employer's site
