Senior Product Quality Analyst - AI Voice

📋 Description

• Own the quality bar for Spotify’s AI voice models, defining what “good enough” means for different
• Independently design evaluation rubrics and build an evaluation approach that measures naturalness
• Plan and carry out evaluation campaigns, turning qualitative and quantitative findings into clear
• Establish an ongoing evaluation rhythm, including when and how we reassess model quality as
• Benchmark Spotify’s AI voices against third-party models and competitors to understand gaps and
• Help determine quality trade-offs as Spotify expands into additional languages and regions

🎯 Requirements

• Experience in product quality, evaluation, data curation or related field using human judgment to
• Ability to define evaluation criteria and turn subjective qualities into repeatable rubrics.
• Comfort designing and running qualitative and MOS-style evaluations and synthesizing results into
• Understanding of voice or audio quality (naturalness, pacing, tone, accent, pronunciation) or
• Strong judgment to balance different product requirements, markets and stakeholders.
• Autonomous work style with ability to establish evaluation processes and cadence over time.

🎁 Benefits

• Role based in London with flexibility to work from home; some in-person meetings.
• Hybrid work arrangement with opportunities to collaborate across teams in a global environment.