North AmericaFull TimeData Science
Remotely
qaaidataevaluationspeechmosvoice quality
Job Description
📋 Description
- Own the quality bar for Spotify’s AI voice models and define what “good enough” means across
- Independently design evaluation rubrics and an evaluation approach for naturalness, tone, pacing
- Plan and run evaluation campaigns; translate qualitative/quantitative findings into actionable
- Establish an ongoing evaluation rhythm as technology and products evolve.
- Benchmark Spotify’s AI voices against third-party models and competitors to identify strengths and
- Help determine appropriate quality trade-offs as Spotify expands into additional languages and
🎯 Requirements
- You have experience in product quality, evaluation, data curation or related field where human
- You can define evaluation criteria and turn subjective qualities into repeatable rubrics.
- You are comfortable designing and running qualitative and MOS-style evaluations and synthesizing
- You understand voice or audio quality concepts like naturalness, pacing, tone, accent and
- You have strong judgment to balance different product requirements, markets and stakeholders while
- You are autonomous, can identify what needs evaluation, and establish processes to keep evaluations
🎁 Benefits
- Competitive base salary with equity.
- Health insurance, six-month paid parental leave, 401(k), meal allowance, paid time off, flexible
- Flexible working arrangements with some in-person meetings and remote work options.