Senior AI Voice Quality Analyst

Spotify AB; New York (NY); Hybrid; USD 114,000 - 164,000; Full time

Benefits offered by this job

Health insurance

Six-month paid parental leave

401(k) retirement plan

Monthly meal allowance

23 paid days off

Paid flexible holidays

Paid sick leave

Job summary

Spotify in the United States seeks a Senior Product Quality Analyst to define and measure AI voice quality across products and languages. You will work with Voice Production, Speak and product teams to ensure high-quality experiences for listeners in NYC or Los Angeles, with flexible remote work options.

You will design evaluation rubrics, run qualitative and MOS-style studies, surface gaps, and help set research and product priorities for future AI voice improvements.

Qualifications

• Experience in product quality, evaluation, data curation or a closely related field where human judgment assesses model or product performance.
• Ability to independently define evaluation criteria and translate subjective qualities into repeatable rubrics.
• Experience designing and running qualitative and MOS-style evaluations and synthesizing results into actionable insights.
• Understanding of voice or audio quality, including naturalness, pacing, tone and pronunciation.

Responsibilities

• Own the quality bar for Spotify’s AI voice models, defining what “good enough” means for different products and markets.
• Independently design evaluation rubrics and build an approach to measure naturalness, tone, pacing, pronunciation and audio quality.
• Plan and execute evaluation campaigns, turning findings into clear recommendations for teams.
• Establish an ongoing evaluation rhythm as technology and products evolve.
• Benchmark Spotify’s AI voices against third-party models and competitors to identify improvement areas.

Skills

Product quality

Evaluation design

Qualitative evaluations

MOS evaluations

Voice quality

Cross-team collaboration

Autonomous working

Strong judgment

Job description

Spotify in the United States seeks a Senior Product Quality Analyst to define and measure AI voice quality across products and languages. You will work with Voice Production, Speak and product teams to ensure high-quality experiences for listeners in NYC or Los Angeles, with flexible remote work options.

You will design evaluation rubrics, run qualitative and MOS-style studies, surface gaps, and help set research and product priorities for future AI voice improvements.