Senior Product Quality Analyst, AI Voice

• Own how Spotify defines and measures AI voice quality across experiences including AI DJ, Generative AI Ads, Personalized Podcasts, Agent Voice Chat, and more. • Join the Voice Production Team within Personalization — the creative team behind Spotify's AI voice experiences who think about AI voices from casting and performance perspectives. • Bring together Voice Production's creative bar, Speak's technical bar, and the wider industry bar to answer whether the technology is the best at serving Spotify's specific needs. • Be based in London with flexibility to work from home.

• Have experience in product quality, evaluation, data curation, or a closely related field where human judgement is used to assess model or product performance. • Know how to independently define evaluation criteria and turn subjective qualities into clear, repeatable rubrics. • Be comfortable designing and running both qualitative and MOS-style evaluations and synthesising the results into actionable insights. • Have an understanding of voice or audio quality including naturalness, pacing, tone, accent, and pronunciation, or the ability to develop that expertise quickly. • Have strong judgement and maintain a consistent quality bar while balancing different product requirements, markets, and stakeholder perspectives. • Be comfortable working autonomously, identifying what needs to be evaluated and establishing the processes and cadence to make evaluation useful over time. • Communicate clearly across creative, technical, and product teams and act as a reliable point of contact for internal partners and external vendors. • Be curious about generative AI, speech technology, and the evolving AI voice landscape and translate industry changes into meaningful benchmarks for Spotify.

• Have experience benchmarking AI voice models against third-party models and competitors. • Have experience determining appropriate quality trade-offs across multiple languages and regions. • Have experience working with machine learning teams on voice or speech technology. • Have experience establishing ongoing evaluation rhythms that evolve alongside technology and products. • Have experience with voice casting, direction, recording, or production.

• Own the quality bar for Spotify's AI voice models, defining what good enough means for different products, audiences, languages, and use cases. • Independently design evaluation rubrics and build an evaluation approach that measures naturalness, tone, pacing, pronunciation, accent, audio quality, and overall experience. • Plan and carry out evaluation campaigns, turning qualitative and quantitative findings into clear recommendations for Voice Production, Speak, and product teams. • Establish an ongoing evaluation rhythm including when and how to reassess model quality as technology and products evolve. • Benchmark Spotify's AI voices against third-party models and competitors to understand where experiences lead, differ, and can improve. • Help determine appropriate quality trade-offs as Spotify expands into additional languages and regions, considering the product use case and needs of each market. • Partner closely with voice experts, machine learning teams, product partners, and vendors to maintain a consistent quality bar across demanding and sometimes competing priorities. • Surface the most meaningful gaps in model performance and use evaluation insights to help influence future research and technical priorities.

• Work from London with flexibility to work from home. • Receive extensive learning opportunities through Spotify's dedicated GreenHouse team. • Receive flexible share incentives letting you choose how you share in Spotify's success. • Receive six months of global parental leave for all new parents. • Access All The Feels, the employee assistance programme and self-care hub. • Swap public holidays flexibly according to your values and beliefs.

Spotify is the world's most popular audio streaming subscription service with more than 700 million monthly active users. The Personalization team makes deciding what to play next easier and more enjoyable for every listener, building some of Spotify's most-loved features from Blend to Discover Weekly.