Remote Multilingual AI Quality & Evaluation Lead

Creandum Advisor LLP

Stockholms kommun

Hybrid

SEK 776.397 - 1.358.695

Vollzeit

14 Tage+

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Spotify is seeking a professional to advance multilingual AI data quality across Localization. You will define quality standards, design evaluations, and curate multilingual datasets to support scalable AI model development and evaluation.

Based in London or Stockholm, you will partner with Product, Engineering, Data Science, Research, and Localization to drive quality signals, use cases, and launch decisions, while embracing flexible work arrangements.

Qualifikationen

  • Experience in multilingual quality evaluation, localization, data curation, annotation, or related fields.
  • Understanding language quality, cultural relevance, and user experience across languages and markets.
  • Familiar with structured evaluations using rubrics, audits, or annotation workflows.
  • Comfort using qualitative and quantitative data to identify trends and improve quality.
  • Knowledge of LLMs, AI evaluation, and human‑in‑the‑loop workflows is a plus.
  • Ability to work in cross‑functional environments.

Aufgaben

  • Define quality frameworks, rubrics, thresholds for multilingual AI experiences.
  • Design and execute structured evaluations for AI-generated experiences.
  • Lead multilingual dataset curation, annotation, and ground-truth creation.
  • Analyze results, identify gaps, and provide actionable recommendations.
  • Support evaluator calibration and human‑AI agreement studies.
  • Collaborate with Product, Engineering, Data Science, Localization, vendors and markets.
  • Document best practices and help define quality standards.
  • Contribute to scalable evaluation capabilities for next-gen AI experiences.

Kenntnisse

Quality evaluation
Localization
Data curation
Annotation
AI evaluation
LLMs awareness

Tools

SQL
Python
Dashboards
Annotation platforms

Jobbeschreibung

Spotify is seeking a professional to advance multilingual AI data quality across Localization. You will define quality standards, design evaluations, and curate multilingual datasets to support scalable AI model development and evaluation.

Based in London or Stockholm, you will partner with Product, Engineering, Data Science, Research, and Localization to drive quality signals, use cases, and launch decisions, while embracing flexible work arrangements.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Multilingual AI Quality Specialist
Multilingual AI Quality Specialist

Creandum Advisor LLP • Stockholms kommun

Hybrid
SEK 776.397 - 1.358.695
Senior Speech AI Scientist - Generative & Production ML
Senior Speech AI Scientist - Generative & Production ML

Spotify • Stockholms kommun

Hybrid
SEK 900.000 - 1.300.000
Flexible work options
Health insurance
Staff Machine Learning Engineer - Content Intelligence
Staff Machine Learning Engineer - Content Intelligence

Spotify • Stockholms kommun

Hybrid
SEK 758.478 - 1.300.249
Senior Machine Learning Engineering Manager
Senior Machine Learning Engineering Manager

Spotify • Stockholms kommun

Hybrid
SEK 1.586.000 - 2.643.000
Senior Staff Machine Learning Engineer, Content Platform
Senior Staff Machine Learning Engineer, Content Platform

Spotify • Stockholms kommun

Hybrid
SEK 70.000 - 120.000
Senior Staff Machine Learning Engineer - Content Policy & Safety
Senior Staff Machine Learning Engineer - Content Policy & Safety

Spotify • Stockholms kommun

Hybrid
SEK 1.085.069 - 1.627.603
Senior ML Engineering Manager: Strategy & Hands-On Leadership
Senior ML Engineering Manager: Strategy & Hands-On Leadership

Spotify • Stockholms kommun

Hybrid
SEK 1.586.000 - 2.643.000
Remote AI Swedish Language QA Specialist
Remote AI Swedish Language QA Specialist

SME Careers • Västernorrlands län

Remote
SEK 276.000 - 551.000
Staff Engineer - Content Intelligence Infrastructure
Staff Engineer - Content Intelligence Infrastructure

Spotify • Stockholms kommun

Hybrid
SEK 600.000 - 900.000
Senior Machine Learning Engineer - Policy & Safety
Senior Machine Learning Engineer - Policy & Safety

Spotify • Stockholm

Hybrid
SEK 900.000 - 1.100.000