Music Producer - AI Evaluation

Obsidian; Greater London; On-site; GBP 12,000 - 26,000; Full time

Job summary

Mercor is seeking experienced music professionals to evaluate generative AI music in English and German. You will rate samples on musicality, creativity, prompt adherence, vocal and mix quality, and annotate structure and genres with a detailed taxonomy.

Responsibilities include evaluating lyrics, vocal performance, and the quality of training data. This is a task-based role with flexible commitment for up to six months, approximately 20 hours weekly.

Qualifications

• Native or near-native German and able to follow English instructions.
• Professional or semi-professional experience in music.
• Headphones or studio monitors suitable for careful listening.

Responsibilities

• Rate AI-generated music across genres on musicality, creativity, prompt adherence, vocal quality, and mix.
• Annotate genre/sub-genre, song structure, and vocal/instrumental traits with a taxonomy.
• Evaluate lyrics and vocal performance against references.
• Score the quality of training data used for models.

Skills

German language proficiency

English comprehension

Music production

Audio engineering

Songwriting

Lyrics writing

Education

Formal music training

Tools

Headphones

Studio monitors

Job description

Mercor is hiring experienced music professionals to evaluate generative music AI models, in partnership with a leading AI lab.

You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in German and English.

Key Responsibilities

• Rate AI-generated music samples head-to-head on musicality, creativity, prompt adherence, vocal quality, and production/mix quality
• Annotate songs in detail: genre and sub-genre classification, song structure, and vocal and instrumental characteristics, using a structured taxonomy
• Evaluate generated lyrics and vocal performance against reference material
• Score the quality of musical training data

Requirements

• Native or near-native proficiency in German, and the ability to follow detailed written instructions in English
• Professional or semi-professional experience in music, via either track below
• Headphones or studio monitors suitable for careful listening

We hire on either of two tracks

Production track — 3+ years working as a music producer, audio engineer, or sound mixer, and comfort using audio-engineering vocabulary to describe a mix by ear.

Music and language track — deep knowledge of the German music scene, with professional or semi-professional experience as a songwriter, lyricist, performer, composer, or music journalist. Studio production credentials are not required on this track.

Nice to have

• Formal training in music performance, theory, or composition
• Experience writing, performing, or producing released music in German
• Broad familiarity with contemporary German genres, sub-genres, and artists

Pay

• This role is paid per completed task, not per hour
• A task is one completed evaluation of a single music sample, submitted and passing quality review
• The rate shown is a blended average across task types, weighted by expected volume — shorter tasks pay less per task and longer ones pay considerably more
• Delivering more tasks per week moves you into a higher rate band

Project Timeline

• Start date: immediate
• Duration: up to 6 months
• Commitment: flexible. Most experts work around 20 hours per week; there is no upper cap, and high-volume contributors take on considerably more

Application & Onboarding

• Upload your resume and complete the application form
• Complete a 25-minute conversational interview covering your background, experience, and motivations
• Receive next steps and onboarding details within a few days

Apply today and put your musical expertise to work.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.