Music AI Evaluation Specialist

Mercor; United States; Remote; USD 60,000 - 90,000; Full time

Job summary

Mercor is seeking experienced musicians to evaluate generative musical AI models in collaboration with a leading AI lab. You will judge outputs across genres, assess lyrics and voice generation, and score training data quality.

Strong English comprehension and music production background are required. The role emphasizes careful analysis, consistency, and bilingual proficiency to ensure high-quality evaluation of creative AI systems.

Qualifications

• Experience writing music in the domain language.
• Able to understand directions in English.
• Experience as a music producer, audio engineer, or sound mixer for 3+ years.
• Evidence of understanding musical performance, theory, and lyrics.

Responsibilities

• You will assess model outputs across in different categories of music in your bilingual language.
• Evaluate AI model output lyrics, voice generation, and other standards
• Score quality of musical training data

Skills

Music production

Audio engineering

Sound mixing

Lyrics writing

Education

Bachelor's degree in music

Job description

Mercor is seeking experienced musicians to evaluate generative musical AI models in collaboration with a leading AI lab. You will judge outputs across genres, assess lyrics and voice generation, and score training data quality.

Strong English comprehension and music production background are required. The role emphasizes careful analysis, consistency, and bilingual proficiency to ensure high-quality evaluation of creative AI systems.