Generative Music AI Evaluator (Russian/English)

Obsidian; New York (NY); Remote; USD 34,000 - 83,000; Full time

Job summary

Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Russian and English.

Responsibilities include comparing AI-generated lyrics with published songs, rating lyrics on quality, creativity, prompt adherence and originality, and evaluating natural language, slang, and regional expressions.

Qualifications

• Native or near-native proficiency in Russian and the ability to follow detailed written instructions in English.
• Experience as a songwriter, lyricist, performer, composer, or music journalist with knowledge of the Russian music scene.
• Headphones or studio monitors suitable for critical listening.

Responsibilities

• Compare AI-generated lyrics with published songs to identify similarities.
• Rate lyrics based on quality, creativity, prompt adherence, and originality.
• Evaluate whether lyrics sound natural, including word choice, slang, and regional expressions.

Skills

Russian language proficiency

Follow English instructions

Tools

Headphones or studio monitors

Job description

Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Russian and English.

Responsibilities include comparing AI-generated lyrics with published songs, rating lyrics on quality, creativity, prompt adherence and originality, and evaluating natural language, slang, and regional expressions.