Russian Music Expert - Song Evaluation

Obsidian; San Francisco (CA); On-site; USD 41,000 - 83,000; Full time

Job summary

Mercor is seeking experienced musicians to evaluate generative music AI models in collaboration with a leading AI lab. You will assess AI-generated lyrics across genres and rate them against quality standards, working in Russian and English.

Key tasks include comparing lyrics to published songs, rating for creativity and adherence to prompts, and evaluating natural phrasing, slang, and regional usage. Most experts work ~20 hours per week; compensation is hourly.

Qualifications

• Native or near-native proficiency in Russian; able to follow detailed written instructions in English
• Experience as songwriter/lyricist/performer/composer/music journalist with knowledge of the Russian music scene
• Headphones or studio monitors suitable for critical listening

Responsibilities

• Compare AI-generated lyrics with published songs to identify similarities
• Rate lyrics based on quality, creativity, prompt adherence, and originality
• Evaluate whether lyrics sound natural, including word choice, slang, and regional expressions

Skills

Russian language

Songwriting/lyric writing

Critical listening

Education

Formal training in music performance/theory/composition

Tools

Headphones

Studio monitors

Job description

Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab.

You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Russian and English.

Key Responsibilities

• Compare AI-generated lyrics with published songs to identify similarities

• Rate lyrics based on quality, creativity, prompt adherence, and originality

• Evaluate whether lyrics sound natural, including word choice, slang, and regional expressions.

Requirements

• Native or near-native proficiency in Russian, and the ability to follow detailed written instructions in English

• Experience as a songwriter, lyricist, performer, composer, or music journalist, with knowledge of the Russian music scene

• Headphones or studio monitors suitable for critical listening

Nice to have

• Formal training in music performance, theory, or composition

• Credited or published songwriting work

• Broad familiarity with contemporary Russian genres, sub-genres, and artists

Project Timeline

• Start date: immediate

• Duration: up to 6 months

• Commitment: flexible. Most experts work around 20 hours per week; there is no cap

• Compensation: this role is currently paid hourly. The pay structure may move to per-task during the project; if it does, your effective hourly rate will stay the same.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.