Russian Audio Evaluator & Linguistic QA (SF Bay)

Mercor; Dallas (TX); On-site; USD 34,000 - 55,000; Full time

Job summary

Mercor is seeking a Russian Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project. The role involves transcription, annotation, and evaluation tasks to train and benchmark language models.

This short-term engagement is ideal for candidates with strong academic or analytical backgrounds fluent in Russian and English, based in the San Francisco Bay Area for occasional in-person collaboration.

Qualifications

• Strong writing, editing and critical thinking skills.
• Ability to work independently and meet deadlines.
• Native or near-native fluency in Russian and professional fluency in English.
• Familiarity with Russian language variations and contemporary usage.
• Ability to transcribe and analyze Russian audio content accurately.
• Based in the San Francisco Bay Area and available 10–20 hours per week.

Responsibilities

• Transcribe and optimize Russian audio/video content following detailed constraints.
• Produce high-quality outputs in Russian with English as needed.
• Adhere to formatting and stylistic guidelines and capture dialect nuances.
• Define evaluation rubrics and grading guidelines in Russian and English.
• Test language models and provide structured feedback to improve performance.
• Participate in QA cycles to maintain dataset quality for benchmarks.

Skills

Strong writing

Editing

Independent work

Time management

Russian fluency

English fluency

Job description

Mercor is seeking a Russian Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project. The role involves transcription, annotation, and evaluation tasks to train and benchmark language models.

This short-term engagement is ideal for candidates with strong academic or analytical backgrounds fluent in Russian and English, based in the San Francisco Bay Area for occasional in-person collaboration.