Russian Audio Evaluator — SF Bay Area

Mercor; New York (NY); Hybrid; USD 28,000 - 55,000; Part time

Job summary

Mercor seeks a Russian Audio Generalist Evaluator Expert for a short-term, structured engagement. You will transcribe, annotate, and evaluate audio content to train and benchmark language models. Fluency in Russian and English is required, with a San Francisco Bay Area base enabling occasional in-person collaboration.

The role suits candidates with strong analytical backgrounds and the ability to work 10–20 hours per week.

Qualifications

• Native or near-native fluency in Russian and professional fluency in English.
• Strong writing, editing, and critical thinking abilities.
• Ability to work independently and meet deadlines.
• Experience with transcription, annotation, or evaluation workflows is a plus.

Responsibilities

• Transcribe and optimise audio and video content in Russian, following constraints.
• Produce high-quality outputs in Russian; provide English support when required.
• Define evaluation standards and rubrics in Russian and English.
• Conduct model testing and grading; provide structured feedback.
• Support benchmarking and QA to ensure task quality and consistency.

Skills

Russian fluency

English fluency

Transcription & analysis

Attention to detail

Time management

Job description

Mercor seeks a Russian Audio Generalist Evaluator Expert for a short-term, structured engagement. You will transcribe, annotate, and evaluate audio content to train and benchmark language models. Fluency in Russian and English is required, with a San Francisco Bay Area base enabling occasional in-person collaboration.

The role suits candidates with strong analytical backgrounds and the ability to work 10–20 hours per week.