Russian Audio Evaluation Specialist — SF Bay Area (Short-Term)

Obsidian; Dallas (TX); Hybrid; USD 34,000 - 69,000; Part time

Job summary

Mercor is seeking a Russian Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. The role involves transcription, annotation, and evaluation tasks to train and benchmark language models.

This short-term engagement is ideal for candidates with strong academic or analytical backgrounds fluent in Russian and English, based in the San Francisco Bay Area for occasional in-person collaboration.

Qualifications

• Native or near-native fluency in Russian (spoken and written).
• Professional fluency in English.

Responsibilities

• Transcribe and transcribe audio/video in Russian following constraints.
• Develop and document evaluation rubrics in Russian and English.
• Evaluate model outputs for accuracy, completeness, and clarity.
• Provide structured feedback to improve model performance in Russian audio tasks.

Job description

Mercor is seeking a Russian Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. The role involves transcription, annotation, and evaluation tasks to train and benchmark language models.

This short-term engagement is ideal for candidates with strong academic or analytical backgrounds fluent in Russian and English, based in the San Francisco Bay Area for occasional in-person collaboration.