Russian Audio Linguistics Evaluator — SF Bay Area

Obsidian; New York (NY); Remote; USD 34,440,000 - 55,104,000; Part time

Job summary

Mercor is seeking a Russian Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. The role involves transcription, annotation, and evaluation tasks that help train and benchmark advanced language models.

This short-term engagement suits candidates with strong academic or analytical backgrounds who are fluent in Russian and English and based in the SF Bay Area.

Qualifications

• Strong writing, editing, and critical thinking skills.
• Native or near-native fluency in Russian (spoken and written) and professional fluency in English.
• Based in the San Francisco Bay Area.
• Available to commit 10-20 hours per week.

Responsibilities

• Transcribe and transcribe Russian audio content with accuracy and consistency.
• Annotate and evaluate audio data according to defined rubrics.
• Develop and document evaluation standards in Russian and English.
• Conduct model testing and provide structured feedback for improvements.
• Support benchmarking and QA processes to ensure data quality.

Skills

Russian fluency

English fluency

Transcription

Editing

Quality assurance

Independent work

Education

Linguistics background

Job description

Mercor is seeking a Russian Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. The role involves transcription, annotation, and evaluation tasks that help train and benchmark advanced language models.

This short-term engagement suits candidates with strong academic or analytical backgrounds who are fluent in Russian and English and based in the SF Bay Area.