Dutch Audio Evaluator — Remote QA & Benchmark Specialist

mercor; San Francisco (CA); Hybrid; GBP 45,000 - 60,000; Full time

Job summary

Mercor is seeking a Dutch Audio Generalist Evaluator for a remote contract (3–6 months). You will transcribe audio and video in Dutch and English and help define evaluation standards.

You will run prompts, assess outputs, and support benchmarking and QA to ensure high-quality benchmarks. Strong writing, independence, and bilingual fluency are essential.

Qualifications

• Strong writing and critical thinking skills.
• Ability to work independently and meet deadlines.
• Fluent in Dutch and English.
• Able to work within GMT or PST working hours.

Responsibilities

• Transcribe audio and video with precision in Dutch and English.
• Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English.
• Conduct model testing by running prompts and assessing outputs against expectations.
• Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.
• Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.

Skills

Dutch fluency

English fluency

Independent worker

Time-zone flexibility

Education

College student or graduate

Job description

Mercor is seeking a Dutch Audio Generalist Evaluator for a remote contract (3–6 months). You will transcribe audio and video in Dutch and English and help define evaluation standards.

You will run prompts, assess outputs, and support benchmarking and QA to ensure high-quality benchmarks. Strong writing, independence, and bilingual fluency are essential.