Bilingual Evaluator - Fully Remote | Upto $50/hr

mercor; San Francisco (CA); Hybrid; GBP 45,000 - 60,000; Full time

Job summary

Mercor is seeking a Dutch Audio Generalist Evaluator for a remote contract (3–6 months). You will transcribe audio and video in Dutch and English and help define evaluation standards.

You will run prompts, assess outputs, and support benchmarking and QA to ensure high-quality benchmarks. Strong writing, independence, and bilingual fluency are essential.

Qualifications

• Strong writing and critical thinking skills.
• Ability to work independently and meet deadlines.
• Fluent in Dutch and English.
• Able to work within GMT or PST working hours.

Responsibilities

• Transcribe audio and video with precision in Dutch and English.
• Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English.
• Conduct model testing by running prompts and assessing outputs against expectations.
• Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.
• Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.

Skills

Dutch fluency

English fluency

Independent worker

Time-zone flexibility

Education

College student or graduate

Job description

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Role

Position: Dutch Audio Generalist Evaluator

Type: Contract

Compensation: $50/hour

Location: Remote

Duration: 3–6 months

Role Responsibilities

• Transcribe audio and video with precision in Dutch and English . Ensure adherence to multiple constraints and instructions.
• Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English .
• Conduct model testing by running prompts and assessing outputs against expectations.
• Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.
• Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.

Qualifications

Must-Have

• Strong writing and critical thinking skills
• Ability to work independently and meet deadlines
• Fluent in Dutch and English
• Able to work within GMT or PST working hours

Preferred

• College students or graduates

Originally posted on Himalayas