Bilingual Evaluator - Fully Remote | Upto $50/hr

mercor; Singapore; Remote; SGD 79,000 - 106,000; Part time

Job summary

Mercor is seeking a Dutch Audio Generalist Evaluator for a remote, contract-driven role lasting 3–6 months. You will transcribe audio and video in Dutch and English, develop evaluation rubrics, and test models to ensure benchmark quality.

Ideal candidates work independently, meet deadlines, and can align with GMT or PST hours. This contract position offers $50/hour compensation and requires strong writing, Dutch-English fluency, and the ability to operate across time zones.

Qualifications

• Fluent in Dutch and English.
• Strong writing and critical thinking skills.
• Able to work independently and meet deadlines.
• Able to work within GMT or PST working hours.

Responsibilities

• Transcribe audio and video with precision in Dutch and English. Ensure adherence to multiple constraints and instructions.
• Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English.
• Conduct model testing by running prompts and assessing outputs against expectations.
• Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.
• Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.

Skills

Strong writing

Critical thinking

Independent work

Dutch and English fluency

GMT/PST hours

Education

College students or graduates

Job description

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Role

Position: Dutch Audio Generalist Evaluator

Type: Contract

Compensation: $50/hour

Location: Remote

Duration: 3–6 months

Role Responsibilities

• Transcribe audio and video with precision in Dutch and English . Ensure adherence to multiple constraints and instructions.
• Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English .
• Conduct model testing by running prompts and assessing outputs against expectations.
• Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.
• Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.

Qualifications

Must-Have

• Strong writing and critical thinking skills
• Ability to work independently and meet deadlines
• Fluent in Dutch and English
• Able to work within GMT or PST working hours

Preferred

• College students or graduates

Originally posted on Himalayas