Test Engineer - Fully Remote | Upto $90/hr

mercor; United States; A distancia; USD 74.000 - 124.000; A tiempo parcial

Descripción de la vacante

Mercor is seeking a QA/Test Engineer for a remote contract role. You will design test cases, review tasks and reference solutions to catch ambiguities, and debug using Python to ensure robust checks.

Build quality checklists and provide actionable feedback to authors, while monitoring AI agent runs for shortcuts and grading gaps to ensure trustworthy benchmark scores. The ideal candidate holds an MSc or PhD in a STEM field (or equivalent experience), has 1+ year in QA/test roles, and

Formación

• MSc or PhD in a STEM field or equivalent practical experience.
• 1+ years in test engineering, quality assurance, or a related role.
• Experience designing test cases and debugging complex systems.
• Proficiency in Python and Git
• Exceptional attention to detail and clear documentation habits.

Responsabilidades

• Design test cases to confirm task functionality, including edge cases.
• Review tasks and reference solutions to catch ambiguities and gaps early.
• Debug using Python when tasks or checks misbehave.
• Build quality checklists and provide actionable feedback to authors.
• Monitor AI agent runs for shortcuts and grading gaps to ensure trustworthy benchmark scores.

Conocimientos

Python

Attention to detail

Educación

MSc or PhD in STEM

Herramientas

Git

Descripción del empleo

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: QA/Test Engineer Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week

Role Responsibilities

• Design test cases to confirm task functionality, including edge cases.
• Review tasks and reference solutions to catch ambiguities and gaps early.
• Debug using Python when tasks or checks misbehave.
• Build quality checklists and provide actionable feedback to authors.
• Monitor AI agent runs for shortcuts and grading gaps to ensure trustworthy benchmark scores.

Qualifications Must-Have

• MSc or PhD in a STEM field or equivalent practical experience.
• 1+ years in test engineering, quality assurance, or a related role.
• Experience designing test cases and debugging complex systems.
• Proficiency in Python and Git .
• Exceptional attention to detail and clear documentation habits.

Qualifications Preferred

• Experience in AI training , model evaluation, or quality review of AI-generated work.
• A perfectionist mindset and ability to work independently through ambiguous problems.