QA/Test Engineer - Fully Remote | Upto $90/hr

mercor

United States

Remote

USD 83,000 - 124,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mercor is a San Francisco–headquartered company that connects elite creative and technical talent with leading AI research labs. We are seeking a QA/Test Engineer on a contract basis for remote work, with a commitment of 35 hours per week and compensation of $60–$90 per hour.

The role involves designing test cases, reviewing tasks for ambiguity, debugging with Python, and contributing to quality checklists to ensure reliable AI agent runs. Strong documentation is essential.

Qualifications

  • MSc or PhD in a STEM field or equivalent practical experience.
  • 1+ years in test engineering, QA, or research/software engineering.
  • Design test cases, quality-review processes, and debugging complex systems.
  • Proficiency in Python and Git.
  • Exceptional attention to detail and clear documentation habits.

Responsibilities

  • Design test cases to confirm each task works as intended, including tricky edge cases.
  • Review tasks and reference solutions to catch ambiguity and gaps early.
  • Debug using Python when tasks or checks don't behave as expected.
  • Shape quality checklists and provide actionable feedback to authors.
  • Protect benchmark scores by identifying shortcuts and grading gaps in AI agent runs.

Skills

Design test cases
Quality assurance
Debugging complex systems
Documentation habits

Education

MSc or PhD in STEM field
Equivalent practical experience

Tools

Python
Git

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: QA/Test Engineer
Type:Contract
Compensation:$60–$90/hour
Location:Remote
Commitment:35 hours/week

Role Responsibilities
  • Design test cases to confirm each task works as intended, including tricky edge cases.
  • Review tasks and reference solutions to catch ambiguity and gaps early.
  • Debug using Python when tasks or checks don't behave as expected.
  • Shape quality checklists and provide actionable feedback to authors.
  • Protect benchmark scores by identifying shortcuts and grading gaps in AI agent runs.
Qualifications

Must-Have

  • MSc or PhD in a STEM field or equivalent practical experience.
  • 1+ years in test engineering, quality assurance, or a research/software engineering role.
  • Skill in designing test cases, quality-review processes, and debugging complex systems.
  • Proficiency in Python and Git.
  • Exceptional attention to detail and clear documentation habits.
Preferred
  • Experience in AI training, model evaluation, or quality review of AI-generated work.
  • A perfectionist mindset with creativity in identifying overlooked issues.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Test Engineer - Fully Remote | Upto $90/hr
Test Engineer - Fully Remote | Upto $90/hr

mercor • United States

Remote
USD 83,000 - 124,000
Remote QA/Test Engineer - AI Benchmarking (Contract)
Remote QA/Test Engineer - AI Benchmarking (Contract)

mercor • United States

Remote
USD 83,000 - 124,000
Remote QA/Test Engineer for AI Benchmarking & Debugging
Remote QA/Test Engineer for AI Benchmarking & Debugging

mercor • United States

Remote
USD 83,000 - 124,000
Software Tester - Fully Remote | Upto $60/hr
Software Tester - Fully Remote | Upto $60/hr

mercor • United States

Remote
USD 41,000 - 83,000
QA Engineer | Remote - Contract
QA Engineer | Remote - Contract

Xperteez Technology • United States

Remote
USD 34,000 - 69,000
QA Test Engineer- Remote
QA Test Engineer- Remote

YO AI Labs • New York (NY)

Remote
USD 34,000 - 69,000
QA Engineer - Browser Test Specialist
QA Engineer - Browser Test Specialist

mercor • United States

Remote
USD 41,000 - 83,000
Software Test Engineer - Remote
Software Test Engineer - Remote

YO AI Labs • New York (NY)

Remote
USD 41,000 - 83,000
Remote AI QA Tester
Remote AI QA Tester

Naukri Mitra • United States

Remote
USD 87,000 - 106,000
QA Test Engineer- Remote
QA Test Engineer- Remote

YO AI Labs • United States

Remote
USD 55,000 - 96,000