Remote QA/Test Engineer for AI & Benchmark Quality

mercor; United States; Teletrabalho; USD 83 000 - 124 000; Tempo parcial

Resumo da oferta

Mercor is seeking a QA/Test Engineer for a remote, contract role. You will design test cases, review tasks, and debug with Python to ensure robust AI-related workflows. The role emphasizes quality assurance, thorough documentation, and collaboration with researchers to protect benchmark scores and identify gaps in AI runs.

MSc/PhD or equivalent experience preferred, 1+ year in test engineering. Proficiency in Python and Git is required, and a perfectionist mindset with attention to detail is

Qualificações

• MSc or PhD in a STEM field or equivalent practical experience.
• 1+ years in test engineering, quality assurance, or a research/software engineering role.
• Skill in designing test cases, quality-review processes, and debugging complex systems.
• Proficiency in Python and Git.
• Exceptional attention to detail and clear documentation habits.

Responsabilidades

• Design test cases to confirm each task works as intended, including tricky edge cases.
• Review tasks and reference solutions to catch ambiguity and gaps early.
• Debug using Python when tasks or checks don't behave as expected.
• Shape quality checklists and provide actionable feedback to authors.
• Protect benchmark scores by identifying shortcuts and grading gaps in AI agent runs.

Conhecimentos

Test design

Quality assurance

Debugging

Python

Formação académica

MSc/PhD in STEM or equivalent

Ferramentas

Git

Descrição da oferta de emprego

Mercor is seeking a QA/Test Engineer for a remote, contract role. You will design test cases, review tasks, and debug with Python to ensure robust AI-related workflows. The role emphasizes quality assurance, thorough documentation, and collaboration with researchers to protect benchmark scores and identify gaps in AI runs.

MSc/PhD or equivalent experience preferred, 1+ year in test engineering. Proficiency in Python and Git is required, and a perfectionist mindset with attention to detail is