Remote ML QA Engineer — Model Evaluation & Debugging

AuraOne Human Data

United States

Remote

USD 124,000 - 193,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AuraOne, Inc. is seeking a Scientific / ML Engineer — AI Research and Model Evaluation for remote work in the US. You will reproduce model outputs, run tests, and grade solutions for correctness, style, and edge cases, documenting failure modes and writing minimal fixtures to illustrate issues.

You will also compare paired solutions, provide ranking rationale, and contribute to error‑pattern catalogs to improve model guidance and evaluation rubrics.

Qualifications

  • Strong day‑job engineering experience with reading, running and debugging unfamiliar code.
  • Comfort writing concise unit tests that capture a single failure mode.
  • Familiarity with a testing framework (pytest, Jest, or JUnit).

Responsibilities

  • Run and reproduce candidate code outputs in a sandboxed environment for assignments.
  • Grade ML engineering solutions for correctness, style, and edge-case handling.
  • Write minimal failing tests that demonstrate bugs the model output missed.
  • Compare paired solutions and rank them with a rubric-based rationale.
  • Tag failure modes with severity scores (compile error, runtime crash, off‑by‑one, security issue).
  • Document recurring code‑generation failures for targeted fixes.
  • Calibrate reviews to maintain high inter‑rater agreement.

Skills

Code review
Debugging
Unit testing
Software engineering judgment
ML engineering

Tools

pytest
Jest
JUnit
Go test
RSpec

Job description

AuraOne, Inc. is seeking a Scientific / ML Engineer — AI Research and Model Evaluation for remote work in the US. You will reproduce model outputs, run tests, and grade solutions for correctness, style, and edge cases, documenting failure modes and writing minimal fixtures to illustrate issues.

You will also compare paired solutions, provide ranking rationale, and contribute to error‑pattern catalogs to improve model guidance and evaluation rubrics.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation Engineer — ML Quality & Testing
Remote AI Evaluation Engineer — ML Quality & Testing

AuraOne Human Data • United States

Remote
USD 55,000 - 96,000
Remote ML Code Reviewer & QA Engineer (Contractor)
Remote ML Code Reviewer & QA Engineer (Contractor)

AuraOne Human Data • United States

Remote
USD 83,000 - 165,000
Remote Mechanical Engineer Reviewer - AI Evaluation
Remote Mechanical Engineer Reviewer - AI Evaluation

AuraOne Human Data • United States

Remote
USD 102,000 - 146,000
Scientific / ML Engineer — AI Research and Model Evaluation
Scientific / ML Engineer — AI Research and Model Evaluation

AuraOne Human Data • United States

Remote
USD 124,000 - 193,000
AI Evaluation Specialist - Remote (Engineering Sciences)
AI Evaluation Specialist - Remote (Engineering Sciences)

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote Software Review Engineer for Model QA & Debugging
Remote Software Review Engineer for Model QA & Debugging

AuraOne Human Data • United States

Remote
USD 165,000 - 248,000
Remote ML Output Quality Reviewer (Junior)
Remote ML Output Quality Reviewer (Junior)

AuraOne Human Data • United States

Remote
USD 55,000 - 110,000
Remote Senior MBSE Engineer, SysML v2 & AI Evaluation
Remote Senior MBSE Engineer, SysML v2 & AI Evaluation

AuraOne Human Data • United States

Remote
USD 69,000 - 124,000
Remote Junior Software Engineer — Code Review & QA
Remote Junior Software Engineer — Code Review & QA

Auraone • United States

Remote
USD 148,000 - 210,000
Remote work
Hourly pay
Remote ML Model Evaluation & Experimentation Reviewer
Remote ML Model Evaluation & Experimentation Reviewer

Auraone • United States

Remote
USD 83,000 - 124,000