ML QA Engineer – Code & Model Review (Remote)

AuraOne; United States; On-site; USD 55,000 - 110,000; Full time

Job summary

AuraOne is seeking a remote ML Engineer reviewer to evaluate production code, reproduce outputs, and write minimal failing tests. You will grade engineering solutions for correctness and edge cases, and document failures to guide model improvements.

The role emphasizes concise reasoning in reviews, familiarity with testing frameworks, and reliable weekly availability as a contractor. Applicants must be authorized to work from the United States.

Qualifications

• Ability to read, run, and debug unfamiliar code for ML Engineer tasks.
• Experience writing concise unit tests that capture a single failure mode.
• Familiarity with testing frameworks (pytest, Jest, JUnit, etc.).
• Clear, persuasive written reasoning in review notes.
• Reliable async availability for at least 10 hours per week.
• Prior code-review or technical-interview grading experience is a plus.

Responsibilities

• Run and reproduce candidate code outputs in a sandboxed environment for ML Engineer assignments.
• Grade ml engineering solutions for correctness, style, and edge-case handling.
• Write the smallest failing test demonstrating a model's bug.
• Compare paired solutions and rank them with written rationale tied to the rubric.
• Tag failure modes (compile error, runtime crash, off‑by‑one, security issue) with severity scores.
• Document recurring code‑generation failures so the modeling team can target them.
• Calibrate against gold‑standard reviews to keep inter‑rater agreement above target.

Skills

Code review

Debugging

Unit testing

Software engineering judgment

ML engineering

AI model evaluation

Job description

AuraOne is seeking a remote ML Engineer reviewer to evaluate production code, reproduce outputs, and write minimal failing tests. You will grade engineering solutions for correctness and edge cases, and document failures to guide model improvements.

The role emphasizes concise reasoning in reviews, familiarity with testing frameworks, and reliable weekly availability as a contractor. Applicants must be authorized to work from the United States.