Remote Mechanical Engineer Reviewer - AI Evaluation

AuraOne Human Data; United States; Remote; USD 102,000 - 146,000; Full time

Job summary

AuraOne, Inc. is seeking a Mechanical Engineer Reviewer for AI Evaluation. This remote contractor role focuses on reproducing code outputs, evaluating solutions, and writing targeted tests to diagnose model gaps.

You will collaborate with the modeling team to improve evaluation quality and reliability. The ideal candidate can read, run, and debug unfamiliar code, write concise failure-focused tests, and provide clear reasoning to support senior engineers.

Qualifications

• Strong day-job engineering experience with reading, running, and debugging unfamiliar code.
• Comfort writing concise unit tests that capture a single failure mode.
• Familiarity with a testing framework (pytest, Jest, JUnit, Go test, or RSpec).
• Clear written reasoning to convince another senior engineer.
• Reliable async availability for at least 10 hours per week.
• Prior code-review or technical-interview-grading experience is a plus.

Responsibilities

• Run and reproduce candidate code outputs in a sandboxed environment.
• Grade mechanical engineer review solutions for correctness, style, and edge-case handling.
• Write the smallest failing test that demonstrates a model bug.
• Compare paired solutions and rank them with a rubric-based rationale.
• Tag failure modes with severity scores (compile error, runtime crash, edge-case).
• Document recurring code-generation failures for the modeling team.
• Calibrate against gold-standard reviews to keep inter-rater agreement above target.

Skills

Code review

Debugging

Unit testing

Software engineering judgment

Mechanical Engineer engineering review

Tools

pytest

Jest

JUnit

Go test

RSpec

Job description

AuraOne, Inc. is seeking a Mechanical Engineer Reviewer for AI Evaluation. This remote contractor role focuses on reproducing code outputs, evaluating solutions, and writing targeted tests to diagnose model gaps.

You will collaborate with the modeling team to improve evaluation quality and reliability. The ideal candidate can read, run, and debug unfamiliar code, write concise failure-focused tests, and provide clear reasoning to support senior engineers.