Senior AI Coding Evaluator - Remote Code Review Pro

AI Trainer Jobs; United States; Remote; USD 83,000 - 124,000; Part time

Job summary

AuraOne seeks a Senior Software Engineer - AI Coding Evaluator to join a remote, contractor-based track evaluating production code and model outputs against real-world standards. You will reproduce failures, write tests, and articulate fixes to guide model improvements.

The role emphasizes ability to read and run unfamiliar code, write concise tests, and provide clear rationale for grading decisions. Flexible remote engagement with hourly compensation after interview.

Qualifications

• Strong day-job engineering experience read/run/debug unfamiliar code for Senior Software Engineer - AI Coding Evaluator work.
• Comfort writing concise unit tests that capture a single failure mode.
• Familiarity with a testing framework: pytest, Jest, or JUnit.
• Clear written reasoning—review notes to convince another senior engineer.
• Reliable async availability for at least 10 hours per week.
• Prior code-review or technical-interview-grading experience is a plus.

Responsibilities

• Run and reproduce candidate code outputs in a sandboxed environment for assignments.
• Grade AI coding solutions for correctness, style, and edge-case handling.
• Write the smallest failing test that demonstrates a bug.
• Compare paired solutions and rank them with a rubric-based rationale.

Skills

Code reading

Unit testing

Debugging

Test frameworks

Written reasoning

Async availability

Security awareness

Tools

pytest

Jest

JUnit

Job description

AuraOne seeks a Senior Software Engineer - AI Coding Evaluator to join a remote, contractor-based track evaluating production code and model outputs against real-world standards. You will reproduce failures, write tests, and articulate fixes to guide model improvements.

The role emphasizes ability to read and run unfamiliar code, write concise tests, and provide clear rationale for grading decisions. Flexible remote engagement with hourly compensation after interview.