Remote Code Review Engineer for AI-Generated Code

AuraOne; United States; On-site; USD 82,656 - 123,984; Full time

Job summary

AuraOne is seeking a Software Developer reviewer to assess production code, reproduce model outputs, and evaluate correctness against defined rubrics. The role emphasizes writing targeted tests and documenting edge cases to guide model improvements.

Remote, US-eligible contractors are encouraged to apply for project-based work and flexible scheduling. Ideal candidates have hands-on software development experience, strong reasoning in reviews, and familiarity with common testing ecosystems.

Qualifications

• Strong day-job engineering experience
• Comfort writing concise unit tests
• Familiarity with at least one testing framework (pytest, Jest, JUnit, Go test, RSpec)
• Clear written reasoning to convince a senior engineer
• Reliable async availability for at least 10 hours per week
• Prior code-review or technical-interview-grading experience is a plus

Responsibilities

• Run and reproduce candidate code outputs in a sandboxed environment for assignments.
• Grade software developer solutions for correctness, complexity, idiomatic style, and edge-case handling.
• Write minimal failing tests demonstrating bugs.
• Compare paired solutions and rank with a written rationale tied to the rubric.
• Tag failure modes with severity scores.
• Document recurring code-generation failures for the modeling team.
• Calibrate against gold-standard reviews to maintain inter-rater agreement.

Skills

Code review

Debugging

Unit testing

Software engineering judgment

Engineering review

API Development

Software Development

Job description

AuraOne is seeking a Software Developer reviewer to assess production code, reproduce model outputs, and evaluate correctness against defined rubrics. The role emphasizes writing targeted tests and documenting edge cases to guide model improvements.

Remote, US-eligible contractors are encouraged to apply for project-based work and flexible scheduling. Ideal candidates have hands-on software development experience, strong reasoning in reviews, and familiarity with common testing ecosystems.