Remote Senior Software Engineer (AI Coding Evaluator)

AuraOne; United States; On-site; USD 83,000 - 165,000; Full time

Benefits offered by this job

Remote work

Contractor

US-eligible

Job summary

AuraOne is seeking a Senior Software Engineer — AI Coding Evaluator for a remote engineering review track. You will evaluate production code, debugging traces, and AI outputs against real-world correctness standards; reproduce failures, and write the unit tests the model should have written.

You will grade solutions for correctness, complexity, idiomatic style, and edge-case handling; write minimal failing tests, document failure modes, and rank results with a clear rationale.

Qualifications

• Strong day-job engineering experience and ability to read, run, and debug unfamiliar code.
• Clear written reasoning in review notes for senior engineers.
• Experience with at least one testing framework (pytest/Jest/JUnit/Go test/RSpec).

Responsibilities

• Run and reproduce candidate code outputs in a sandboxed environment for assignments.
• Grade senior software engineer AI coding solutions for correctness, complexity, and edge cases.
• Write minimal failing tests that demonstrate a bug a model output missed.
• Compare paired solutions and write a rationale tied to the rubric.
• Tag failure modes with severity scores and document recurring issues.

Skills

Code review

Debugging

Unit testing

Engineering judgment

Senior AI coding evaluation

Tools

pytest

Jest

JUnit

Go test

RSpec

Job description

AuraOne is seeking a Senior Software Engineer — AI Coding Evaluator for a remote engineering review track. You will evaluate production code, debugging traces, and AI outputs against real-world correctness standards; reproduce failures, and write the unit tests the model should have written.

You will grade solutions for correctness, complexity, idiomatic style, and edge-case handling; write minimal failing tests, document failure modes, and rank results with a clear rationale.