Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
AuraOne, Inc. is seeking a SWE Bench Engineer for JAVA to evaluate generated Java code, reproduce outputs in a safe sandbox, and explain fixes so the modeling team can target gaps.
This remote contractor role emphasizes strong Java expertise and the ability to write concise unit tests that illustrate a single failure mode. You will grade solutions for correctness and style, compare paired submissions with rubric-based rationale, and document recurring failures to help improve future model
SWE Bench Engineer - JAVA is a remote engineering review track for evaluating Java code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should have written, and explain the fix so the modeling team can target the gap.
Java model quality lives or dies on whether the generated code actually compiles, passes tests, and handles edge cases. AuraOne pairs experienced engineers with the modeling team to grade outputs the way a code reviewer would.
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Hourly rate confirmed after the interview process.
Strong day-job Java experience — you can read, run, and debug unfamiliar code for SWE Bench Engineer - JAVA work. Comfort writing concise unit tests that capture a single failure mode. Familiarity with a testing framework. pytest, Jest, or JUnit. Go test, RSpec, or whatever you use. Clear written reasoning — your review note has to convince another senior engineer. Reliable async availability for at least 10 hours per week. Prior code-review or technical-interview-grading experience is a plus.