Remote C# Code Evaluation Engineer (Bench)

AuraOne Human Data

United States

Remote

USD 69,000 - 96,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne, Inc. is seeking a SWE Bench Engineer for C# code evaluation.

This remote contractor role partners with the modeling team to reproduce failures, write minimal failing tests, and explain fixes so the modeling team can target gaps. You will grade outputs for correctness, style, and edge cases; tag failure modes by severity; document recurring code-generation failures; and calibrate against gold-standard reviews to keep inter-rater agreement high.

Qualifications

  • Strong day-job C# experience — you can read, run, and debug unfamiliar code for SWE Bench Engineer - C# Code Evaluation work.
  • Comfort writing concise unit tests that capture a single failure mode.
  • Familiarity with a testing framework (pytest, Jest, JUnit, Go test, RSpec, or equivalent).
  • Clear written reasoning — your review note has to convince another senior engineer.
  • Reliable async availability for at least 10 hours per week.
  • Prior code-review or technical-interview-grading experience is a plus.

Responsibilities

  • Run and reproduce C# code outputs in a sandboxed environment for SWE Bench Engineer - C# Code Evaluation assignments.
  • Grade SWE bench engineer C# engineering review solutions for correctness, style, and edge-case handling.
  • Write minimal failing tests that demonstrate the bug a model output missed.
  • Compare paired solutions and rank them with a written rationale tied to the rubric.
  • Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.
  • Document recurring code-generation failures so the modeling team can target them.
  • Calibrate against gold-standard reviews to keep inter-rater agreement above target.

Job description

AuraOne, Inc. is seeking a SWE Bench Engineer for C# code evaluation.

This remote contractor role partners with the modeling team to reproduce failures, write minimal failing tests, and explain fixes so the modeling team can target gaps. You will grade outputs for correctness, style, and edge cases; tag failure modes by severity; document recurring code-generation failures; and calibrate against gold-standard reviews to keep inter-rater agreement high.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Java Code Review Engineer SWE Bench
Remote Java Code Review Engineer SWE Bench

AuraOne Human Data • United States

Remote
USD 83,000 - 165,000
Remote C++ Code Reviewer & Unit Test Engineer
Remote C++ Code Reviewer & Unit Test Engineer

AuraOne Human Data • United States

Remote
USD 55,000 - 110,000
SWE Bench Engineer - C# Code Evaluation
SWE Bench Engineer - C# Code Evaluation

AuraOne Human Data • United States

Remote
USD 69,000 - 96,000
Remote SRE Code-Review Engineer (Contractor)
Remote SRE Code-Review Engineer (Contractor)

AuraOne, Inc. • United States

Remote
USD 227,000 - 324,000
Remote AI Code Evaluation & Benchmark Engineer
Remote AI Code Evaluation & Benchmark Engineer

AuraOne Human Data • United States

Remote
USD 48,000 - 96,000
Remote SRE & Code-Review Quality Engineer
Remote SRE & Code-Review Quality Engineer

Auraone • United States

Remote
USD 227,000 - 324,000
Go Bench Engineer — Remote Code Review & Testing
Go Bench Engineer — Remote Code Review & Testing

AuraOne Human Data • United States

Remote
USD 83,000 - 165,000
Senior Data Scientist-Remote Engineering Review Contractor
Senior Data Scientist-Remote Engineering Review Contractor

AuraOne Human Data • United States

Remote
USD 165,000 - 248,000
Remote Electrical Engineer Reviewer — AI Code Evaluation
Remote Electrical Engineer Reviewer — AI Code Evaluation

AuraOne Human Data • United States

Remote
USD 106,000 - 143,000
Remote Software Review Engineer (Contractor)
Remote Software Review Engineer (Contractor)

AuraOne Human Data • United States

Remote
USD 83,000 - 138,000