Senior C# Engineer: LLM Evaluation & Code Quality

AuraOne Human Data

United States

Remote

USD 83,000 - 165,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne, Inc. is seeking a Senior C# Engineer for LLM Evaluation and Repository Validation. This remote contractor role focuses on evaluating C# code, debugging traces, and AI outputs against real-world correctness standards.

You will reproduce failures, write minimal failing tests, and explain fixes so the modeling team can target gaps. Strong C# skills and unit-testing discipline are essential.

Qualifications

  • Strong day-job C# experience — read, run, and debug unfamiliar code for Senior C# Engineer - LLM Evaluation and Repository Validation work.
  • Comfort writing concise unit tests that capture a single failure mode.
  • Familiarity with a testing framework such as pytest, Jest, or JUnit.

Responsibilities

  • Run and reproduce C# code outputs in a sandboxed environment for Senior C# Engineer - LLM Evaluation and Repository Validation assignments.
  • Grade senior software engineer C# solutions for correctness, style, and edge-case handling.
  • Write minimal failing tests that demonstrate the bug a model output missed.
  • Compare paired solutions and rank them with a written rationale tied to the rubric.
  • Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.
  • Document recurring code-generation failures so the modeling team can target them.
  • Calibrate against gold-standard reviews to keep inter-rater agreement above target.

Skills

C# programming
Unit testing
Code review
Debugging
Software engineering judgment
Senior engineer

Tools

Testing frameworks (pytest, Jest, JUnit)

Job description

AuraOne, Inc. is seeking a Senior C# Engineer for LLM Evaluation and Repository Validation. This remote contractor role focuses on evaluating C# code, debugging traces, and AI outputs against real-world correctness standards.

You will reproduce failures, write minimal failing tests, and explain fixes so the modeling team can target gaps. Strong C# skills and unit-testing discipline are essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior LLM Evaluation & Code-Review Engineer
Remote Senior LLM Evaluation & Code-Review Engineer

AuraOne Human Data • United States

Remote
USD 83,000 - 138,000
Senior Software Engineer, LLM Evaluation (Remote)
Senior Software Engineer, LLM Evaluation (Remote)

AuraOne, Inc. • United States

Remote
USD 83,000 - 165,000
Senior Software Engineer, LLM Evaluation & Review (Remote)
Senior Software Engineer, LLM Evaluation & Review (Remote)

AuraOne Human Data • United States

Remote
USD 69,000 - 124,000
Remote work
Contractor engagement
US-eligible
Senior LLM Engineer - AI Evaluation (Remote)
Senior LLM Engineer - AI Evaluation (Remote)

AuraOne Human Data • United States

Remote
USD 83,000 - 165,000
Senior Ruby LLM Evaluation & Code-Review Specialist
Senior Ruby LLM Evaluation & Code-Review Specialist

AuraOne Human Data • United States

Remote
USD 110,000 - 165,000
Senior C# Engineer - LLM Evaluation and Repository Validation
Senior C# Engineer - LLM Evaluation and Repository Validation

AuraOne Human Data • United States

Remote
USD 83,000 - 165,000
Remote C/C++ Code Review Engineer for LLM Evaluation
Remote C/C++ Code Review Engineer for LLM Evaluation

AuraOne Human Data • United States

Remote
USD 55,000 - 96,000
Remote Python LLM QA Engineer & Code Validator
Remote Python LLM QA Engineer & Code Validator

AuraOne, Inc. • United States

Remote
USD 83,000 - 138,000
Remote Senior Go Engineer: LLM Code Evaluation & Validation
Remote Senior Go Engineer: LLM Code Evaluation & Validation

AuraOne Human Data • United States

Remote
USD 96,000 - 165,000
Senior LLM Engineer - AI Evaluation
Senior LLM Engineer - AI Evaluation

AuraOne Human Data • United States

Remote
USD 83,000 - 165,000