Remote Research Engineer: AI Code Gen & Model Evaluation

AuraOne Human Data

United States

Remote

USD 83,000 - 165,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AuraOne, Inc. is seeking a Research Engineer for Code Generation & Model Evaluation. The role focuses on evaluating production code, debugging traces, and AI outputs against real-world correctness standards.

You will reproduce failures, write unit tests, and explain fixes so the modeling team can target gaps. Ideal candidates have strong code-reading and debugging ability, experience with testing frameworks, and the discipline to document concise review notes for senior engineers.

Qualifications

  • Clear reasoning must be demonstrated in reviews.
  • Ability to read, run, and debug unfamiliar code.
  • Experience with code-generation/model-evaluation tasks is a plus.

Responsibilities

  • Reproduce candidate code outputs in a sandboxed environment.
  • Grade solutions for correctness, style, and edge cases.
  • Write minimal failing tests to show bugs.
  • Compare paired solutions and justify rankings with rubrics.
  • Tag failure modes with severity scores (compile/runtime/edge cases).
  • Document recurring failures for the modeling team.
  • Calibrate reviews to maintain high inter-rater agreement.

Skills

Code review
Debugging
Unit testing
Engineering judgment
AI evaluation
Model evaluation

Tools

pytest
Jest
JUnit
Go test
RSpec

Job description

AuraOne, Inc. is seeking a Research Engineer for Code Generation & Model Evaluation. The role focuses on evaluating production code, debugging traces, and AI outputs against real-world correctness standards.

You will reproduce failures, write unit tests, and explain fixes so the modeling team can target gaps. Ideal candidates have strong code-reading and debugging ability, experience with testing frameworks, and the discipline to document concise review notes for senior engineers.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, AI Evaluation & Coding Agents
Senior Software Engineer, AI Evaluation & Coding Agents

AuraOne Human Data • United States

Remote
USD 138,000 - 207,000
Remote AI Evaluation Engineer — Civil Code Reviewer
Remote AI Evaluation Engineer — Civil Code Reviewer

AuraOne Human Data • United States

Remote
USD 102,000 - 146,000
AI Code Review Engineer — Remote (US-Based)
AI Code Review Engineer — Remote (US-Based)

AuraOne Human Data • United States

Remote
USD 83,000 - 152,000
Remote AI Data Evaluation Engineer – Code Review & Testing
Remote AI Data Evaluation Engineer – Code Review & Testing

AuraOne Human Data • United States

Remote
USD 68,000 - 97,000
Remote Software AI Engineer — Code Review & Debugging
Remote Software AI Engineer — Code Review & Debugging

Auraone • United States

Remote
USD 148,000 - 210,000
Remote AI Code Evaluation & Benchmark Engineer
Remote AI Code Evaluation & Benchmark Engineer

AuraOne Human Data • United States

Remote
USD 48,000 - 96,000
Remote Mechanical Engineer Reviewer - AI Evaluation
Remote Mechanical Engineer Reviewer - AI Evaluation

AuraOne Human Data • United States

Remote
USD 102,000 - 146,000
Remote Electrical Engineer Reviewer — AI Code Evaluation
Remote Electrical Engineer Reviewer — AI Code Evaluation

AuraOne Human Data • United States

Remote
USD 106,000 - 143,000
Research Engineer - Code Generation & Model Evaluation
Research Engineer - Code Generation & Model Evaluation

AuraOne Human Data • United States

Remote
USD 83,000 - 165,000
Remote Code Review Engineer — AI & Production Debugging
Remote Code Review Engineer — AI & Production Debugging

Auraone • United States

Remote
USD 148,000 - 210,000