Remote Code Reviewer — Workflow Annotator for AI/Code QA

Auraone

United States

Remote

USD 148,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AI Trainer Jobs seeks a Workflow Annotator — Software Engineering for a remote contractor role evaluating production code, debugging traces, and AI outputs for correctness. You will reproduce failures, write the unit test the model should have written, and explain the fix so the modeling team can target the gap.

Engineering model quality depends on code that compiles, passes tests, and handles edge cases. You will pair with experienced engineers and judge generated code and software engineering

Qualifications

  • Strong day-job engineering experience reading, running and debugging unfamiliar code for Workflow Annotator — Software Engineering work.
  • Comfort writing concise unit tests that capture a single failure mode.
  • Familiarity with a testing framework: pytest, Jest, or JUnit.

Responsibilities

  • Run and reproduce candidate code outputs in a sandboxed environment for Workflow Annotator — Software Engineering assignments.
  • Grade workflow annotator software engineering solutions for correctness, style, and edge-case handling.
  • Write minimal failing tests that demonstrate the bug a model output missed.
  • Compare paired solutions and rank them with a written rationale tied to the rubric.

Skills

Code reading
Debugging
Unit testing
Technical reasoning
Async availability
Review experience

Tools

pytest
Jest
JUnit

Job description

AI Trainer Jobs seeks a Workflow Annotator — Software Engineering for a remote contractor role evaluating production code, debugging traces, and AI outputs for correctness. You will reproduce failures, write the unit test the model should have written, and explain the fix so the modeling team can target the gap.

Engineering model quality depends on code that compiles, passes tests, and handles edge cases. You will pair with experienced engineers and judge generated code and software engineering

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Code Review Engineer for AI Outputs & Tests
Remote Code Review Engineer for AI Outputs & Tests

Auraone • United States

Remote
USD 160,000 - 190,000
Remote Code Review Engineer — AI Model QA
Remote Code Review Engineer — AI Model QA

Auraone • United States

Remote
USD 117,000 - 138,000
Remote work
Remote Code Review Engineer for AI Output QA
Remote Code Review Engineer for AI Output QA

Auraone • United States

Remote
USD 94,000 - 127,000
Remote Code Review Engineer - Expert in QA & Debugging
Remote Code Review Engineer - Expert in QA & Debugging

Auraone • United States

Remote
USD 55,000 - 69,000
Remote work
US-eligible contractor
Remote AI Code Review Engineer & Model QA
Remote AI Code Review Engineer & Model QA

Auraone • United States

Remote
USD 165,000 - 207,000
Workflow Annotator — Software Engineering
Workflow Annotator — Software Engineering

Auraone • United States

Remote
USD 148,000 - 210,000
Remote AI/ML Code Reviewer & Debug Specialist
Remote AI/ML Code Reviewer & Debug Specialist

Auraone • United States

Remote
USD 165,000 - 193,000
Remote work
Remote Senior Webflow Code Reviewer & QA Engineer
Remote Senior Webflow Code Reviewer & QA Engineer

Auraone • United States

Remote
USD 148,000 - 210,000
Remote Backend Code Reviewer for AI & Tests
Remote Backend Code Reviewer for AI & Tests

Auraone • United States

Remote
USD 97,000 - 138,000
Remote Agent Engineer: Code Review & Debugging Expert
Remote Agent Engineer: Code Review & Debugging Expert

Auraone • United States

Remote
USD 138,000 - 689,000