Remote Code Reviewer — Workflow Annotator for AI/Code QA

AI Trainer Jobs; United States; Remote; USD 148,000 - 210,000; Full time

Job summary

AI Trainer Jobs seeks a Workflow Annotator — Software Engineering for a remote contractor role evaluating production code, debugging traces, and AI outputs for correctness. You will reproduce failures, write the unit test the model should have written, and explain the fix so the modeling team can target the gap.

Engineering model quality depends on code that compiles, passes tests, and handles edge cases. You will pair with experienced engineers and judge generated code and software engineering

Qualifications

• Strong day-job engineering experience reading, running and debugging unfamiliar code for Workflow Annotator — Software Engineering work.
• Comfort writing concise unit tests that capture a single failure mode.
• Familiarity with a testing framework: pytest, Jest, or JUnit.

Responsibilities

• Run and reproduce candidate code outputs in a sandboxed environment for Workflow Annotator — Software Engineering assignments.
• Grade workflow annotator software engineering solutions for correctness, style, and edge-case handling.
• Write minimal failing tests that demonstrate the bug a model output missed.
• Compare paired solutions and rank them with a written rationale tied to the rubric.

Skills

Code reading

Debugging

Unit testing

Technical reasoning

Async availability

Review experience

Tools

pytest

Jest

JUnit

Job description

AI Trainer Jobs seeks a Workflow Annotator — Software Engineering for a remote contractor role evaluating production code, debugging traces, and AI outputs for correctness. You will reproduce failures, write the unit test the model should have written, and explain the fix so the modeling team can target the gap.

Engineering model quality depends on code that compiles, passes tests, and handles edge cases. You will pair with experienced engineers and judge generated code and software engineering