Remote Systems Engineer — Coding Agent Review & QA

AI Trainer Jobs; United States; Remote; USD 99,000 - 135,000; Full time

Benefits offered by this job

Remote work

Job summary

AI Trainer Jobs is seeking a Systems Engineer (Coding Agent Experience) for a remote, contractor role. You will run and reproduce candidate code outputs, grade solutions for correctness, and write minimal failing tests to demonstrate bugs. You will rank paired solutions with a clear, rubric-based rationale.

The position offers $85 per hour, remote work eligibility in the US, and requires strong testing and debugging skills along with concise, convincing written notes for senior engineers.

Qualifications

• Ability to read, run, and debug unfamiliar code.
• Experience writing concise unit tests that cover a single failure mode.
• Clear, persuasive written review notes for senior engineers.
• Available for at least 10 hours per week.
• Familiarity with evaluating AI outputs and debugging traces.

Responsibilities

• Run and reproduce candidate code outputs in a sandboxed environment.
• Grade engineering review solutions for correctness, style, and edge cases.
• Write minimal failing tests demonstrating bugs in model outputs.
• Compare paired solutions and rank them with a written rubric.

Skills

Unit testing

Code reading

Debugging

Written reasoning

Async availability

Tools

pytest

Jest

JUnit

Go test

RSpec

Job description

AI Trainer Jobs is seeking a Systems Engineer (Coding Agent Experience) for a remote, contractor role. You will run and reproduce candidate code outputs, grade solutions for correctness, and write minimal failing tests to demonstrate bugs. You will rank paired solutions with a clear, rubric-based rationale.

The position offers $85 per hour, remote work eligibility in the US, and requires strong testing and debugging skills along with concise, convincing written notes for senior engineers.