Remote DevOps Code Reviewer & Testing Architect

AI Trainer Jobs; United States; Remote; USD 165,000 - 193,000; Full time

Benefits offered by this job

Remote work

Independent contractor

Job summary

AI Trainer Jobs is seeking a DevOps Expert for a remote engineering review track. You will evaluate production code, debugging traces, and AI outputs against real-world correctness standards, reproduce failures, and write focused tests to guide improvements.

Responsibilities include running candidate code in a sandbox, grading solutions for correctness and edge cases, and drafting concise rationales. This is a remote, contractor role with compensation discussed after interview.

Qualifications

• Strong day-job engineering experience; read, run, and debug unfamiliar code for DevOps Expert work.
• Clear, concise unit tests that capture a single failure mode.
• Familiarity with a testing framework (pytest, Jest, JUnit) and related tooling.

Responsibilities

• Run and reproduce candidate code outputs in a sandboxed environment for DevOps Expert assignments.
• Grade cloud & platform engineering solutions for correctness, style, and edge-case handling.
• Write minimal failing tests that demonstrate the bug a model output missed.
• Compare paired solutions and rank them with a written rationale tied to the rubric.
• Tag failure modes with severity scores and document the patch the model should produce.

Skills

Code review

Unit testing

Reading unfamiliar code

Testing frameworks

Written communication

Remote collaboration

Tools

pytest

Jest

JUnit

Job description

AI Trainer Jobs is seeking a DevOps Expert for a remote engineering review track. You will evaluate production code, debugging traces, and AI outputs against real-world correctness standards, reproduce failures, and write focused tests to guide improvements.

Responsibilities include running candidate code in a sandbox, grading solutions for correctness and edge cases, and drafting concise rationales. This is a remote, contractor role with compensation discussed after interview.