Remote DevOps & Cloud AI Reviewer

AI Trainer Jobs; United States; Remote; USD 55,000 - 110,000; Full time

Job summary

AI Trainer Jobs is seeking a remote DevOps and Cloud Infrastructure AI Expert contractor to evaluate production code, debug traces, and AI outputs against correctness standards. You will reproduce failures, write unit tests, and explain fixes to guide model improvements.

Responsibilities include running candidate code in a sandbox, grading solutions for correctness and edge cases, and writing minimal failing tests with clear rationale for senior engineers.

Qualifications

• Strong day-job engineering experience and ability to read, run, and debug unfamiliar code.
• Comfort writing concise unit tests that capture a single failure mode.
• Familiarity with a testing framework (pytest, Jest, JUnit, Go test, RSpec, etc.).
• Clear written reasoning to convince another senior engineer.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Run and reproduce candidate code outputs in a sandboxed environment.
• Grade cloud and platform engineering solutions for correctness, style, and edge-case handling.
• Write the smallest failing tests demonstrating a bug missed by a model output.
• Compare paired solutions and rank them with a written rubric-based rationale.

Skills

Code review

Debugging

Unit testing

Software engineering judgment

Cloud & platform engineering

AI evaluation

Rubric writing

Expert review

Tools

pytest

Jest

JUnit

Go test

RSpec

Job description

AI Trainer Jobs is seeking a remote DevOps and Cloud Infrastructure AI Expert contractor to evaluate production code, debug traces, and AI outputs against correctness standards. You will reproduce failures, write unit tests, and explain fixes to guide model improvements.

Responsibilities include running candidate code in a sandbox, grading solutions for correctness and edge cases, and writing minimal failing tests with clear rationale for senior engineers.