Remote ML Model Evaluation & Experimentation Reviewer

AI Trainer Jobs; United States; Remote; USD 83,000 - 124,000; Full time

Job summary

AI Trainer Jobs is seeking a Machine Learning Engineer — Model Evaluation & Experimentation contractor to join our remote review team. You will evaluate AI outputs, grade workflow correctness, and ensure policy adherence across reviewer tasks, helping the modeling team improve training data.

In this role, you will apply structured rubrics, document actionable next steps, and communicate findings to stakeholders. Expect 10+ hours per week with flexible scheduling and US-eligible remote work.

Qualifications

• Direct experience evaluating ML outputs on real teams.
• Ability to apply multi-page rubrics consistently.
• Clear written reasoning naming the policy or workflow applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Review AI outputs against current workflows, playbooks, and policy.
• Grade tone, escalation logic, and stakeholder fit on a rubric.
• Flag operational risk, policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.

Skills

Operational review

Policy adherence

Workflow judgment

Stakeholder communication

Machine learning evaluation

Tools

AI tooling

Job description

AI Trainer Jobs is seeking a Machine Learning Engineer — Model Evaluation & Experimentation contractor to join our remote review team. You will evaluate AI outputs, grade workflow correctness, and ensure policy adherence across reviewer tasks, helping the modeling team improve training data.

In this role, you will apply structured rubrics, document actionable next steps, and communicate findings to stakeholders. Expect 10+ hours per week with flexible scheduling and US-eligible remote work.