Remote ML Model Evaluation & Experimentation Reviewer

Auraone

United States

Remote

USD 83,000 - 124,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AI Trainer Jobs is seeking a Machine Learning Engineer — Model Evaluation & Experimentation contractor to join our remote review team. You will evaluate AI outputs, grade workflow correctness, and ensure policy adherence across reviewer tasks, helping the modeling team improve training data.

In this role, you will apply structured rubrics, document actionable next steps, and communicate findings to stakeholders. Expect 10+ hours per week with flexible scheduling and US-eligible remote work.

Qualifications

  • Direct experience evaluating ML outputs on real teams.
  • Ability to apply multi-page rubrics consistently.
  • Clear written reasoning naming the policy or workflow applied.
  • Reliable async availability for at least 10 hours per week.

Responsibilities

  • Review AI outputs against current workflows, playbooks, and policy.
  • Grade tone, escalation logic, and stakeholder fit on a rubric.
  • Flag operational risk, policy-adherence gaps with severity tags.
  • Capture the right next step so the modeling team can train on it.

Skills

Operational review
Policy adherence
Workflow judgment
Stakeholder communication
Machine learning evaluation

Tools

AI tooling

Job description

AI Trainer Jobs is seeking a Machine Learning Engineer — Model Evaluation & Experimentation contractor to join our remote review team. You will evaluate AI outputs, grade workflow correctness, and ensure policy adherence across reviewer tasks, helping the modeling team improve training data.

In this role, you will apply structured rubrics, document actionable next steps, and communicate findings to stakeholders. Expect 10+ hours per week with flexible scheduling and US-eligible remote work.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Training Engineer – ML Model Evaluation
Remote AI Training Engineer – ML Model Evaluation

Xperteez Technology • United States

Remote
USD 83,000 - 165,000
Senior ML Engineer Expert - Remote QA & Policy Reviewer
Senior ML Engineer Expert - Remote QA & Policy Reviewer

Auraone • United States

Remote
USD 105,000 - 143,000
Machine Learning Engineer — Model Evaluation & Experimentation
Machine Learning Engineer — Model Evaluation & Experimentation

Auraone • United States

Remote
USD 83,000 - 124,000
Remote AI Trainer & Evaluator (Contractor, Flexible Hours)
Remote AI Trainer & Evaluator (Contractor, Flexible Hours)

micro1 Inc. • United States

Remote
USD 83,000 - 165,000
Remote AI Engineer — Model QA & RLHF Reviewer
Remote AI Engineer — Model QA & RLHF Reviewer

prolificacademicltd • United States

Remote
USD 55,000 - 110,000
Remote work from home
Flexible hours
Competitive pay up to $80/hr
Remote AI Engineer: RLHF & Model QA Reviewer
Remote AI Engineer: RLHF & Model QA Reviewer

prolificacademicltd • United States

Remote
USD 91,000 - 129,000
Remote work
Competitive hourly rate up to $80
Flexible hours
+1
Senior AI Engineer – RLHF & Model Evaluation (Remote)
Senior AI Engineer – RLHF & Model Evaluation (Remote)

prolificacademicltd • United States

Remote
USD 91,000 - 129,000
Fully remote
Flexible scheduling
Short onboarding
+1
Remote User Research & Feedback Synthesis Evaluator
Remote User Research & Feedback Synthesis Evaluator

Auraone • United States

Remote
USD 110,000 - 165,000
Remote work
Remote AI Output Evaluator & Policy Auditor
Remote AI Output Evaluator & Policy Auditor

Auraone • United States

Remote
USD 90,000 - 117,000
Senior AI Model Auditor & Evaluator (Remote)
Senior AI Model Auditor & Evaluator (Remote)

prolificacademicltd • United States

Remote
USD 91,000 - 129,000
Fully remote
Flexible scheduling
Project-based engagements