Remote AI Coding Evaluations Project Lead & QA Reviewer

AuraOne Human Data

United States

Remote

USD 28,000 - 55,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AuraOne, Inc. is seeking an AI Coding & Evaluations Project Lead — Remote Software Review Specialist to professionally review AI outputs and ensure alignment with policy and workflow requirements.

The role supports strategic project leadership and operational QA across remote assignments, emphasizing accurate governance and escalation discipline. Responsibilities include grading tone, stakeholder fit, flagging risks, and documenting next steps to train the model team.

Qualifications

  • Experience in strategic project lead AI coding evaluations and operations on real teams.
  • Ability to apply multi-page rubrics consistently across large batches.
  • Clear written reasoning naming policy or workflow applied.
  • Strong attention to detail and ability to flag prompt issues.
  • Reliable async availability for at least 10 hours per week.

Responsibilities

  • Review AI outputs against workflows, playbooks, and policy for AI Coding & Evaluations tasks.
  • Grade tone, escalation logic, and stakeholder fit on a structured rubric.
  • Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
  • Capture the right next step so the modeling team can train on it.
  • Adjudicate disputes against published playbooks or firm guidance.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Skills

Operational review
Policy adherence
Workflow judgment
Stakeholder communication
AI model evaluation
Strategic AI Evaluations

Job description

AuraOne, Inc. is seeking an AI Coding & Evaluations Project Lead — Remote Software Review Specialist to professionally review AI outputs and ensure alignment with policy and workflow requirements.

The role supports strategic project leadership and operational QA across remote assignments, emphasizing accurate governance and escalation discipline. Responsibilities include grading tone, stakeholder fit, flagging risks, and documenting next steps to train the model team.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Coding Evaluations Lead
Remote AI Coding Evaluations Lead

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote AI Review Lead - Operations & Policy QA
Remote AI Review Lead - Operations & Policy QA

AuraOne, Inc. • United States

Remote
USD 62,000 - 96,000
Remote AI Training & Development QA Reviewer
Remote AI Training & Development QA Reviewer

Auraone • United States

Remote
USD 99,000 - 135,000
Remote AI Executive Communications QA Reviewer
Remote AI Executive Communications QA Reviewer

Auraone • United States

Remote
USD 96,000 - 103,000
Remote AI QA Specialist: Coding Agent Evaluations
Remote AI QA Specialist: Coding Agent Evaluations

AuraOne Human Data • United States

Remote
USD 55,000 - 96,000
Prior experience training
AI workflow tooling familiarity
Bilingual experience for cross-region
Remote AI Evaluation Lead, Data Operations
Remote AI Evaluation Lead, Data Operations

AuraOne Human Data • United States

Remote
USD 34,000 - 83,000
Remote AI Output Reviewer — Coding Author Operations
Remote AI Output Reviewer — Coding Author Operations

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote AI Code Evaluation Expert
Remote AI Code Evaluation Expert

AuraOne Human Data • United States

Remote
USD 55,000 - 110,000
Remote Strategic AI QA Lead - Public-Sector Programs
Remote Strategic AI QA Lead - Public-Sector Programs

AuraOne Human Data • United States

Remote
USD 34,000 - 83,000
Remote Engineering AI QA & Policy Reviewer
Remote Engineering AI QA & Policy Reviewer

AuraOne Human Data • United States

Remote
USD 83,000 - 124,000