Remote AI Data Ops Lead

Prolific

United States

Remote

USD 69,000 - 96,000

Part time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Prolific is seeking a Queue Lead to manage AI data program queues, quality, and reporting. This remote freelance role focuses on throughput, calibrations, and contributor performance across projects, with emphasis on live program operations and stakeholder visibility.

You will own end-to-end queue execution, monitor quality metrics, and build dashboards while guiding annotators. Ideal candidates have hands-on experience in fast-paced data ops and AI data programs.

Qualifications

  • Proven, direct experience running queues and quality on AI data programs.
  • 3+ years in high-throughput ops with AI data ops experience.
  • Ability to design calibration processes from scratch.
  • Ability to track dashboards or reporting systems (spreadsheets required).
  • Experience managing contributor performance at scale.

Responsibilities

  • Own work queues: intake, triage, prioritization, task assignment, and SLA delivery.
  • Monitor task queue and backlog control.
  • Identify and troubleshoot bottlenecks.
  • Monitor quality at project and annotator level.
  • Perform QA tasks and provide annotator feedback.
  • Manage annotator performance including retention/removal decisions.
  • Build and maintain dashboards to track throughput and performance.
  • Turn raw queue data into actionable reporting for stakeholders.
  • Provide feedback for process improvements based on data trends.
  • Oversee Slack channels, train new annotators, and conduct webinars.

Skills

Queue management
Data ops
Quality assessment
Calibration
Dashboards & reporting
Contributor performance
Adaptability

Job description

Prolific is seeking a Queue Lead to manage AI data program queues, quality, and reporting. This remote freelance role focuses on throughput, calibrations, and contributor performance across projects, with emphasis on live program operations and stakeholder visibility.

You will own end-to-end queue execution, monitor quality metrics, and build dashboards while guiding annotators. Ideal candidates have hands-on experience in fast-paced data ops and AI data programs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Freelance AI Data Ops Lead
Remote Freelance AI Data Ops Lead

Prolific • United States

Remote
USD 55,000 - 96,000
Remote Data Operations Lead - AI Datasets & QA
Remote Data Operations Lead - AI Datasets & QA

Clera • United States

Remote
USD 62,000 - 124,000
Queue Lead - DP
Queue Lead - DP

Prolific • United States

Remote
USD 69,000 - 96,000
Queue Lead
Queue Lead

Prolific • United States

Remote
USD 55,000 - 96,000
Senior AI Data Operations Lead - Remote
Senior AI Data Operations Lead - Remote

Prolific • United States

Remote
USD 140,000 - 190,000
Remote AI Data QA & Database Admin
Remote AI Data QA & Database Admin

Prolific • United States

Remote
USD 28,000 - 40,000
PayPal account
Remote AI Training Project Lead - Part-Time Contract
Remote AI Training Project Lead - Part-Time Contract

OpenTrain AI, Inc. • United States

Remote
USD 55,000 - 90,000
Remote AI Data Projects Lead (Part-Time, Quality&Delivery)
Remote AI Data Projects Lead (Part-Time, Quality&Delivery)

Vettedlance • United States

Remote
USD 55,000 - 90,000
Quality Manager remote Analyst
Quality Manager remote Analyst

Executive Staff Recruiters / ESR Healthcare • United States

Remote
USD 90,000 - 130,000
Delivery Lead: AI Data Projects (Remote)
Delivery Lead: AI Data Projects (Remote)

Toloka • United States

Remote
USD 140,000 - 190,000
Fully remote schedule