Queue Lead (Fully Remote)

Prolific; United States; Remote; USD 85,000 - 120,000; Full time

Job summary

Prolific is seeking a hands-on Operations professional to own day-to-day execution for AI annotation queues in the United States. You will manage throughput, quality, and contributor performance, ensuring timely delivery and high standards.

Responsibilities include intake, triage, prioritization, and SLA adherence, plus running QA, calibrations, feedback, and dashboards to optimize performance and reliability of the annotation process.

Qualifications

• 3+ years in high-throughput operations with AI data experience.

Responsibilities

• Own day-to-day execution for AI annotation queues.
• Manage throughput, quality, and contributor performance.
• Handle intake, triage, prioritization, and SLA delivery.
• Run QA, calibrations, feedback, and dashboards.

Skills

High-throughput ops

AI data experience

Calibration

Dashboards

Contributor management

Job description

• You'll own day-to-day execution for AI annotation queues.
• You'll manage throughput, quality, and contributor performance.

Key Responsibilities:

• Handle intake, triage, prioritization, and SLA delivery.
• Run QA, calibrations, feedback, and dashboards.

Requirements:

• 3+ years high-throughput ops with AI data experience.
• Experience with calibration, dashboards, and contributor management.

Prolific

Prolific builds the world's largest pool of quality human data, used by over 35,000 AI developers, researchers, and organizations. The company prioritizes ethically sourced feedback and believes diverse human perspectives will drive the next leap in AI innovation.