AI Training Data Program Lead · Mercor Mercor · $45-70/hr · remote in US · 3d ago $45-70/hr remote in US 3d ago

Benture; United States; Remote; USD 62,000 - 96,000; Full time

Job summary

Cincinnatus LLC is seeking a Program Lead to manage a large pool of domain experts building AI training data for a leading AI lab's GenAI team. This remote US role involves running human data and model evaluation programs, translating research inputs into guidelines, and raising training data quality and throughput for foundational models.

You will lead onboarding, calls, weekly reviews, and ensure deadlines and quality standards are met, while turning inputs into actionable guidelines and

Qualifications

• Lead and coordinate a large pool of domain experts, onboarding, running calls and weekly reviews, and keeping work on track against deadlines and quality bars.
• Turn research and leadership inputs into clear, actionable guidelines and task instructions.
• Track deliverables, throughput and quality metrics in Sheets or Excel, and report program status to stakeholders.
• Evaluate expert submissions, identify root causes of quality issues, and give clear written feedback that raises the bar across the team.
• Flag risks and blockers early, propose fixes, and drive them to resolution with research, product and operations partners.

Responsibilities

• Lead and coordinate a large pool of domain experts, onboarding, running calls and weekly reviews, and keeping work on track against deadlines and quality bars.
• Turn research and leadership inputs into clear, actionable guidelines and task instructions.
• Track deliverables, throughput and quality metrics in Sheets or Excel, and report program status to stakeholders.
• Evaluate expert submissions, identify root causes of quality issues, and give clear written feedback that raises the bar across the team.
• Flag risks and blockers early, propose fixes, and drive them to resolution with research, product and operations partners.

Skills

Team leadership

Project coordination

Strong written communication

Remote collaboration

Education

STEM degree

Tools

Sheets/Excel

SQL

coding basics

Job description

Program Lead | $45-70/hr | Remote (US) | Full-time W-2

Lead a team of domain experts building AI training data for a leading AI lab's GenAI team. You'll run human data and model evaluation programs day to day, translate research inputs into clear guidelines, and raise the quality and throughput of training data used to build foundational AI models.

What the work involves

• Lead and coordinate a large pool of domain experts, including onboarding, running calls and weekly reviews, and keeping work on track against deadlines and quality bars
• Turn research and leadership inputs into clear, actionable guidelines and task instructions
• Track deliverables, throughput and quality metrics in Sheets or Excel, and report program status to stakeholders
• Evaluate expert submissions, identify root causes of quality issues, and give clear written feedback that raises the bar across the team
• Flag risks and blockers early, propose fixes, and drive them to resolution with research, product and operations partners

Who it's for

• Experience as an Expert Program Manager, program lead or team lead on AI training data, human data or model evaluation projects (e.g., at Mercor, Scale AI, Surge, Micro1, Turing, Outlier, Appen, TELUS, or an internal AI data operations team)
• 3+ years leading or coordinating large contributor or expert teams against deadlines and quality bars
• Demonstrable career progression, e.g., Expert Contributor to Reviewer to Team Lead to Program Lead
• Strong written communication skills and the ability to explain complex guidelines and quality decisions clearly
• Ability to engage reliably for at least 40 hours per week on weekdays

Preferred

• Prior experience on Mercor projects
• A degree in a STEM field
• Advanced spreadsheet skills (Sheets or Excel), working knowledge of SQL, and some coding experience
• People leadership experience managing large groups of contributors or experts

Pay, schedule and employment

This is a full-time W-2 position with Cincinnatus LLC (40 hours per week), with the opportunity to be placed at a leading AI lab as part of their extended workforce. Pay is $45-70 per hour. Applicants must be based in the United States.