Data Acquisition & Operations Lead for AI Models

Reflection AI Ltd; New York (NY); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Top-tier comp

Stock options

Health & wellness

Meals provided

Parental leave

Unlimited PTO

Visa sponsorship

Team events

Job summary

Reflection AI Ltd is seeking a Human Data Operations Manager to own end-to-end data acquisition pipelines that feed world-class AI models. You will partner with researchers, design tasks, manage vendors, and build quality data programs to improve model usefulness and performance.

The role blends program ownership with hands-on work on data collection workflows, quality frameworks, and success metrics. You will drive improvements while maintaining rigorous governance and speed.

Qualifications

• 4+ years of experience delivering a portfolio of complex programs and prioritizing across changing research needs.
• Understanding of LLM training, evaluation, and prompt design, with ability to learn unfamiliar research concepts quickly.
• Proficiency in SQL for querying datasets and building dashboards, and Python for data analysis, API integrations, and workflow automation.

Responsibilities

• Collaborate with research: Translate critical model capabilities and plans into executable data acquisition strategies.
• Orchestrate providers: Assess vendors, forecast capacity, define task instructions, acceptance criteria, and ensure quality, delivery, and cost.
• Track and optimize campaigns: Build dashboards tracking throughput, turnaround time, acceptance rates, rework, and cost per accepted task.
• Ensure alignment: Surface vulnerabilities early and turn feedback into concrete changes to subsequent sourcing; close the loop with research.

Skills

Program management

LLM training knowledge

SQL

Python

Stakeholder management

Job description

Reflection AI Ltd is seeking a Human Data Operations Manager to own end-to-end data acquisition pipelines that feed world-class AI models. You will partner with researchers, design tasks, manage vendors, and build quality data programs to improve model usefulness and performance.

The role blends program ownership with hands-on work on data collection workflows, quality frameworks, and success metrics. You will drive improvements while maintaining rigorous governance and speed.