Quality Control Lead - AI

Oxbow Talent; San Francisco (CA); On-site; USD 160,000 - 270,000; Full time

Benefits offered by this job

Equity

Job summary

Oxbow Talent seeks a Quality Control Lead for AI training data in San Francisco. You will own the QC process for complex datasets used to train frontier AI models, building the function from the ground up and partnering with the Head of Operations.

You will design QC frameworks, set KPIs, and implement automated tools in collaboration with data ops and infrastructure teams. Significant ownership and rapid growth await.

Qualifications

• 2-10 years of experience across software engineering, data science, machine learning or technical data operations.
• Significant hands-on experience owning or leading quality assurance or quality control within a technical or data-driven environment.
• Strong ability to review, debug and evaluate technical datasets, code or complex structured information.
• Experience developing quality processes, identifying systemic issues and implementing improvements.
• Comfortable operating independently in a fast-paced environment with significant ownership and responsibility.

Responsibilities

• Own the final quality checkpoint for AI training datasets including code, reasoning data and reinforcement learning trajectories.
• Design and implement QC frameworks, audit processes, grading rubrics and evaluation criteria.
• Build the quality control function from scratch, establishing scalable processes and best practices.
• Identify recurring data quality issues and work with technical teams to resolve root causes.
• Collaborate with infrastructure engineers to develop automated QC tools and workflows using Python and modern AI development tools.
• Define and monitor quality KPIs including error rates, accuracy metrics and continuous improvement.
• Work closely with internal data operations and delivery teams to maintain exceptional quality standards.

Skills

Quality assurance

Python

Data analysis

Code review

Quality processes

Tools

AI development tools

Job description

Quality Control Lead | AI Training Data | San Francisco | $160K-$270K + Equity

The Opportunity

We're partnering with one of the fastest-growing companies in the AI infrastructure space to recruit a Quality Control Lead who will take ownership of quality assurance across highly complex datasets used to train frontier AI models.

Backed by leading investors and experiencing exceptional growth, this business works directly with some of the world's most advanced AI research organisations, developing the technical datasets that power next-generation large language models and autonomous AI agents.

This is a rare opportunity to become the company's first dedicated quality control hire, reporting directly to the Head of Operations and building the entire QC function from the ground up.

The Role

You'll be responsible for ensuring that complex technical datasets meet the highest standards of accuracy, consistency and reliability before delivery to leading AI research labs.

Key responsibilities include:

• Own the final quality checkpoint for AI training datasets including code, reasoning data and reinforcement learning trajectories.
• Design and implement QC frameworks, audit processes, grading rubrics and evaluation criteria.
• Build the quality control function from scratch, establishing scalable processes and best practices.
• Identify recurring data quality issues and work with technical teams to resolve root causes.
• Collaborate with infrastructure engineers to develop automated QC tools and workflows using Python and modern AI development tools.
• Define and monitor quality KPIs including error rates, accuracy metrics and continuous improvement.
• Work closely with internal data operations and delivery teams to maintain exceptional quality standards.

What We're Looking For

• 2-10 years of experience across software engineering, data science, machine learning or technical data operations.
• Significant hands-on experience owning or leading quality assurance or quality control within a technical or data-driven environment.
• Strong ability to review, debug and evaluate technical datasets, code or complex structured information.
• Experience developing quality processes, identifying systemic issues and implementing improvements.
• Comfortable operating independently in a fast-paced environment with significant ownership and responsibility.

Highly desirable:

• Experience within AI training data, human data, RLHF, data annotation or LLM evaluation.
• Background working at an AI research lab, AI data infrastructure business or high-growth technology startup.
• Experience designing evaluation rubrics, grading frameworks or automated quality-checking tools.
• Strong Python skills and a background in statistics, mathematics or computer science.
• Experience establishing or scaling a technical quality control function.

Why Consider This Opportunity?

• Frontier AI exposure: Work directly on the quality of datasets supporting some of the world's most advanced AI models.
• High ownership: Become the first dedicated QC hire with the autonomy to define how quality is measured and maintained.
• Exceptional growth: Join a rapidly scaling, well-funded AI company operating at the forefront of the industry.
• Technical impact: Build automated quality systems rather than simply managing manual review processes.
• Career progression: Significant opportunity to shape and potentially grow the quality function as the business scales.
• Competitive package: $160K-$270K base salary plus meaningful equity participation.

Location & Working Arrangements

This is a full-time, onsite position based in San Francisco, working five days per week from the company's office.

Relocation and visa sponsorship may be considered for exceptional candidates.