Head of AI Data Quality & Audits - Remote

Executive Staff Recruiters / ESR Healthcare; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Executive Staff Recruiters / ESR Healthcare is seeking a Quality Manager to lead the quality strategy for large-scale AI training data and annotation programs. You will define standards, build QA teams, and oversee audits to ensure accurate, timely delivery in a fast-paced environment.

The role requires defining metrics, developing calibration frameworks, and guiding client quality reviews while balancing quality with speed and cost, with experience in leading managers and high-volume operations.

Qualifications

• 8+ years of experience in quality leadership and high-volume operations.
• Excellent analytical, communication, and stakeholder-management skills.
• Experience leading managers or team leads.
• Experience in annotation, data labeling, AI training data, multimodal, or LLM evaluation projects preferred.

Responsibilities

• Define quality standards, metrics, and targets across data types.
• Build and lead Quality Leads and QA teams.
• Develop audit, sampling, calibration, and escalation frameworks.
• Lead client quality reviews and manage quality-related escalations.
• Partner with Project Leads to balance quality, speed, and cost.
• Identify root causes and implement lasting improvements in processes, training, and guidelines.

Skills

Quality management

Leadership

Analytics

Stakeholder management

Communication

Job description

Executive Staff Recruiters / ESR Healthcare is seeking a Quality Manager to lead the quality strategy for large-scale AI training data and annotation programs. You will define standards, build QA teams, and oversee audits to ensure accurate, timely delivery in a fast-paced environment.

The role requires defining metrics, developing calibration frameworks, and guiding client quality reviews while balancing quality with speed and cost, with experience in leading managers and high-volume operations.