AI Training Data Quality Manager

OpenTrain AI, Inc.; United States; Remote; USD 55,000 - 83,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a senior quality leader to define and drive the quality strategy for AI training data and annotation programs. You will oversee quality systems, collaborate with project leaders, and balance quality, speed, and cost across evaluation tasks.

This project-based contractor role spans 16 weeks, with 20+ hours per week and Pacific Time hours. Open worldwide, strong English required, 8+ years experience including 4+ in leadership.

Qualifications

• At least 8 years of professional experience, including 4+ years leading teams.
• Strong quality management and high-volume operations experience.
• Experience designing and scaling quality systems.
• Experience leading managers or team leads.
• Excellent analytical, communication, and stakeholder-management skills.
• Preferred experience with annotation, data labeling, AI training data, multimodal work, or large language model evaluation.

Responsibilities

• Lead quality strategy for AI training data and annotation programs.
• Oversee quality systems, support consistent delivery, and work with project leaders to balance quality, speed, and cost.
• Define quality standards, metrics, and targets across data types.
• Build and lead Quality Leads and QA teams.
• Design audit, sampling, calibration, and escalation frameworks.
• Lead quality reviews and manage quality-related escalations.
• Identify root causes and improve processes, training, and guidelines.
• Monitor quality reports and drive corrective actions.

Skills

Quality leadership

Team leadership

Analytical skills

Stakeholder management

Communication

Job description

The Work

You will lead quality strategy for AI training data and annotation programs. The work focuses on evaluation tasks where multiple chatbots are compared and given a final assessment.

You will oversee quality systems, support consistent delivery, and work with project leaders to balance quality, speed, and cost.

• Define quality standards, metrics, and targets across data types.
• Build and lead Quality Leads and QA teams.
• Design audit, sampling, calibration, and escalation frameworks.
• Lead quality reviews and manage quality-related escalations.
• Identify root causes and improve processes, training, and guidelines.
• Monitor quality reports and drive corrective actions.

What It Pays and Takes

This is a project-based contractor role involving a defined number of evaluation tasks. The engagement is planned for 16 weeks.

• Schedule: 20 or more hours per week.
• Working pattern: five working days per week, including weekends as required, with two weekdays off.
• Work hours: 7:00 a.m. to 4:00 p.m. Pacific Time.
• Location: Open worldwide.
• Language: Professional fluency in English.
• Experience: At least 8 years of professional experience, including 4 or more years leading teams.
• Strong quality management and high-volume operations experience.
• Experience designing and scaling quality systems.
• Experience leading managers or team leads.
• Excellent analytical, communication, and stakeholder-management skills.
• Preferred experience with annotation, data labeling, AI training data, multimodal work, or large language model evaluation.

How It Works

OpenTrain is a platform where people find AI training and data-labeling roles, build a profile, and start applications.

About AI Training Work

AI training is the human work behind systems that learn from examples, including comparing chatbot answers and rating model outputs. People with experience in quality management and specialized evaluation work help make these systems more accurate and consistent.