AI Data Training & Quality Lead

Innodata Inc.; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

Innodata Inc. is seeking a Technical Training & Quality Manager - AI Data to lead training, quality assurance, and continuous improvement across AI data programs.

You will collaborate with AI/ML, Data Science, Operations, Program Management, and Quality teams to ensure teams handling data annotation, labeling, model evaluation, RLHF, and other AI-data workflows have the required capabilities and consistently meet client quality standards.

Qualifications

• 8–12 years of experience in AI/ML, data operations, data annotation, AI training, or related areas.
• Bachelor's or Master's degree in CS/Engineering/Data Science/AI/ML/Statistics or related field.
• Strong understanding of Artificial Intelligence, Machine Learning, Generative AI and LLMs.
• Experience leading training and quality teams in a high-volume delivery environment.
• Ability to translate complex technical concepts into training content.

Responsibilities

• Design and execute technical training programs for AI data teams.
• Develop training curricula, learning paths, assessments, certification programs, and refresher modules.
• Train teams on AI/ML concepts, LLMs, Generative AI, NLP, data annotation, data labeling, model evaluation, prompt engineering, RLHF, and AI response quality.
• Conduct Train-the-Trainer programs and build internal technical trainers.
• Identify skill gaps through assessments, production performance, and quality metrics and create targeted upskilling plans.
• Develop practical exercises, technical assessments, simulations, and certification frameworks.
• Own quality frameworks and standards across AI data projects.
• Define and monitor quality KPIs, accuracy, agreement rates, defect rates, audit scores, rework, and productivity.
• Establish quality calibration processes and conduct regular quality audits.
• Analyze quality trends and identify root causes of recurring defects.
• Partner with Operations and Program Managers to implement corrective and preventive actions.
• Drive continuous improvement initiatives to improve accuracy, consistency, productivity, and turnaround time.
• Provide technical guidance for projects involving data annotation and labeling, LLM evaluation, RLHF, Prompt-response evaluation, NLP and text classification, image/video/audio annotation, Generative AI evaluation, data validation and enrichment, model benchmarking and red teaming.

Skills

AI/ML knowledge

Data operations

Data annotation

Quality management

Training design

CAPA / RCA

Stakeholder management

Process improvement

Trend analysis

Learning & development

Education

Bachelor's or Master's in CS/Engineering/Data Science/AI/ML/Statistics

Job description

Innodata Inc. is seeking a Technical Training & Quality Manager - AI Data to lead training, quality assurance, and continuous improvement across AI data programs.

You will collaborate with AI/ML, Data Science, Operations, Program Management, and Quality teams to ensure teams handling data annotation, labeling, model evaluation, RLHF, and other AI-data workflows have the required capabilities and consistently meet client quality standards.