Technical Training & Quality Manager

Innodata Inc.; United States; Remote; USD 145,000 - 175,000; Full time

Job summary

Innodata Inc. is seeking a Technical Training & Quality Manager – AI Data to lead training, capability development, and quality assurance for AI data programs.

You will collaborate with AI/ML, Data Science, Operations, and QA teams to ensure teams maintain high-quality data workflows and meet client standards. The role requires strong AI/ML technical understanding, hands-on experience in training, QA, and process improvement, and the ability to scale operations across large datasets and multiple

Qualifications

• 8–12 years of experience in AI/ML, data operations, data annotation, AI training, quality management, technical L&D, or related areas.
• Bachelor's or Master's degree in a related field such as CS, Engineering, Data Science, AI/ML, Statistics.
• Strong understanding of AI, ML, Generative AI and LLMs.

Responsibilities

• Design and execute technical training programs for AI data and annotation teams.
• Develop curricula, assessments, certifications, and refresher modules.
• Train teams on AI/ML concepts, LLMs, NLP, data annotation, model evaluation, prompt engineering, RLHF, and AI response quality.
• Establish quality KPIs, audits, and continuous improvement plans.

Skills

AI/ML knowledge

Training program design

Quality management

Stakeholder management

Communication & facilitation

Process improvement

SOP development

Education

Bachelor's/Master's in CS/Engineering/Data Science/AI/ML/Statistics

Tools

Python

SQL

Analytics/BI tools

AI platforms

Annotation tools

Job description

Innodata(Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked.Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale.We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.

Scope of the Role

We are looking for a Technical Training & Quality Manager – AI Data to lead technical training, capability development, quality assurance, and continuous improvement for AI data programs.

The role will work closely with AI/ML, Data Science, Operations, Program Management, and Quality teams to ensure that teams working on data annotation, data preparation, model evaluation, RLHF, LLM training, AI response evaluation, and other AI-data workflows have the required technical capabilities and consistently meet client-defined quality standards.

The ideal candidate should combine strong technical understanding of AI/ML and data workflows with hands-on experience in training, quality management, process improvement, and large-scale operations

Technical Training & Capability Development

• Design and execute technical training programs for AI data and annotation teams.
• Develop training curricula, learning paths, assessments, certification programs, and refresher modules.
• Train teams on AI/ML concepts, LLMs, Generative AI, NLP, data annotation, data labeling, model evaluation, prompt engineering, RLHF, and AI response quality.
• Conduct Train-the-Trainer programs and build internal technical trainers.
• Identify skill gaps through assessments, production performance, and quality metrics and create targeted upskilling plans.
• Develop practical exercises, technical assessments, simulations, and certification frameworks.

Quality Management

• Own quality frameworks and standards across AI data projects.
• Define and monitor quality KPIs, accuracy, agreement rates, defect rates, audit scores, rework, and productivity.
• Establish quality calibration processes and conduct regular quality audits.
• Analyze quality trends and identify root causes of recurring defects.
• Partner with Operations and Program Managers to implement corrective and preventive actions.
• Drive continuous improvement initiatives to improve accuracy, consistency, productivity, and turnaround time.

AI Data & Technical Operations

• Data annotation and labeling
• LLM evaluation
• NLP and text classification
• Generative AI evaluation
• Data validation and enrichment
• Model benchmarking and red teaming
• Understand project guidelines, client specifications, annotation taxonomies, and evaluation rubrics and translate them into effective training and quality programs.
• Work with SMEs and technical teams to resolve complex quality and interpretation issues.

Stakeholder Management

• Work closely with clients, Program Managers, Operations, Engineering, Data Science, and QA teams.
• Participate in client calibration sessions and quality reviews.
• Present quality dashboards, training effectiveness, RCA findings, and improvement plans to senior leadership.
• Support new project launches through training needs analysis, SOP development, quality framework creation, and readiness assessments.
• Identify opportunities to improve training effectiveness, operational quality, and process efficiency.
• Use data and analytics to measure training ROI and quality improvement.
• Drive automation and technology adoption in training and quality processes.
• Standardize best practices across projects and delivery teams.

You’ll Thrive in This Role If You Have

• 8–12 years of experience in AI/ML, data operations, data annotation, AI training, quality management, technical L&D, or related areas.
• Bachelor's/Master's degree in Computer Science, Engineering, Data Science, AI/ML, Statistics, or a related field.
• Strong understanding of Artificial Intelligence, Machine Learning, Generative AI and LLMs.
• Experience working with AI data / annotation / model evaluation projects.
• Experience managing training and quality teams in a high-volume delivery environment.
• Strong analytical and problem-solving skills.
• Experience with Root Cause Analysis, CAPA, calibration, quality audits and process improvement.
• Strong stakeholder and client management skills.
• Excellent communication, presentation, and facilitation skills.
• Ability to convert complex technical concepts into easy-to-understand training content.
• Certifications in AI/ML, Quality Management, Six Sigma, instructional design or technical training are preferred.
• Experience with AI platforms, annotation tools, LLM evaluation frameworks, or data-quality platforms.
• Exposure to Python, SQL, analytics/BI tools, or automation would be an advantage.

The expected salary range for this position is $145,000 - $175,000 p/year, based on experience, skills, and qualifications.

As set forth in Innodata Inc.’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.