Technical Training & Quality Manager

Jobtailor; Deutschland; Remote; EUR 90.000 - 120.000; Vollzeit

Benefits dieser Stelle

Professional development

Zusammenfassung

Jobtailor is seeking an experienced Training & Quality Lead to design and execute advanced AI/ML training programs for annotation teams. You will develop curricula, assessments, and certification programs while building robust quality frameworks and KPIs.

The role requires leading cross-functional teams, driving continuous improvement, and collaborating with clients and internal stakeholders to ensure high data quality and training effectiveness.

Qualifikationen

• 8–12 years of experience in AI/ML, data operations, data annotation, AI training, quality management or related areas.
• Bachelor's or master's degree in Computer Science, Engineering, Data Science, AI/ML, Statistics, or related field.
• Strong understanding of AI/ML concepts, Generative AI, and LLMs.
• Experience leading training and quality teams in high-volume delivery environments.
• Excellent communication, presentation, and facilitation skills.

Aufgaben

• Design and execute technical training programs for AI data and annotation teams.
• Develop curricula, assessments, certifications, and refresher modules.
• Train teams on AI/ML concepts, LLMs, NLP, data annotation, model evaluation, and prompt engineering.
• Own quality frameworks, monitor KPIs, and drive process improvements.
• Collaborate with clients, PMs, QA, and engineering to align training with project needs.

Kenntnisse

AI/ML training

Quality management

Root cause analysis

Stakeholder management

Data annotation

Ausbildung

Bachelor's/Master's in CS/Engineering/Data Science/AI/ML

Tools

Python

SQL

Analytics/BI tools

Jobbeschreibung

• Design and execute technical training programs for AI data and annotation teams
• Develop training curricula, learning paths, assessments, certification programs, and refresher modules
• Train teams on AI/ML concepts, LLMs, Generative AI, NLP, data annotation, data labeling, model evaluation, prompt engineering, RLHF, and AI response quality
• Conduct Train-the-Trainer programs and build internal technical trainers
• Identify skill gaps and create targeted upskilling plans
• Develop practical exercises, technical assessments, simulations, and certification frameworks
• Own quality frameworks and standards across AI data projects
• Define and monitor quality KPIs, accuracy, agreement rates, defect rates, audit scores, rework, and productivity
• Establish quality calibration processes and conduct regular quality audits
• Analyze quality trends, identify root causes, and implement corrective and preventive actions
• Drive continuous improvement to improve accuracy, consistency, productivity, and turnaround time
• Provide technical guidance for data annotation, LLM evaluation, RLHF, prompt-response evaluation, NLP, multimedia annotation, Generative AI evaluation, data validation, model benchmarking, and red teaming projects
• Translate project guidelines, client specifications, annotation taxonomies, and evaluation rubrics into training and quality programs
• Work with SMEs and technical teams to resolve complex quality and interpretation issues
• Collaborate with clients, Program Managers, Operations, Engineering, Data Science, and QA teams
• Participate in client calibration sessions and quality reviews
• Present quality dashboards, training effectiveness, RCA findings, and improvement plans to senior leadership
• Support new project launches through training needs analysis, SOP development, quality framework creation, and readiness assessments
• Measure training ROI and quality improvement using data and analytics
• Drive automation and technology adoption in training and quality processes
• Standardize best practices across projects and delivery teams

Requirements

• 8–12 years of experience in AI/ML, data operations, data annotation, AI training, quality management, technical L&D, or related areas
• Bachelor's/Master's degree in Computer Science, Engineering, Data Science, AI/ML, Statistics, or a related field
• Strong understanding of Artificial Intelligence, Machine Learning, Generative AI and LLMs
• Experience working with AI data / annotation / model evaluation projects
• Experience managing training and quality teams in a high-volume delivery environment
• Strong analytical and problem-solving skills
• Experience with Root Cause Analysis, CAPA, calibration, quality audits and process improvement
• Strong stakeholder and client management skills
• Excellent communication, presentation, and facilitation skills
• Ability to convert complex technical concepts into easy-to-understand training content
• Experience with AI platforms, annotation tools, LLM evaluation frameworks, or data-quality platforms
• Exposure to Python, SQL, analytics/BI tools, or automation would be an advantage

Core Competencies

Demonstrates expertise in designing and executing technical training programs focused on AI/ML concepts, data annotation, and quality management. Proficient in developing training curricula, assessments, and quality frameworks while driving continuous improvement and stakeholder collaboration.

Highest-signal resume keywords

• AI/ML Training Program Development
• Quality Management and Audits
• Root Cause Analysis and CAPA
• Stakeholder and Client Management
• Data Annotation and Model Evaluation

Hard Skills

• Artificial Intelligence
• Machine Learning
• Generative AI
• Data Annotation
• Quality Management
• Training Development
• Root Cause Analysis
• Process Improvement
• Technical Training
• Quality KPIs

Soft Skills

• Analytical Skills
• Problem-Solving Skills
• Communication Skills
• Presentation Skills
• Facilitation Skills

Industry Keywords

• Data Operations
• Technical L&D
• Quality Audits
• Calibration
• High-Volume Delivery Environment

Tools & Technologies

• AI Platforms
• Annotation Tools
• LLM Evaluation Frameworks
• Data-Quality Platforms
• Python
• SQL
• Analytics/BI Tools