Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate; Remote; CAD 80,000 - 100,000; Full time

Job summary

A dynamic AI training company is seeking a ML Technical Quality Assurance Lead in Calgary, Alberta. This role involves maintaining high standards in AI data training and reviewing Python tasks for correctness. Ideal candidates will have a strong background in Python and machine learning, with excellent analytical skills and experience communicating technical feedback. You will ensure the consistency of ML-related training data, contribute to project success, and foster engagement within the QA community.

Qualifications

• Solid professional experience with Python for machine learning.
• Experience with end-to-end workflows in ML.
• Exceptional ability to evaluate ML code and metrics.

Responsibilities

• Review Python/ML tasks for correctness and clarity.
• Keep trainers and QAs updated on project changes.
• Monitor QA activity and encourage re-engagement.
• Create and maintain technical documentation.
• Organize training calls to explain ML quality standards.

Skills

Python for machine learning

NumPy

pandas

scikit-learn

PyTorch

TensorFlow

Analytical skills

Problem-solving skills

Written communication

Leadership

Education

Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics

Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

• Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
• Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
• Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
• Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
• Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

• Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
• Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
• ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
• Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
• Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
• Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
• Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.

Quality Assurance Lead • Calgary, Alberta, CA