Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate; Remote; CAD 70,000 - 90,000; Full time

Job summary

A leading AI training company in Dartmouth, Nova Scotia is seeking an ML Technical Quality Assurance Lead responsible for maintaining high-quality standards in AI data training. You'll review Python and ML tasks, manage communications with trainers, and create vital documentation. Ideal candidates should have a Bachelor’s or Master’s in a related field and solid experience with Python and ML frameworks. Excellent analytical skills and written communication are essential for this role, combining technology with precision.

Qualifications

• Solid professional experience with Python for machine learning, including end-to-end workflows.
• Strong hands-on experience with deep learning frameworks such as PyTorch or TensorFlow.
• Exceptional ability to understand and evaluate ML code, experiments, and metrics.

Responsibilities

• Review Python / ML tasks and code submissions for correctness and clarity.
• Keep trainers and QAs updated about project changes on Discord.
• Create and maintain technical documentation, including coding guidelines.

Skills

Python for machine learning

NumPy

pandas

scikit-learn

PyTorch or TensorFlow

Analytical skills

Written communication skills

Education

Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or Statistics

Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

• Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
• Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
• Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
• Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
• Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

• Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
• Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
• ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
• Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
• Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
• Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
• Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.

Quality Assurance Lead • Dartmouth, Nova Scotia, CA