AI/ML QA Lead — End-to-End Testing (Toronto Onsite)

Realign Llc; Toronto; On-site; CAD 120,000 - 170,000; Full time

Job summary

Realign Llc in Toronto, ON is seeking an experienced QA Lead for AI/ML Testing. You will lead end-to-end testing, establish quality standards, and drive automation across AI-driven solutions.

The role requires 10+ years in software testing and 3+ years in AI/ML testing leadership, with strong collaboration with data scientists, developers, and product teams. This onsite position focuses on validating model accuracy, performance, security, and business outcomes, while mentoring QA staff and

Qualifications

• 10+ years of software testing and quality assurance experience.
• 3+ years leading AI/ML testing initiatives.
• Experience with functional, data, model, performance, security, and integration testing.

Responsibilities

• Lead end-to-end test strategy and governance for AI/ML solutions.
• Develop testing frameworks: functional, data, model, performance, security.
• Validate AI model accuracy and business outcomes.
• Collaborate with data scientists, developers, product owners.
• Drive test automation and QA process improvements.
• Manage defect lifecycle, reporting, and release readiness.
• Ensure AI governance and quality standards compliance.
• Mentor and lead QA team members.
• Support Agile delivery across SDLC.

Skills

Software Testing

QA Leadership

AI/ML testing

Functional testing

Data testing

Model testing

Performance testing

Security testing

Integration testing

Test Automation

Defect Management

Agile QA

Stakeholder Management

Mentoring

Job description

Realign Llc in Toronto, ON is seeking an experienced QA Lead for AI/ML Testing. You will lead end-to-end testing, establish quality standards, and drive automation across AI-driven solutions.

The role requires 10+ years in software testing and 3+ years in AI/ML testing leadership, with strong collaboration with data scientists, developers, and product teams. This onsite position focuses on validating model accuracy, performance, security, and business outcomes, while mentoring QA staff and