Senior Quality Assurance Specialist (AI Testing / QA Lead)

Altis Technology; Toronto; Hybrid; CAD 96,000 - 138,000; Full time

Benefits offered by this job

Hybrid schedule

Job summary

Altis Technology in Toronto is seeking a Senior QA Specialist to lead AI testing and QA strategy across enterprise projects. You will develop AI-powered QA agents, perform diverse testing, and ensure security and reliability in AI-enabled applications.

The role requires 10+ years in testing, hands-on AI automation experience, and strong collaboration with cross-functional teams. Hybrid schedule and full lifecycle QA leadership are provided.

Qualifications

• 10+ years in enterprise testing across web, cloud, and mobile.
• Hands-on AI-assisted testing with agentic AI and LLMs.
• Strong leadership and stakeholder communication skills.

Responsibilities

• Lead QA strategy, planning, execution, and reporting across projects.
• Develop AI-powered QA agents using LLMs and chatbot tech.
• Perform functional, integration, regression, performance, and UAT testing.
• Validate AI-enabled apps for security, privacy, and safety.
• Coordinate testing across Agile, Waterfall, Hybrid, and DevOps environments.

Skills

AI testing

QA leadership

Agentic AI

CI/CD testing

Selenium

Education

Post-secondary degree in CS/Engineering

Software Quality Engineering certification

Tools

DeepEval

Applitools

Promptfoo

SaolaAI

Copilot Studio Kit

Job description

Senior Quality Assurance Specialist (AI Testing / QA Lead)

Location: Toronto, ON | Hybrid, 3 days per week onsite, 2 days remote

Language: English, excellent written and verbal communication required

Duration: 6-month contract, 35 hours per week

About the Opportunity

Are you a seasoned Quality Assurance professional passionate about AI innovation and delivering exceptional software solutions? A leading public sector organization is seeking a Senior QA Specialist with strong hands-on experience in AI-assisted testing, agentic AI, and large-scale enterprise applications to support high-impact technology initiatives. In this role, you'll collaborate with developers, architects, business analysts, and project leaders to strengthen testing practices across complex digital environments. You'll combine technical expertise with QA leadership to ensure applications are reliable, secure, accessible, and aligned with evolving business and user needs.

Whats In It for You

• Work on meaningful public sector technology initiatives with a direct impact on digital service delivery
• Gain exposure to emerging AI testing technologies, including LLMs, intelligent QA agents, and automated testing frameworks
• Collaborate with multidisciplinary teams in an environment that values knowledge sharing, innovation, and continuous improvement
• Enjoy a hybrid schedule with consistent weekday business hours

Your Responsibilities

• You'll lead QA planning, test strategy, execution, risk assessment, and reporting across enterprise technology projects
• You’ll develop AI-powered QA agents using agentic AI, LLMs, and chatbot technologies to generate and execute test cases
• You’ll perform functional, integration, regression, performance, accessibility, mobile, API, and user acceptance testing
• You’ll validate AI-enabled applications for response accuracy, hallucinations, prompt injection, security, privacy, and safety
• You’ll design automated test scripts, manage test data, track defects, and support CI/CD testing activitiesYou’ll coordinate testing across Agile, Waterfall, Hybrid, and DevOps environments while guiding business users through UAT
• You’ll prepare Master Test Plans, test scripts, progress updates, and Test Completion Reports to support release decisions

Skills and Qualifications

• 10+ years of enterprise application testing experience across on-premise web applications, cloud integrations, and mobile platforms, including at least 3 years of hands-on AI-assisted testing
• Proven experience building AI-powered QA agents using agentic AI, LLMs, and chatbots, with tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, and Copilot Studio Kit
• Strong expertise across UI, integration, regression, performance, AI-enabled systems, UAT, and AI-assisted automation within CI/CD pipelines
• Experience with Micro Focus UFT, TOSCA, Selenium, Cucumber, JMeter, and OpenText LoadRunner
• Proficiency with OpenText ALM, OpenText Octane, JIRA, Visual Studio, and Confluence. Experience with ServiceNow, Salesforce, or SAP is an asset
• Post-secondary degree in Computer Science, Electronic Engineering, or a related discipline. Software Quality Engineering certification is an asset
• Strong analytical, accessibility, QA leadership, and stakeholder communication skills, with experience across Agile, Scrum, Waterfall, Hybrid, and DevOps methodologies

We appreciate the time and effort all applicants invest in their submissions. Please note that only candidates shortlisted for this role will be contacted directly. However, your profile will remain under consideration for future opportunities that align with your experience and career goals.All qualified applicants will receive fair consideration for employment. We welcome individuals of all backgrounds, experiences, and identities including those who identify as women, members of racialized groups, Indigenous Peoples, persons with disabilities, and 2SLGBTQIA+ communities. If you require an accommodation, please review our accessibility policy and reach out to our accessibility officer with any questions. Our human recruiters review all applications and always make the final hiring decision. On occasion, we also use AI-assisted tools to help review applications.