Technical Lead-Testing Services

Birlasoft; Ontario; Hybrid; CAD 70,000 - 90,000; Full time

Job summary

A leading IT services company is seeking a Technical Lead for Testing Services in Mississauga, Ontario. As a QA Engineer, you will focus on functional and AI testing throughout the development lifecycle. The ideal candidate will have strong QA skills, experience in testing protocols, and familiarity with AI concepts. This full-time role offers a hybrid work arrangement with three days onsite, engaging with cross-functional teams to ensure quality in AI products.

Qualifications

• Strong foundation in QA theory and practice.
• Experience in writing test plans and strategies.
• Excellent bug identification and reporting skills.
• Proven testing experience in web applications and APIs.
• Familiarity with AI/ML concepts and QA challenges.

Responsibilities

• Review and analyze project requirements for testing.
• Perform manual functional and regression testing.
• Create test plans and comprehensive test cases.
• Manage bugs and issues using Azure DevOps.
• Validate AI model responses and identify edge cases.
• Collaborate effectively in a cross-functional team.

Skills

QA theory and practice

Writing test plans and cases

Identifying bugs

Testing web applications

AI/ML concepts

Model performance metrics

Writing test cases for AI models

Prompt engineering

Azure DevOps

Test automation with Playwright

Mobile testing

Education

Bachelor’s or master’s degree in relevant field

Tools

Azure DevOps

Playwright

TypeScript

Job description

Overview

Technical Lead-Testing Services role at Birlasoft. As a QA Engineer, you will be responsible for both functional and AI testing across the full development lifecycle. This position will test standard application features as well as the AI-specific components such as natural language responses, model behaviors, and prompt handling. You will be working in a team and collaborating closely with developers, product managers, and other stakeholders to ensure a high standard of quality for our AI product. Location: Mississauga, Ontario. HYBRID - 3 days onsite.

Role Responsibilities

• Review and analyze project requirements and technical specifications.
• Perform manual testing: functional, regression, smoke, and exploratory testing.
• Create detailed test plans, test strategies, and comprehensive test cases.
• Identify, document, track, and manage bugs to resolution using Azure DevOps.
• Validate and evaluate AI model responses across different scenarios and edge cases.
• Design test cases that reflect real-world usage patterns for AI chat.
• Compare and analyze outputs between different AI models or versions.
• Collaborate with developers, product owners, and stakeholders to ensure product quality.
• Participate in Agile ceremonies including sprint planning, stand-ups, and retrospectives.

Technical Qualifications

• Strong foundation in QA theory and practice.
• Experience in writing test plans, test strategies, and test cases.
• Skilled in identifying bugs and creating detailed, clear, and concise bug reports.
• Experience in testing web applications and APIs.
• Familiarity with AI/ML concepts and how they impact QA.
• Knowledge of model performance metrics and AI evaluation techniques.
• Ability to write test cases for AI model responses, validate outputs, and identify edge case failures.
• Understanding of prompt engineering and the unique testing challenges of generative AI systems.
• Experience using Azure DevOps for test case management and bug tracking.
• Knowledge of Playwright and TypeScript for test automation is considered a plus.
• Mobile testing experience is considered a plus.

General Qualifications

• Excellent written and verbal English communication skills.
• Solid understanding of the Software Development Life Cycle (SDLC) and QA methodologies.
• Proven experience working in a Scrum/Agile environment.
• Ability to work collaboratively in cross-functional teams.
• Background in insurance or other regulated industries.

Education Requirements

• Bachelor’s or master’s degree in relevant field.

Seniority level

• Entry level

Employment type

• Full-time

Job function

• Engineering and Information Technology

Industries

• IT Services and IT Consulting