11708

Maarut; Toronto; Hybrid; CAD 90,000 - 130,000; Full time

Job summary

Maarut is seeking a Systems Testing/QA Specialist - Senior to lead testing efforts across projects, including AI-enabled systems. You will design and execute comprehensive test plans, collaborate with cross-functional teams, and drive quality through automated and manual testing, UAT, and defect management.

The role requires extensive experience in QA leadership, test design, automation tools, and strong collaboration to ensure timely delivery of high-quality software solutions.

Qualifications

• Post-secondary degree in Computer Science, Electronics or related field.
• 10+ years of testing for large-scale applications including web, cloud and mobile.
• 3+ years AI-assisted testing with LLM/ chatbot applications.
• Experience with AI testing tools and automation in CI/CD pipelines.
• Knowledge of SDLC/Agile/DevOps delivery methodologies.

Responsibilities

• Lead testing efforts for projects including planning, coordination and QA oversight.
• Design manual and automated tests; develop data to support execution.
• Execute tests across functional, integration, performance and AI-enabled systems.
• Lead UAT with business users and provide guidance.
• Manage defect lifecycle and communicate progress to stakeholders.

Skills

QA leadership

Test design

Automation testing

AI testing

UAT facilitation

Defect management

Collaboration

Risk assessment

Test automation tools

Education

Post-secondary degree in Computer Science or related

Tools

Micro Focus UFT

TOSCA

Selenium

Cucumber

JMeter

OpenText Load Runner

OpenText ALM

JIRA

Confluence

Job description

RQ00822 - Systems Testing/QA Specialist - Senior

The Quality Assurance Specialist (QA lead) is responsiblefor performing application testing tasks and Quality Assurance activitiesincluding Functional Testing, Automation Testing, and various AI testing asdescribed below.

The Quality Assurance Specialist (QA lead) will participatein planning and estimating the activities required to test the new solutionsand enhanced applications. He/She will participate in the development of MasterTest Plans, Test

Cases, Test Scripts, Test Completion Reports, etc. whileproviding advice to business users for the development of Test Cases for UserAcceptance Test.

Executing the tests as required, performing issue trackingand resolution.

The Quality Assurance Specialist (QA Lead) plays a criticalrole in ensuring the delivery of high-quality software solutions by designing,executing, and managing testing activities throughout the software developmentlifecycle. The QA Specialist will work collaboratively with cross-functionalteams to validate system functionality, performance, and usability, and ensurealignment with business requirements and quality standards.

The Quality Assurance (QA) Specialist will be working undera hybrid work model (3 days in office and a remote location). The officelocation will be Metro Hall 15th floor, 55 John Street in Toronto.The successful candidate will be working seven (7) hours per day, five (5) daysper week based on normal working Business Hours.

Key Responsibilities

Quality Assurance Leadership

• Lead testing efforts for assigned projects, includingplanning, coordination, execution and oversight of QA activities.
  
• Assess risks to quality based on verification and validationresults and provide recommendations for mitigation.
  
• Implement and maintain quality processes that supportdevelopment and production change management.
  

Test Design & Planning

• Design comprehensive manual and automated testing processes,including test plans, test cases, and test scripts.
  
• Develop functional, system, regression, integration, load,and performance test scenarios based on project requirements.
  
• Collaborate with development leads and business analysts todesign and create test data to support test execution.
  

Test Execution & Management

• Perform various types of testing manually and/or usingautomation tools, including:
  
• Functional Testing
  
• Regression Testing
  
• Integration Testing
  
• Usability/Accessibility Testing
  
• Performance Testing
  
• Perform the following types of AI testing activities:
  
• Functional AI Testing
  
• Response accuracy
  
• Hallucination testing
  
• AI-Security and privacy testing (prompt injection)
  
• AI-Safety Testing (inappropriate behaviours)
  
• Execute test cycles, monitor progress, and manage defectresolution and issue tracking.
  
• Maintain detailed records of test results and discrepanciesusing designated QA tools.
  
• Work closely with project managers, implementation team,system administrators, architects, vendors (as needed) and databaseadministrators to ensure testing activities are aligned with project timelinesand technical requirements.
  
• Lead and assist business users in conducting User AcceptanceTesting (UAT), providing guidance and support as needed.
  

Reporting & Communication

• Manage the full-cycle process for documenting andcommunicating test discrepancies and defects to appropriate stakeholders.
  
• Provide regular updates on testing progress, issues, andoutcomes to project teams and management
  
• Develop and build a Test Completion Report summarizing alltesting activities and results for Gating purposes
  

Requirements

Assignment Duties

• Post-secondary degree in Computer Science, ElectronicEngineering, or a related discipline.
  
• Minimum of 10+ years of experience performing testing forlarge-scale applications, including on-premise web solutions, cloud-basedintegrations, and mobile platforms.
  
• Minimum of 3 years of solid experience in AI-assistedtesting with hands-on experience in developing AI-powered QA agents usingagentic AI, LLM technologies and chatbot applications to create and executetest cases.
  
• Experience using AI tools to increase testing coverage,negative testing, regression testing with knowledge of AI-assisted automationfor CI/CD pipelines.
  
• Experience leading and coordinating testing activities incollaboration with project with project teams and a strong understanding of thevarious delivery methodologies such as: SDLC - Waterfall, Agile (Scrum),Hybrid, and DevOps.
  
• Certification in Software Quality Engineering or anequivalent credential is considered a strong asset.
  
• Excellent analytical skills in business processes,information systems, information management, and web UI design andaccessibility.
  
• Strong written and verbal communication skills, with theability to collaborate effectively across multidisciplinary teams.
  

Technical Capabilities

• Extensive hands-on experience with all layers of testing:UI, Integration,Regression, Performance, AI-enabled systems, andUser Acceptance Testing—across web-based, mobile, and cloud platforms.
  
• Proven ability to execute AI testing activities utilizingspecialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI,Agentic AI, Copilot Studio Kit, etc.
  
• Skilled in implementing automated testing using tools suchas Micro Focus UFT, TOSCA, Selenium, Cucumber, as well as conductingperformance testing with JMeter and OpenText Load Runner. As well as experiencewith platforms such as: ServiceNow, Salesforce, SAP, or equivalent areconsidered an asset
  
• Strong experience in executing test cycles, analyzingresults, and managing the full defect lifecycle using tools like OpenText ALM,OpenText Octane, JIRA, Visual Studio, Confluence, etc.
  
• Demonstrated capability in analyzing business requirementsand user stories to design test scenarios, develop test cases and scripts,prepare test data, and assess results for quality assurance.
  

The City may contact the references provided. Should anyreference fail to confirm that the services listed in Section 3.0 wereperformed in a satisfactory manner; the Candidate may be declared non-compliantand not considered for the remainder of the evaluation process.

• Design and deliver detailed manual and automated test plans,test cases, and test scripts aligned with business requirements and projectobjectives.
  
• Perform various testing types (functional, regression,integration, system, performance, usability, and UAT) across multiple platformsand environments. Report and document results accordingly.
  
• Maintain accurate records of test discrepancies and defectsusing designated QA tools and provide timely reports and recommendations tostakeholders.
  
• On as needed basis, develop and implement automated testingframeworks and scripts using tools such as Micro Focus/OpenText UFT, Selenium,Cucumber, etc.
  
• On as needed bases, conduct load and stress testing usingtools like Load Runner or JMeter and deliver performance analysis reports withactionable insights.
  
• Collaborate with business analysts and developers to createand manage test data and scenarios that support robust validation of businessprocesses.
  
• Support the implementation of quality assurance processesand contribute to the continuous improvement of testing practices within Agile,DevOps, and traditional environments.
  

Must Haves

• Minimum of 3 years of solid experience in AI-assistedtesting with hands-on experience in developing AI-powered QA agents usingagentic AI, LLM technologies and chatbot applications to create and executetest cases.
  
• Minimum of 10+ years of experience performing testing forlarge-scale applications, including on-premise web solutions, cloud-basedintegrations, and mobile platforms.
  
• Extensive hands-on experience with all layers oftesting:UI, Integration, Regression, Performance, AI-enabled systems, andUser Acceptance Testing—across web-based, mobile, and cloud platforms.
  
• Proven ability to execute AI testing activities utilizingspecialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI,Agentic AI, Copilot Studio Kit, etc.