Quality Engineer - AI Chatbot Validation

Viva Tech Solutions; Toronto; On-site; CAD 90,000 - 120,000; Full time

Job summary

Viva Tech Solutions in Toronto is seeking a senior Quality Engineer to lead test automation efforts across AI-powered features and APIs. You will design robust QA processes, craft test data, and collaborate with software engineers to improve quality at speed.

The role demands 5+ years in QA/Quality Engineering, strong programming in Java/Python, and hands-on experience with Selenium, Playwright, and Cucumber. Familiarity with AI quality concepts and various testing frameworks is essential.

Qualifications

• 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
• 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
• 5+ years of experience building and maintaining test automation frameworks.
• Experience testing AI or machine learning-powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.
• Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
• Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
• Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
• Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
• Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
• Ability to create effective test data and evaluation datasets for AI-driven functionality.

Skills

Quality Engineering

Quality Assurance

Test automation

Software development

Java

Python

Groovy

test automation frameworks

AI testing

LLM testing

Tools

Selenium

Cucumber/Gherkin

Playwright

RestAssured

JUnit

TestNG

qTest

ReadyAPI

JMeter

Job description

• 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
• 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
• 5+ years of experience building and maintaining test automation frameworks.
• Experience testing AI or machine learning-powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.
• Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
• Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
• Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
• Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
• Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
• Ability to create effective test data and evaluation datasets for AI-driven functionality.