Staff Quality Engineer - AI Systems & Automation

Devconnectplatform

Canada

Remote

CAD 134,000 - 185,000

Full time

12 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health benefits from day one
Remote-first
Generous PTO
WeWork access

Job summary

StackAdapt is hiring a Staff Quality Engineer to lead the quality strategy for AI/agentic systems. You will design evaluation frameworks for non-deterministic AI, build scalable automated test suites, and set quality benchmarks across CI/CD pipelines.

You’ll mentor QE teams and influence cross-functional partners in a fast-paced, remote-friendly environment. You will work with Engineering Managers, PMs, Designers, and ML/Data Science to align testing requirements and ensure reliable product

Qualifications

  • 7+ years of hands-on software quality and test automation.
  • Experience with API & UI automation frameworks.
  • Experience testing AI/agentic systems and scaling automation.

Responsibilities

  • Define end-to-end quality strategy for AI products.
  • Design evaluation frameworks for non-deterministic systems.
  • Develop scalable automated test suites and tooling.
  • Establish quality metrics and benchmarks.
  • Partner with mgmt, product, ML/DS, and eng teams.
  • Mentor QE org and promote best practices.
  • Contribute to planning, code review, and design decisions.
  • Provide actionable test result feedback.

Skills

QA strategy
API & UI test automation
Playwright
Cypress
TypeScript
Python
Jest
Junit
CI/CD
OpenAI/Anthropic
TestRail
Jenkins
Github Actions
CircleCI
React testing
AI/Agentic testing
Mentoring QE

Education

Bachelor's degree in Computer Science or related field
Advanced degree (nice to have)

Tools

Playwright
Cypress
Jest
JUnit
TestRail
Jenkins
Github Actions
CircleCI
CI/CD pipelines
React

Job description

StackAdapt is hiring a Staff Quality Engineer to lead the quality strategy for AI/agentic systems. You will design evaluation frameworks for non-deterministic AI, build scalable automated test suites, and set quality benchmarks across CI/CD pipelines.

You’ll mentor QE teams and influence cross-functional partners in a fast-paced, remote-friendly environment. You will work with Engineering Managers, PMs, Designers, and ML/Data Science to align testing requirements and ensure reliable product

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Test Automation Engineer
Senior AI Test Automation Engineer

PureFacts Financial Solutions • Toronto

On-site
CAD 100,000 - 140,000
Senior Quality Engineer – Test Automation, AI Testing & Java/Python
Senior Quality Engineer – Test Automation, AI Testing & Java/Python

Astra-North Infoteck Inc. • Toronto

On-site
CAD 90,000 - 120,000
AI Quality Engineer: Prompt Testing & Evaluation
AI Quality Engineer: Prompt Testing & Evaluation

Rootly • Canada

On-site
CAD 110,000 - 160,000
Competitive compensation
Comprehensive medical, dental, and视s
Vacation and mental health days
+3
Staff Quality Engineer
Staff Quality Engineer

Devconnectplatform • Canada

Remote
CAD 134,000 - 185,000
Health benefits from day one
Remote-first
Generous PTO
+1
Quality Engineer (QE) / SDET – AI Chatbot Validation
Quality Engineer (QE) / SDET – AI Chatbot Validation

Astra-North Infoteck Inc. • Toronto

On-site
CAD 90,000 - 140,000
Quality Engineer (QE) / SDET – AI Chatbot Validation
Quality Engineer (QE) / SDET – AI Chatbot Validation

Astra-North Infoteck Inc. • Toronto

On-site
CAD 110,000 - 160,000
QA Automation Engineer - Remote, AI-Powered Testing
QA Automation Engineer - Remote, AI-Powered Testing

360training.com • Canada

Remote
CAD 90,000 - 120,000
Monthly Team Events
Pet Insurance
Remote & Hybrid Work Models
+3
Quality Assurance Analyst
Quality Assurance Analyst

GuestTek Interactive Entertainment Ltd. • Calgary

On-site
CAD 70,000 - 90,000
QA Engineer: AI-Driven Test Automation
QA Engineer: AI-Driven Test Automation

Method Integration Inc. • Toronto

Hybrid
CAD 50,000 - 60,000
Hybrid work model
Weekly lunch credit
Health benefits
+1
Quality Engineer
Quality Engineer

Pacer Group • Toronto

Hybrid
CAD 55,000 - 62,000