Senior AI QA Engineer — Automation Lead (Remote NZ)

Remote; San Francisco (CA); Remote; USD 68,000 - 107,000; Full time

Benefits offered by this job

Health insurance

Wellness allowance

Parental leave

Milestone rewards

Hybrid/remote-friendly

Job summary

Re-Leased is hiring a senior quality automation engineer to own the quality system for am:pm — an AI-powered SaaS product for commercial real estate. Based in Napier or remote from another NZ city, you’ll shape automation, tests, and data-driven quality across the end-to-end pipeline.

You’ll build and curate AI-enabled evals, drive continuous delivery, and partner with engineers to raise the bar on quality while keeping customer outcomes at the center of every decision.

Qualifications

• 5+ years of QA experience in a SaaS product environment, with automation at the centre of how you work.
• Track record of designing test automation frameworks from the ground up — architecture, tooling choices, conventions.
• CI/CD fluent — you understand what runs when and where tests fit, with a clear point of view on the quality controls that make continuous delivery safe: pipeline gates, smoke checks, rollback signals.
• Actively using AI tools in your workflow today — and opinions on where they're strong and where they aren't
• Genuine interest in testing AI products: you've thought about how to test non-deterministic systems, and evals excite you.

Responsibilities

• Drive quality automation across the test pyramid — set where coverage sits so tests run at the layer that's cheapest and most reliable — and steward the end-to-end suite: curate what earns a place in it, and set the standards engineers follow when contributing tests of their own
• Support our move to continuous delivery — design the right level of automated quality controls (pipeline gates, smoke checks, release signals) so we can release frequently without slowing the flow of change
• Use AI tooling as a first-class part of your workflow — test generation, bug triage, test data creation — and keep raising the bar on how the team uses it
• Curate AI-generated tests and findings — decide what to keep, reject, or refine, applying your own testing judgment rather than accepting output wholesale
• Shape how we test AI-powered features — advise on when evals are the right quality control and what they should cover, and contribute adversarial and edge-case scenarios; engineers write and own the evals themselves
• Partner with engineers on acceptance criteria and coach them on designing test scenarios from a user's perspective — positive paths, negative paths, edge cases
• Run exploratory and risk-based testing to find what automation misses, and feed production bugs back into automation at the layer that would have caught them
• Analyse quality workflows — triage, release, escape defects — and drive structural improvements, reporting on quality signals so the squad always knows where quality stands

Skills

QA automation

Test frameworks

Exploratory testing

AI testing

Tools

Playwright

Cypress

TypeScript

Job description

Re-Leased is hiring a senior quality automation engineer to own the quality system for am:pm — an AI-powered SaaS product for commercial real estate. Based in Napier or remote from another NZ city, you’ll shape automation, tests, and data-driven quality across the end-to-end pipeline.

You’ll build and curate AI-enabled evals, drive continuous delivery, and partner with engineers to raise the bar on quality while keeping customer outcomes at the center of every decision.