Senior AI QA Automation Engineer (Remote NZ)

Re-Leased; Napier; On-site; NZD 120,000 - 180,000; Full time

Job summary

Re-Leased is seeking a senior quality automation engineer to own the am:pm QA system, shaping automation, controls and practices for an AI-powered SaaS product. Based in Napier or remotely from another NZ city, you will drive end-to-end quality with AI at the core, championing automation across the test pyramid and enabling safe, frequent releases.

You will lead test generation, triage, and data creation using AI, collaborate with engineers on acceptance criteria, and mentor a small startup

Qualifications

• 5+ years of QA experience in a SaaS product environment with automation at the centre of how you work.
• Comfortable working in a production codebase — Git, branches, PRs, code review — and able to read code well enough to locate and understand the surface under test.
• CI/CD fluent — you understand what runs when and where tests fit, with a clear point of view on the quality controls that make continuous delivery safe: pipeline gates, smoke checks, rollback signals.
• Actively using AI tools in your workflow today — and opinions on where they're strong and where they aren't.
• Genuine interest in testing AI products: you've thought about (or worked on) how to test non-deterministic systems, and evals excite you rather than scare you.
• Strong exploratory testing instincts and sound test-pyramid judgment — you find the bugs automation can't, and you know where automation investment pays off and where it doesn't.
• Comfortable with ambiguity, change, and making calls with incomplete information — you're drawn to small teams and early-stage product work.
• A genuine focus on the customer outcome, not just the test count.

Responsibilities

• Drive quality automation across the test pyramid — set where coverage sits so tests run at the layer that's cheapest and most reliable — and steward the end-to-end suite: curate what earns a place in it, and set the standards engineers follow when contributing tests of their own
• Support our move to continuous delivery — design the right level of automated quality controls (pipeline gates, smoke checks, release signals) so we can release frequently without slowing the flow of change
• Use AI tooling as a first-class part of your workflow — test generation, bug triage, test data creation — and keep raising the bar on how the team uses it
• Curate AI-generated tests and findings — decide what to keep, reject, or refine, applying your own testing judgment rather than accepting output wholesale
• Shape how we test AI-powered features — advise on when evals are the right quality control and what they should cover, and contribute adversarial and edge-case scenarios; engineers write and own the evals themselves
• Partner with engineers on acceptance criteria and coach them on designing test scenarios from a user's perspective — positive paths, negative paths, edge cases
• Run exploratory and risk-based testing to find what automation misses, and feed production bugs back into automation at the layer that would have caught them
• Analyse quality workflows — triage, release, escape defects — and drive structural improvements, reporting on quality signals so the squad always knows where quality stands

Skills

QA Automation

SaaS QA

CI/CD

Git & PRs

AI tooling

Exploratory testing

Test pyramid

Quality ownership

Tools

Git

Azure DevOps

REST API testing

CI/CD tooling

Job description

Re-Leased is seeking a senior quality automation engineer to own the am:pm QA system, shaping automation, controls and practices for an AI-powered SaaS product. Based in Napier or remotely from another NZ city, you will drive end-to-end quality with AI at the core, championing automation across the test pyramid and enabling safe, frequent releases.

You will lead test generation, triage, and data creation using AI, collaborate with engineers on acceptance criteria, and mentor a small startup