Senior AI QA Automation Engineer

Re-Leased; Auckland; On-site; NZD 110,000 - 150,000; Full time

Job summary

Re-Leased is building am:pm, an AI-driven SaaS product for commercial real estate operators. We seek a senior QA Automation Engineer to own the quality system, building automated coverage, quality controls, and end-to-end test strategies in a fast-moving startup within an established SaaS business.

The role emphasizes testing agentic AI features, non-deterministic outputs, and integration with the team's deployment pipeline.

Qualifications

• 5+ years of QA experience in a SaaS product environment.
• Comfortable working in a production codebase — Git, branches, PRs, code review — and able to read code well enough to locate and understand the surface under test
• CI/CD fluent — you understand what runs when and where tests fit, with a clear point of view on the quality controls that make continuous delivery safe: pipeline gates, smoke checks, rollback signals
• Actively using AI tools in your workflow today — and opinions on where they’re strong and where they aren’t
• Genuine interest in testing AI products: you’ve thought about (or worked on) how to test non-deterministic systems, and evals excite you rather than scare you
• Strong exploratory testing instincts and sound test-pyramid judgment — you find the bugs automation can’t, and you know where automation investment pays off and where it doesn’t
• Comfortable with ambiguity, change, and making calls with incomplete information — you’re drawn to small teams and early-stage product work
• A genuine focus on the customer outcome, not just the test count

Responsibilities

• Drive quality automation across the test pyramid — set where coverage sits so tests run at the layer that’s cheapest and most reliable — and steward the end-to-end suite: curate what earns a place in it, and set the standards engineers follow when contributing tests of their own
• Support our move to continuous delivery — design the right level of automated quality controls (pipeline gates, smoke checks, release signals) so we can release frequently without slowing the flow of change
• Use AI tooling as a first-class part of your workflow — test generation, bug triage, test data creation — and keep raising the bar on how the team uses it
• Curate AI-generated tests and findings — decide what to keep, reject, or refine, applying your own testing judgment rather than accepting output wholesale
• Shape how we test AI-powered features — advise on when evals are the right quality control and what they should cover, and contribute adversarial and edge-case scenarios; engineers write and own the evals themselves
• Partner with engineers on acceptance criteria and coach them on designing test scenarios from a user’s perspective — positive paths, negative paths, edge cases
• Run exploratory and risk-based testing to find what automation misses, and feed production bugs back into automation at the layer that would have caught them
• Analyse quality workflows — triage, release, escape defects — and drive structural improvements, reporting on quality signals so the squad always knows where quality stands

Skills

QA experience

Automation

CI/CD

AI tooling

Exploratory testing

Test pyramid

Ambiguity handling

Customer focus

Tools

Git

Azure DevOps

Terraform

Job description

Re-Leased is building am:pm, an AI-driven SaaS product for commercial real estate operators. We seek a senior QA Automation Engineer to own the quality system, building automated coverage, quality controls, and end-to-end test strategies in a fast-moving startup within an established SaaS business.

The role emphasizes testing agentic AI features, non-deterministic outputs, and integration with the team's deployment pipeline.