Senior Quality Automation Engineer

Logoslabs; San Francisco (CA); Remote; USD 68,000 - 107,000; Full time

Benefits offered by this job

Health insurance

Wellness allowance

Parental leave

Milestone rewards

Hybrid/remote-friendly

Job summary

Re-Leased is hiring a senior quality automation engineer to own the quality system for am:pm — an AI-powered SaaS product for commercial real estate. Based in Napier or remote from another NZ city, you’ll shape automation, tests, and data-driven quality across the end-to-end pipeline.

You’ll build and curate AI-enabled evals, drive continuous delivery, and partner with engineers to raise the bar on quality while keeping customer outcomes at the center of every decision.

Qualifications

• 5+ years of QA experience in a SaaS product environment, with automation at the centre of how you work.
• Track record of designing test automation frameworks from the ground up — architecture, tooling choices, conventions.
• CI/CD fluent — you understand what runs when and where tests fit, with a clear point of view on the quality controls that make continuous delivery safe: pipeline gates, smoke checks, rollback signals.
• Actively using AI tools in your workflow today — and opinions on where they're strong and where they aren't
• Genuine interest in testing AI products: you've thought about how to test non-deterministic systems, and evals excite you.

Responsibilities

• Drive quality automation across the test pyramid — set where coverage sits so tests run at the layer that's cheapest and most reliable — and steward the end-to-end suite: curate what earns a place in it, and set the standards engineers follow when contributing tests of their own
• Support our move to continuous delivery — design the right level of automated quality controls (pipeline gates, smoke checks, release signals) so we can release frequently without slowing the flow of change
• Use AI tooling as a first-class part of your workflow — test generation, bug triage, test data creation — and keep raising the bar on how the team uses it
• Curate AI-generated tests and findings — decide what to keep, reject, or refine, applying your own testing judgment rather than accepting output wholesale
• Shape how we test AI-powered features — advise on when evals are the right quality control and what they should cover, and contribute adversarial and edge-case scenarios; engineers write and own the evals themselves
• Partner with engineers on acceptance criteria and coach them on designing test scenarios from a user's perspective — positive paths, negative paths, edge cases
• Run exploratory and risk-based testing to find what automation misses, and feed production bugs back into automation at the layer that would have caught them
• Analyse quality workflows — triage, release, escape defects — and drive structural improvements, reporting on quality signals so the squad always knows where quality stands

Skills

QA automation

Test frameworks

Exploratory testing

AI testing

Tools

Playwright

Cypress

TypeScript

Job description

Does redefining what Quality looks like in the age of AI — on a brand-new AI product — make you tick?

At Re-Leased our vision is to shape the future of Commercial Real Estate and drive better outcomes for people, property and planet. We're now building am:pm — an agentic AI product for commercial real estate operators.

Property managers run their portfolios on a system of record like Re-Leased, but most of the actual work happens outside it — emails, phone calls, follow-ups, to-do lists scattered across tools, with no system behind them. am:pm is the system of action for that work: it captures the work to be done as jobs and tasks, grounded in the communication channels, memories, and documents that surround the portfolio — so the work itself finally has a home. You can read more at ampm.ai.

am:pm is in early access with customers right now. The squad is small, the stack is new, and we're moving fast.

Your Role

We're looking for a senior quality automation engineer to own the quality system for am:pm — based in Napier or remote from another city in New Zealand. The whole squad owns quality; you build the automation, quality controls, and practices that make that possible. This is an automation-led role: engineers write unit and integration tests, and you shape where automated coverage sits across the test pyramid and steward the end-to-end suite, with AI as a core part of how you work — generating tests, triaging failures, creating test data. We're also moving to continuous delivery, and a core part of this role is making that safe — the right level of automated quality controls so changes flow to production with confidence.

And because am:pm is an AI product, quality means testing agentic behaviour: non-deterministic outputs, tool use, statistical rather than binary correctness. Engineers write the evals — just as they write unit and integration tests — and you bring the quality lens: when evals are the right control, and what they need to catch.

This is a small-team, start-up environment inside an established SaaS business — less process, more agency, and a tight feedback loop with real customers.

Your Responsibilities

• Drive quality automation across the test pyramid — set where coverage sits so tests run at the layer that's cheapest and most reliable — and steward the end-to-end suite: curate what earns a place in it, and set the standards engineers follow when contributing tests of their own
• Support our move to continuous delivery — design the right level of automated quality controls (pipeline gates, smoke checks, release signals) so we can release frequently without slowing the flow of change
• Use AI tooling as a first-class part of your workflow — test generation, bug triage, test data creation — and keep raising the bar on how the team uses it
• Curate AI-generated tests and findings — decide what to keep, reject, or refine, applying your own testing judgment rather than accepting output wholesale
• Shape how we test AI-powered features — advise on when evals are the right quality control and what they should cover, and contribute adversarial and edge-case scenarios; engineers write and own the evals themselves
• Partner with engineers on acceptance criteria and coach them on designing test scenarios from a user's perspective — positive paths, negative paths, edge cases
• Run exploratory and risk-based testing to find what automation misses, and feed production bugs back into automation at the layer that would have caught them
• Analyse quality workflows — triage, release, escape defects — and drive structural improvements, reporting on quality signals so the squad always knows where quality stands

Your Experience

• 5+ years of QA experience in a SaaS product environment, with automation at the centre of how you work
• Track record of designing test automation frameworks from the ground up — architecture, tooling choices, conventions — and building the JavaScript/TypeScript end-to-end suites (e.g. Playwright, Cypress) that run on them
• Comfortable working in a production codebase — Git, branches, PRs, code review — and able to read code well enough to locate and understand the surface under test
• CI/CD fluent — you understand what runs when and where tests fit, with a clear point of view on the quality controls that make continuous delivery safe: pipeline gates, smoke checks, rollback signals
• Actively using AI tools in your workflow today — and opinions on where they're strong and where they aren't
• Genuine interest in testing AI products: you've thought about (or worked on) how to test non-deterministic systems, and evals excite you rather than scare you
• Strong exploratory testing instincts and sound test-pyramid judgment — you find the bugs automation can't, and you know where automation investment pays off and where it doesn't
• Comfortable with ambiguity, change, and making calls with incomplete information — you're drawn to small teams and early-stage product work
• A genuine focus on the customer outcome, not just the test count

Bonus

• Experience with LLM eval frameworks — golden datasets, judge models, statistical thresholds
• Experience with adversarial testing of AI systems — prompt injection, jailbreaks, hostile inputs
• API testing chops (REST), performance or accessibility testing experience
• Prior start-up or zero-to-one product experience

Our Stack & How We Work

am:pm is built on .NET 8, Vue 3, SQL Server and a growing set of AI services on Microsoft Azure. The squad manages its own DevOps — Terraform for IaC, Azure DevOps for pipelines. We've woven AI tooling deeply into how we work; if you're excited by the idea of testing AI-native software and using AI to test it, you'll fit right in.

Our culture is very important to us too, and we strongly believe in living out our core values:

• People First: One team globally; our people and customers always come first.
• Find a Way: Like a river, we find a way around all obstacles
• Win or Learn: Our journey for improvement never ends; enjoy the ride!
• Aim High: We dare to set big goals and love the challenge of achieving them against the odds.

Why you’ll love working here!

Taking care of you: Including comprehensive health insurance, access to a premium EAP service and an annual wellness allowance to spend on what helps you feel good - whether that’s towards a gym membership, new running shoes, or mindfulness apps.

Support for families: Generous paid parental leave and flexible, family-friendly support designed to help growing families balance work and life with confidence.

Recognition for tenure and milestones: We celebrate time, commitment, and contribution with milestone rewards and additional leave as you grow your career with us.

Flexible working, built for a global team: With customers and teammates across New Zealand, Australia, the United Kingdom, and North America, we work in a hybrid, remote-friendly way with collaborative offices and the flexibility of a balanced approach to WFH/i-office work.

Ready to Level Up?

Join us and help shape the future of real estate at one of the most exciting SaaS companies born from New Zealand.

www.re-leased.com