Senior Software Engineer - AI-Driven Quality & Testing

Lever, Inc.; New Zealand; Remote; NZD 255,000 - 411,000; Full time

Benefits offered by this job

Fully remote

Home office budget

Flexible time off

Wellbeing support

Annual company gatherings

Job summary

Lever, Inc. is seeking a Senior Software Engineer, Quality based in New Zealand to advance AI-powered testing.

You will design, build, and operate agents for test creation, execution, maintenance, evaluation, and failure triage, blending software engineering with test infrastructure and AI tooling. You will own the infrastructure for dependable agent-driven testing, collaborate with distributed product teams, and shape evaluation methods for non-deterministic AI capabilities.

Qualifications

• 5+ years of professional software engineering experience.
• Hands-on experience with test infrastructure and tooling.
• Practical experience with LLMs and AI-driven testing.
• Experience with distributed systems and CI at scale.
• Ability to influence engineering teams and drive adoption.

Responsibilities

• Build and operate AI agents for testing lifecycle.
• Own testing infrastructure, environments, data, and guardrails.
• Establish methods to evaluate AI outputs for reliability.
• Apply evaluation practices to AI-powered features.
• Collaborate with product teams to keep tools relevant.
• Develop reusable testing patterns and tooling.
• Drive adoption of quality tooling across teams.
• Contribute to system design and infra improvements.

Skills

5+ years exp

Test infrastructure

LLM frameworks

Distributed systems

CI at scale

Cross-team influence

Java

TypeScript

Python

Tools

Kubernetes

Helm

Job description

Lever, Inc. is seeking a Senior Software Engineer, Quality based in New Zealand to advance AI-powered testing.

You will design, build, and operate agents for test creation, execution, maintenance, evaluation, and failure triage, blending software engineering with test infrastructure and AI tooling. You will own the infrastructure for dependable agent-driven testing, collaborate with distributed product teams, and shape evaluation methods for non-deterministic AI capabilities.