Senior AI-Driven Quality Engineer (Remote)

Lever, Inc.; Netherlands; Remote; EUR 127,000 - 204,000; Full time

Benefits offered by this job

Remote work

VSOP equity

Home office budget

Flexible time off

Healthcare benefits

Wellbeing support

Professional development budget

Team all-hands

Job summary

Lever, Inc. is seeking a Senior Software Engineer, Quality based in the Netherlands to lead AI-powered testing initiatives.

You will design and operate AI agents supporting test design, execution, maintenance, and failure triage, while shaping evaluation methods for non-deterministic outputs. You'll own testing infrastructure, data, environments, tool interfaces, and guardrails, and collaborate with product teams to ensure testing tools stay relevant and scalable in a fully remote, global

Qualifications

• 5+ years of professional software engineering experience.
• Hands-on experience building and owning test infrastructure or developer tooling.
• Practical experience with LLMs or agent frameworks, including prompt design and non-deterministic outputs.
• Strong understanding of distributed systems and CI at scale.
• Ability to influence engineering teams and drive adoption of tools across teams.

Responsibilities

• Build and operate AI agents across the testing lifecycle (design, generation, maintenance, execution, triage).
• Own infrastructure to enable dependable agent-driven testing (environments, data, interfaces, guardrails, runtimes, cost).
• Establish reliable evaluation methods for agent outputs to trust automated results.
• Apply AI-driven evaluation to non-deterministic AI capabilities in testing the platform.
• Collaborate with product engineering teams to keep testing tools aligned with features.
• Develop reusable testing patterns, tooling, and enablement for engineers to own quality.
• Drive adoption of quality engineering capabilities across non-reporting teams.
• Contribute to system design and continuous improvement of testing infrastructure.

Skills

Java

TypeScript

Python

LLM

Tools

Kubernetes

Helm

Job description

Lever, Inc. is seeking a Senior Software Engineer, Quality based in the Netherlands to lead AI-powered testing initiatives.

You will design and operate AI agents supporting test design, execution, maintenance, and failure triage, while shaping evaluation methods for non-deterministic outputs. You'll own testing infrastructure, data, environments, tool interfaces, and guardrails, and collaborate with product teams to ensure testing tools stay relevant and scalable in a fully remote, global