Remote Senior Software Engineer - Quality & AI Testing

Lever, Inc.; Polska; Remote; PLN 554,000 - 893,000; Full time

Benefits offered by this job

Remote work

Home office budget

Flexible time off

VSOP equity

Global gatherings

Job summary

Lever, Inc. is seeking a Senior Software Engineer focused on Quality, based in Poland or remote. You will build AI-powered testing agents, design and operate test infrastructure, and shape evaluation methods for non-deterministic AI capabilities.

You will work within a global, fully remote engineering organization, owning testing tooling, patterns, and practices to elevate product quality at scale.

Qualifications

• 5+ years of professional software engineering experience.
• Hands-on experience with test infrastructure or internal platforms.
• Practical experience with LLMs or agent frameworks, including evaluation practices.
• Strong understanding of distributed systems and CI at scale.
• Ability to influence teams and drive tool adoption across groups.

Responsibilities

• Build and operate AI agents across the testing lifecycle: design, generation, maintenance, execution, and failure triage.
• Own the infrastructure to enable dependable agent-driven testing, including environments, data, interfaces, and cost controls.
• Establish reliable evaluation methods for agent outputs so automated results are trusted.
• Apply AI-driven evaluation to testing of non-deterministic and AI-powered capabilities.
• Collaborate with product engineering to keep testing tools aligned with features and real needs.
• Develop reusable testing patterns, tooling, and enablement for engineers to own quality.
• Drive adoption of quality engineering across teams not directly reporting to you.
• Contribute to system design and improvements of testing infrastructure.

Skills

Software engineering

Distributed systems

CI at scale

LLMs

Agent frameworks

Java

TypeScript

Python

Kubernetes

Helm

Tools

Kubernetes

Helm

Job description

Lever, Inc. is seeking a Senior Software Engineer focused on Quality, based in Poland or remote. You will build AI-powered testing agents, design and operate test infrastructure, and shape evaluation methods for non-deterministic AI capabilities.

You will work within a global, fully remote engineering organization, owning testing tooling, patterns, and practices to elevate product quality at scale.