Senior Quality Engineer: AI-Powered Testing & Automation

Lever, Inc.; Turkey; Remote; TRY 7,052,000 - 11,373,000; Full time

Benefits offered by this job

Fully remote work

Home office budget

Flexible time off

Healthcare benefits

VSOP equity

Wellbeing support

Retirement plans

Professional development funds

Team gatherings

Diversity & inclusion

Job summary

Lever, Inc. is seeking a Senior Software Engineer in Quality to advance AI-powered testing across a fully remote, international engineering organization.

You will design, build, and operate agents that support test creation, execution, maintenance, evaluation, and failure triage, while shaping how AI-driven testing is evaluated. You will influence product teams and develop reusable tooling, patterns, and practices to enable engineers to own quality, at scale and across non-traditional QA

Qualifications

• 5+ years of professional software engineering experience.
• Hands-on experience building and owning test infrastructure or internal platforms.
• Practical experience with LLMs or agent frameworks, prompt design, tool use, non-deterministic behavior, and evaluation of AI outputs.
• Strong understanding of distributed systems and CI at scale.
• Ability to influence engineering teams without direct management authority.
• Ability to deeply understand the product to build effective quality solutions.
• Strong engineering judgment balancing quality, maintainability, delivery speed and business needs.
• Excellent collaboration and communication in distributed teams.
• Preferred experience with LLM evaluation, open-source software, or developer tooling.
• Experience with Java, TypeScript, or Python, plus Kubernetes and Helm.

Responsibilities

• Build and operate AI agents across the testing lifecycle: design, generation, maintenance, execution, and failure triage.
• Own infrastructure to make agent-driven testing dependable: environments, data, interfaces, guardrails, runtime management, cost controls.
• Establish reliable methods to evaluate agent output quality for trusted automated results.
• Apply AI-driven evaluation to testing of non-deterministic and AI-powered capabilities.
• Collaborate with product engineering to keep testing tools relevant and effective.
• Develop reusable testing patterns, tooling, and enablement practices for engineers to own quality.
• Drive adoption of quality tooling across teams without direct reporting lines.
• Contribute to technical decisions, system design, and continuous improvement of testing infrastructure.

Skills

Software engineering

Test infrastructure

LLMs / agent frameworks

Distributed systems

CI at scale

Cross-team influence

Product understanding

Engineering judgment

Collaboration

Java/TypeScript/Python

Kubernetes & Helm

Open-source tooling

Tools

Kubernetes

Helm

Job description

Lever, Inc. is seeking a Senior Software Engineer in Quality to advance AI-powered testing across a fully remote, international engineering organization.

You will design, build, and operate agents that support test creation, execution, maintenance, evaluation, and failure triage, while shaping how AI-driven testing is evaluated. You will influence product teams and develop reusable tooling, patterns, and practices to enable engineers to own quality, at scale and across non-traditional QA