Senior Software Engineer, AI-Driven Quality & Testing

Lever, Inc.; Colombia; A distancia; COP 479.429.000 - 773.155.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote work-friendly

VSOP equity

Home office budget

Flexible time off

Global healthcare support

Descripción de la vacante

Lever, Inc. is seeking a Senior Software Engineer, Quality in Colombia to build AI-driven testing tools and scalable test infrastructure for a global, fully remote engineering org.

You will design, implement, and operate agents that support test creation, execution, maintenance, and failure triage, while collaborating with product teams to ensure practical coverage and maintainability.

Formación

• 5+ years of professional software engineering experience.
• Hands-on experience building and owning test infrastructure, developer tooling, internal platforms, or comparable systems used by other engineers.
• Practical experience with LLMs or agent frameworks, including prompt and context design, tool use, non-deterministic behavior, and evaluation of AI-generated outputs.
• Strong understanding of distributed systems and continuous integration at scale, including reasoning about concurrency, state, timing, and system reliability.
• Ability to influence engineering teams without direct management authority and demonstrate that you have successfully driven adoption of tools or practices across teams.

Responsabilidades

• Build and operate AI agents across the testing lifecycle, including test design, generation, maintenance, execution, and failure triage.
• Own the infrastructure required to make agent-driven testing dependable, including test environments, test data, tool interfaces, guardrails, runtime management, and cost controls.
• Establish reliable methods for evaluating agent output quality so engineering teams can trust automated results without extensive manual review.
• Apply AI-driven evaluation practices to testing the platform's own non-deterministic and AI-powered capabilities.
• Work closely with product engineering teams as new features are developed to ensure testing tools remain relevant, effective, and grounded in real product needs.
• Develop reusable testing patterns, tooling, and enablement practices that allow engineers to own quality independently.
• Drive adoption of quality engineering capabilities across teams that do not report directly to you.
• Contribute to technical decisions, system design, and continuous improvement of testing infrastructure and engineering practices.

Conocimientos

Java

TypeScript

Python

LLM evaluation

Distributed systems

CI/CD

Agent frameworks

Quality tooling

Herramientas

Kubernetes

Helm

Descripción del empleo

Lever, Inc. is seeking a Senior Software Engineer, Quality in Colombia to build AI-driven testing tools and scalable test infrastructure for a global, fully remote engineering org.

You will design, implement, and operate agents that support test creation, execution, maintenance, and failure triage, while collaborating with product teams to ensure practical coverage and maintainability.