Senior Quality Engineer - AI Agents & Integrations

Cafeto Software USA, LLC; Bogotá; Presencial; COP 60.000.000 - 100.000.000; Jornada completa

Descripción de la vacante

Cafeto Software USA, LLC seeks a Senior Quality Engineer to strengthen the reliability and correctness of AI-powered billing and collections workflows, including AI agents, integrations, and event-driven processes.

You will define quality for AI-enabled workflows, design and build automated evaluations to detect regressions, and investigate failures across backend services, APIs, and cloud observability to ensure production readiness.

Formación

• Experience with quality engineering for AI-enabled systems and complex, high-consequence workflows.

Responsabilidades

• Define what “good” looks like for AI-enabled workflows and production quality.
• Build automated evaluations that detect meaningful regressions in AI agents, integrations, and workflows.
• Investigate failures across application behavior and cloud evidence to determine root causes.
• Establish confidence as changes move from refinement through production, including observability and monitoring for AI-powered processes.
• Focus on validating AI-agent behavior, financial and operational workflows, and integration points (backend services, APIs, event-driven processes).

Conocimientos

AI QA

AI non-determinism

Observability

Descripción del empleo

Cafeto Software USA, LLC seeks a Senior Quality Engineer to strengthen the reliability and correctness of AI-powered billing and collections workflows, including AI agents, integrations, and event-driven processes.

You will define quality for AI-enabled workflows, design and build automated evaluations to detect regressions, and investigate failures across backend services, APIs, and cloud observability to ensure production readiness.