AI Engineer: Cloud QA & Generative AI (Claude)

Quona Capital; Ecatepec de Morelos; On-site; MXN 450,000 - 700,000; Full time

Job summary

Quona Capital is seeking a talented engineer to transform Kyveria, our internal QA tool, into a production-grade AWS service. You will automate quality evaluation of customer interactions across channels using Claude, delivering daily, data-driven feedback to the CX team and external BPOs.

You will migrate workflows from n8n/spreadsheets, build direct data integrations (Salesforce Service Cloud, Amazon Connect, chat), and design robust evaluation pipelines with versioned prompts and cost-aware

Qualifications

• Experience designing and writing evaluations for LLMs.
• Backend development experience in production with Python or TypeScript.
• Strong SQL skills and data modeling.
• Experience with AWS at developer level.
• Familiarity with Salesforce Service Cloud, Amazon Connect, n8n, and Postgres is a plus.

Responsibilities

• Migrate and build production-grade AWS service for Kyveria.
• Read customer interactions from Salesforce, Amazon Connect, chat sources.
• Design evaluation pipelines using Claude and manage prompts.
• Develop automated evals to measure AI against human reviewers.
• Collaborate with CX team and BPOs to provide actionable feedback.

Skills

Claude

Prompt Engineering

LLM evaluations

Backend development

SQL

Tools

Salesforce Service Cloud

Amazon Connect

n8n

PostgreSQL

AWS

Job description

Quona Capital is seeking a talented engineer to transform Kyveria, our internal QA tool, into a production-grade AWS service. You will automate quality evaluation of customer interactions across channels using Claude, delivering daily, data-driven feedback to the CX team and external BPOs.

You will migrate workflows from n8n/spreadsheets, build direct data integrations (Salesforce Service Cloud, Amazon Connect, chat), and design robust evaluation pipelines with versioned prompts and cost-aware