AI Engineer: Cloud QA & Claude AI Pipelines

Konfio MX; México; On-site; MXN 520,000 - 980,000; Full time

Job summary

Konfio MX is seeking an AI/QA Engineer to transform Kyveria, our internal QA tool, into a production-grade AWS service. You will leverage Claude to automate quality evaluation of customer interactions across chat, contact center, and Salesforce, delivering daily, data-driven feedback to CX and BPOs.

You’ll migrate workflows to AWS, build direct data integrations, design evaluation pipelines, and iterate prompts and rubrics based on hard data, partnering with CX teams to translate user needs into

Qualifications

• 3+ years of backend development in production environments using Python or TypeScript.
• Strong SQL skills, data modeling, and external API integration.
• Cloud & DevOps experience with Git, CI/CD, and AWS (EC2/S3/Secrets Manager).
• Desirable: Salesforce Service Cloud, Amazon Connect, n8n, Postgres, QA operations.

Responsibilities

• Platform Migration: Migrate the current workflow into a scalable AWS production service with separate dev and prod environments.
• Data Integration: Build direct integrations to read customer interactions from sources (Salesforce Service Cloud, Amazon Connect, chat) with proper data retention.
• AI Quality Evaluation: Design and operate evaluation pipelines using Claude, manage prompts and rubrics with cost/version tracking.
• Evals & Continuous Improvement: Build automated evaluations to measure AI against human reviewers; iterate prompts and rubrics from data.
• Business Collaboration: Work daily with CX team and BPOs to provide actionable feedback per agent and translate needs into improvements.

Skills

Backend development

Python

TypeScript

SQL

AWS

CI/CD

Prompt engineering

Claude

LLM evaluations

Tools

Salesforce Service Cloud

Amazon Connect

n8n

PostgreSQL

Job description

Konfio MX is seeking an AI/QA Engineer to transform Kyveria, our internal QA tool, into a production-grade AWS service. You will leverage Claude to automate quality evaluation of customer interactions across chat, contact center, and Salesforce, delivering daily, data-driven feedback to CX and BPOs.

You’ll migrate workflows to AWS, build direct data integrations, design evaluation pipelines, and iterate prompts and rubrics based on hard data, partnering with CX teams to translate user needs into