AI Engineer: Claude-Driven QA & AWS Platform Leader

Konfío; Quintana Roo; On-site; MXN 480,000 - 840,000; Full time

Job summary

Konfío in Mexico's Quintana Roo is seeking an experienced Backend Engineer to transform Kyveria, our internal QA tool, into a production-grade AWS service. You will automate quality evaluation of customer interactions across chat, contact center, and Salesforce, delivering daily, data-driven feedback to CX teams and BPOs.

You will design scalable data pipelines, migrate workflows to AWS, integrate Salesforce Service Cloud and other sources, and tune prompts and rubrics with Claude to improve

Qualifications

• Experience with Claude and advanced prompt engineering.
• 3+ years backend development in production environments (Python or TypeScript).
• Strong SQL skills, data modeling, and experience integrating with external APIs.
• Developer-level AWS experience (EC2, S3, Secrets Manager) and DevOps basics.
• Desirable: Salesforce Service Cloud, Amazon Connect, n8n, PostgreSQL; QA/CC background.

Responsibilities

• Platform Migration: Migrate current workflow into a scalable AWS service with separate development and production environments.
• Data Integration: Read customer interactions from sources (Salesforce Service Cloud, Amazon Connect, chat) and ensure data retention.
• AI Quality Evaluation: Design and operate evaluation pipelines using Claude, manage prompts and rubrics, track costs and model versions.
• Evals & Continuous Improvement: Build automated evaluations to measure AI consistency against humans, iterate prompts and rubrics.
• Business Collaboration: Work daily with CX team and BPOs to generate actionable feedback per agent and translate needs into tech improvements.

Skills

Claude / Prompt Eng.

Backend (Python/TS)

SQL & Data modeling

AWS / DevOps

LLM Evaluation

Tools

Salesforce Service Cloud

Amazon Connect

n8n

PostgreSQL

Job description

Konfío in Mexico's Quintana Roo is seeking an experienced Backend Engineer to transform Kyveria, our internal QA tool, into a production-grade AWS service. You will automate quality evaluation of customer interactions across chat, contact center, and Salesforce, delivering daily, data-driven feedback to CX teams and BPOs.

You will design scalable data pipelines, migrate workflows to AWS, integrate Salesforce Service Cloud and other sources, and tune prompts and rubrics with Claude to improve