Senior AI QA Engineer (Remote)

Visa Hunt; México; A distancia; MXN 900.000 - 1.300.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Stock options

Remote work options

Flexible working hours

Benefits above the law

Descripción de la vacante

Nexaminds is seeking a Senior Quality Engineer (AI) to lead the validation and quality strategy for AI-powered systems, including Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) applications, and agent-based workflows. The ideal candidate has deep experience in Quality Engineering, AI evaluation, and automated validation frameworks, with a strong understanding of how to measure, monitor, and improve the reliability of non-deterministic AI systems.

Location: MEXICO (Remote).

Formación

• 7+ years in Quality Engineering or related technical discipline with AI/ML exposure.
• Experience designing validation frameworks for non-deterministic systems like LLMs.
• Knowledge of RAG concepts, hallucination detection, and evaluation metrics.

Responsabilidades

• Define and lead the AI validation strategy for LLMs, RAG systems, and agents.
• Build automated validation pipelines integrated into CI/CD.
• Establish evaluation frameworks covering correctness and grounding.
• Design and maintain prompt regression testing to detect quality drift.
• Introduce semantic validation techniques beyond traditional QA.
• Lead production monitoring of AI output quality and set acceptable ranges.
• Collaborate with engineering, AI/ML, and data governance teams.
• Implement AI guardrails and confidence scoring for outputs.
• Create validation checkpoints across multi-step agent pipelines.
• Track quality KPIs such as defect reduction and output consistency.

Conocimientos

Quality Engineering

AI/ML

LLMs

RAG

Prompt engineering

CI/CD pipelines

Node.js

MongoDB

Data governance

Validation frameworks

Herramientas

Claude Code

Claude SDK

Playwright

RestSharp

Descripción del empleo

Nexaminds is seeking a Senior Quality Engineer (AI) to lead the validation and quality strategy for AI-powered systems, including Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) applications, and agent-based workflows. The ideal candidate has deep experience in Quality Engineering, AI evaluation, and automated validation frameworks, with a strong understanding of how to measure, monitor, and improve the reliability of non-deterministic AI systems.

Location: MEXICO (Remote).