Senior AI Test Automation Architect

Luxoft; Mexico; On-site; PHP 1,200,000 - 1,800,000; Full time

Job summary

Luxoft designs and implements AI-powered testing and QA solutions, focusing on automated failure triage, CBT test selection, and AI-driven test case generation. The role emphasizes building Lambda-based services, integrating with CI/CD pipelines, and maintaining robust AI guardrails.

You will work with AWS Bedrock, Claude, and modern LLM tooling to deliver high-quality automated testing capabilities across Android TV platforms and Jira/Confluence integrations.

Qualifications

• Experience designing and operating AI agents with agentic workflows, rules, and multi-tool orchestration.
• End-to-end RAG pipeline implementation including chunking, embedding, indexing, retrieval, and generation.
• Proficiency in prompt engineering (zero-shot, few-shot, JSON mode).
• Knowledge of vector databases and embedding strategies.
• Experience with LLM orchestration tools (LangChain, LangGraph, or LlamaIndex).
• Strong Python skills for Lambda functions and data processing.
• Hands-on Java for test automation and CI/CD scripting.
• Experience with ReportPortal or equivalent test reporting tool.

Responsibilities

• Design and implement AI-powered testing and QA pipelines.
• Triage and resolve test failures using ReportPortal and AI-assisted insights.
• Develop AWS Lambda functions and REST endpoints to integrate AI into CI/CD.
• Drive continuous evaluation of LLM solution accuracy and guardrails.
• Participate in Kanban ceremonies and PI planning with ART teams.
• Present AI demos to stakeholders and leadership.
• Document AI architecture, RAG pipelines, and tooling in Confluence.

Skills

AI agents

RAG pipeline

Prompt engineering

LLM orchestration

Embeddings

Python

Java

ReportPortal

REST API

Jenkins CI/CD

Docker

Android TV

QTM4J

OpenSearch

Tools

AWS Bedrock

Claude

Cursor IDE

MCP

LangChain

Pinecone

Faiss

OpenSearch

Job description

Luxoft designs and implements AI-powered testing and QA solutions, focusing on automated failure triage, CBT test selection, and AI-driven test case generation. The role emphasizes building Lambda-based services, integrating with CI/CD pipelines, and maintaining robust AI guardrails.

You will work with AWS Bedrock, Claude, and modern LLM tooling to deliver high-quality automated testing capabilities across Android TV platforms and Jira/Confluence integrations.