Senior AI Developer (Automators)

Luxoft; Mexico; On-site; PHP 1,200,000 - 1,800,000; Full time

Job summary

Luxoft designs and implements AI-powered testing and QA solutions, focusing on automated failure triage, CBT test selection, and AI-driven test case generation. The role emphasizes building Lambda-based services, integrating with CI/CD pipelines, and maintaining robust AI guardrails.

You will work with AWS Bedrock, Claude, and modern LLM tooling to deliver high-quality automated testing capabilities across Android TV platforms and Jira/Confluence integrations.

Qualifications

• Experience designing and operating AI agents with agentic workflows, rules, and multi-tool orchestration.
• End-to-end RAG pipeline implementation including chunking, embedding, indexing, retrieval, and generation.
• Proficiency in prompt engineering (zero-shot, few-shot, JSON mode).
• Knowledge of vector databases and embedding strategies.
• Experience with LLM orchestration tools (LangChain, LangGraph, or LlamaIndex).
• Strong Python skills for Lambda functions and data processing.
• Hands-on Java for test automation and CI/CD scripting.
• Experience with ReportPortal or equivalent test reporting tool.

Responsibilities

• Design and implement AI-powered testing and QA pipelines.
• Triage and resolve test failures using ReportPortal and AI-assisted insights.
• Develop AWS Lambda functions and REST endpoints to integrate AI into CI/CD.
• Drive continuous evaluation of LLM solution accuracy and guardrails.
• Participate in Kanban ceremonies and PI planning with ART teams.
• Present AI demos to stakeholders and leadership.
• Document AI architecture, RAG pipelines, and tooling in Confluence.

Skills

AI agents

RAG pipeline

Prompt engineering

LLM orchestration

Embeddings

Python

Java

ReportPortal

REST API

Jenkins CI/CD

Docker

Android TV

QTM4J

OpenSearch

Tools

AWS Bedrock

Claude

Cursor IDE

MCP

LangChain

Pinecone

Faiss

OpenSearch

Job description

Design and implement AI-powered solutions focused on:

Automated test failure triage — LLM + RAG pipeline classifying ReportPortal failures (logs, stack traces, screenshots) into structured categories (PRODUCT_BUG, AUTOMATION_BUG, SYSTEM_ISSUE) using AWS Bedrock + Claude

AI-based Change-Based Testing (CBT) — LLM-driven test case selection using semantic similarity between code changes and test coverage

AI test case generation from feature specs, Jira tickets, and Confluence documentation

Develop AWS Lambda functions (Python 3.12) and API Gateway REST endpoints to integrate AI capabilities into CI/CD pipelines

Apply prompt engineering best practices (system prompts, structured JSON output, guardrails) and drive continuous evaluation of LLM solution accuracy

Use Cursor IDE with MCP integrations, agentic workflows, and context/rules files to accelerate test code generation and maintenance

Write, maintain, and expand automated test suites in Java (Appium / UiAutomator2) for Android TV platforms

Develop and maintain functional, regression, NFR, and CBT test suites

Triage and resolve test failures in ReportPortal; integrate AI triage results with QMetry (QTM4J)

Support CI/CD pipeline health — participate in Nightly Build, RC, and release automation runs via Jenkins

Contribute to framework codebase improvements — bug fixes, refactoring, enhancements

Participate in Kanban ceremonies and PI planning under the ART team

Present AI solution demos to stakeholders and engineering leadership

Document AI system architecture, RAG pipelines, and tools in Confluence

Skills Must have:

AI agents & Agentic tooling — practical knowledge of designing and operating AI agents, including agentic workflows, reusable skills, rules/guardrails, commands, and multi-tool/multi-agent orchestration

RAG pipeline — end-to-end implementation: chunking, embedding, vector indexing, retrieval, generation

Prompt engineering — zero-shot, few-shot, chain-of-thought, structured output (JSON mode), multi-turn

Vector databases — working knowledge of OpenSearch, Pinecone, or Faiss; understands vector vs. graph DB difference

Fine-tuning vs. RAG — ability to reason through which approach fits a given problem

LLM orchestration — LangChain, LangGraph, or LlamaIndex

Embeddings — understands semantic similarity; experience with Amazon Titan Embed or equivalent

Python — for Lambda functions, AI pipeline scripting, and data processing

Java — 3+ years of hands-on test automation development

ReportPortal or equivalent test reporting tool

REST API — concepts and hands-on usage

Jenkins / CI-CD — pipeline debugging and integration

Docker — containerized test execution environments.

Nice to have:

Cursor IDE advanced features — .cursorrules, memory-bank context files, MCP server integration, and agentic triage workflows

Android TV platforms — STB / embedded device testing experience (Fire TV, Roku, or similar)

QMetry (QTM4J) — test management integrated with Jira

Streamlit — for building internal AI dashboards

DSPy — programmatic prompt optimization

AWS SageMaker / MLflow — model evaluation and experiment tracking