GenAI QA Automation Engineer – LLM Testing

Luxoft

United States

A distancia

USD 110.000 - 150.000

Jornada completa

14 días+

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Luxoft is seeking an experienced AI Quality Engineer to design and implement quality strategies for AI-enabled applications, platforms, and services. The role focuses on automated testing, AI model evaluation, and ensuring the accuracy, reliability, safety, and compliance of GenAI, LLM, and ML solutions within enterprise environments.

You will collaborate with product, data science, and engineering teams to define acceptance criteria, produce quality metrics, and govern AI deployments across

Formación

  • 3–5+ years in Quality Engineering or Software Testing, incl. 3+ years in test automation and 2+ years testing AI/ML/GenAI/LLM solutions.
  • Experience designing automated test frameworks and validating AI-generated outputs.
  • Proficiency in Python or Java with knowledge of Agile, SDLC, CI/CD, and Responsible AI principles.
  • Strong analytical, communication, and cross-functional collaboration skills.
  • Experience testing RAG pipelines, chatbots, and LLM-based applications including prompt robustness and model drift.
  • Knowledge of AI evaluation frameworks, MLOps, AI governance, and cloud platforms (Azure, AWS, GCP).
  • Experience in healthcare or regulated environments is preferred.
  • Familiarity with accessibility testing, audit/compliance, and mentoring QA engineers is a plus.

Responsabilidades

  • Design and execute testing strategies for AI/ML, GenAI, LLM, and automation solutions.
  • Develop and maintain automated testing frameworks covering functional, non‑functional, and AI-specific requirements.
  • Evaluate AI-generated outputs for accuracy, reliability, bias, safety, and Responsible AI compliance.
  • Collaborate with engineering, product, data science, and business teams to identify quality risks and acceptance criteria.
  • Produce quality metrics, testing documentation, governance evidence, and deployment/production monitoring recommendations.

Conocimientos

Quality engineering
Test automation
AI/ML testing
GenAI/LLM testing
Python/Java
API testing
CI/CD
Agile/SDLC
Responsible AI

Herramientas

GitHub Copilot
Microsoft 365 Copilot

Descripción del empleo

Luxoft is seeking an experienced AI Quality Engineer to design and implement quality strategies for AI-enabled applications, platforms, and services. The role focuses on automated testing, AI model evaluation, and ensuring the accuracy, reliability, safety, and compliance of GenAI, LLM, and ML solutions within enterprise environments.

You will collaborate with product, data science, and engineering teams to define acceptance criteria, produce quality metrics, and govern AI deployments across

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

AI/ML Quality Engineer — LLM Evaluation & QA Automation
AI/ML Quality Engineer — LLM Evaluation & QA Automation

INSPYR Solutions • Cupertino (CA)

Híbrido
USD 91.000 - 105.000
Remote-friendly schedule
Remote AI QA Engineer for LLMs & Autonomous Agents
Remote AI QA Engineer for LLMs & Autonomous Agents

web • EE. UU.

A distancia
USD 120.000 - 180.000
AI QA Engineer for LLM & GenAI Testing & Automation
AI QA Engineer for LLM & GenAI Testing & Automation

Compunnel Inc. • New York (NY)

Híbrido
USD 140.000 - 190.000
AI Quality Engineer: LLM Testing & Validation
AI Quality Engineer: LLM Testing & Validation

Global Business Ser. 4u Inc. • Plano (TX)

Presencial
USD 120.000 - 180.000
QA Automation Engineer - GenAI / LLM Testing (Healthcare)
QA Automation Engineer - GenAI / LLM Testing (Healthcare)

Luxoft • EE. UU.

A distancia
USD 110.000 - 150.000
Senior AI Test Automation Engineer Frontline AI Quality
Senior AI Test Automation Engineer Frontline AI Quality

Genuine Parts Company • EE. UU.

Presencial
USD 120.000 - 155.000
Senior AI Test Engineer for GenAI & LLM Apps
Senior AI Test Engineer for GenAI & LLM Apps

Anaplan • North Carolina

Híbrido
USD 120.000 - 180.000
QA Automation Engineer, AI & LLM Testing
QA Automation Engineer, AI & LLM Testing

ICE • Atlanta (GA)

Presencial
USD 90.000 - 130.000
QA Automation Engineer - AI & LLM Testing
QA Automation Engineer - AI & LLM Testing

ICE • Jacksonville (FL)

Presencial
USD 85.000 - 110.000
QA Automation Engineer – LLM/AI Testing
QA Automation Engineer – LLM/AI Testing

ICE Clear Europe Limited • Georgia

Presencial
USD 85.000 - 125.000