AI Quality Engineer | Automated Testing for GenAI & LLM

Luxoft; United States; Remoto; USD 110.000 - 170.000; Tempo pieno

Descrizione del lavoro

Luxoft seeks an experienced AI Quality Engineer to shape quality strategies for AI-enabled applications, platforms, and services in healthcare environments. The role emphasizes automated testing, AI model evaluation, and ensuring safety, reliability, and compliance of GenAI, LLM, and ML solutions across enterprise ecosystems.

You will develop automated testing frameworks, collaborate with product, data science, and engineering teams, and contribute to governance, documentation, and production

Competenze

• 3–5+ years of experience in Quality Engineering, Quality Assurance, or Software Testing.
• 3+ years in test automation development and 2+ years testing AI, machine learning, Generative AI, LLM, or intelligent automation solutions.
• Strong experience designing automated test frameworks, validating AI-generated outputs, and performing API, integration, and data testing.

Mansioni

• Design and execute comprehensive testing strategies for AI/ML, GenAI, LLM, and intelligent automation solutions. Develop and maintain automated testing frameworks covering functional, non-functional, and AI-specific requirements. Evaluate AI-generated outputs for accuracy, reliability, consistency, bias, fairness, safety, and Responsible AI compliance. Collaborate with engineering, product, data science, and business teams to identify quality risks and establish acceptance criteria.

Conoscenze

Quality engineering

Test automation

AI / ML testing

Generative AI / LLM testing

Python / Java

API testing

Integration testing

Data validation

Responsible AI

AI model evaluation

Test framework development

CI/CD

Agile / SDLC

Descrizione del lavoro

Luxoft seeks an experienced AI Quality Engineer to shape quality strategies for AI-enabled applications, platforms, and services in healthcare environments. The role emphasizes automated testing, AI model evaluation, and ensuring safety, reliability, and compliance of GenAI, LLM, and ML solutions across enterprise ecosystems.

You will develop automated testing frameworks, collaborate with product, data science, and engineering teams, and contribute to governance, documentation, and production