AI Quality Engineer – MCP & LLM Testing

EPAM Systems; Greater London; On-site; GBP 60,000 - 85,000; Full time

Benefits offered by this job

ESPP

Life protection & income protection

Private medical insurance & dental

Employee Assistance Program

Pension plan

Job summary

EPAM Systems in London is seeking a Quality Engineer to join onsite, focusing on AI-driven enterprise projects and Model Context Protocol integration. You will develop automated testing frameworks, evaluation pipelines, and quality controls for MCP components within our AI platform.

You will work in a Classic Agile environment to guarantee reliability, accuracy, and performance of agent-driven workflows in enterprise-scale systems, defining testing standards for AI models and tools in

Qualifications

• Experience in quality engineering for AI-enabled platforms.
• Familiarity with test automation frameworks and evaluation pipelines.
• Understanding of Agile delivery and CI/CD integration for quality checks.

Responsibilities

• Develop automated testing frameworks for MCP components and AI systems.
• Design evaluation strategies for LLM accuracy, safety, and reliability.
• Create automated tests using Python and Pytest; apply BDD approaches.
• Implement quality gates in CI/CD pipelines to ensure ongoing quality.
• Collaborate with engineers, QA, and product teams to define quality metrics.

Skills

QA automation mindset

Agile collaboration

CI/CD awareness

LLM evaluation concepts

Problem solving

Tools

Python

Pytest

Behave / Cucumber

Job description

EPAM Systems in London is seeking a Quality Engineer to join onsite, focusing on AI-driven enterprise projects and Model Context Protocol integration. You will develop automated testing frameworks, evaluation pipelines, and quality controls for MCP components within our AI platform.

You will work in a Classic Agile environment to guarantee reliability, accuracy, and performance of agent-driven workflows in enterprise-scale systems, defining testing standards for AI models and tools in