AI Platform QA Automation Engineer (Python)

EPAM Systems; Greater London; On-site; GBP 65,000 - 90,000; Full time

Benefits offered by this job

ESPP

Private medical insurance

Dental care

Employee Assistance Program

Pension plan

CycleScheme

Techscheme

Season ticket loans

In-office lunches

Massages

Job summary

EPAM Systems in London is seeking a Python QA Automation Engineer to join an onsite team, contributing to an AI-driven enterprise project. You will develop automated testing frameworks and evaluation pipelines for MCP components within our AI platform, ensuring robust quality and compliance across intelligent automation solutions.

You will work with engineering and product teams in a Classic Agile environment to guarantee reliability and performance of agent-driven workflows in enterprise-scale

Qualifications

• Strong programming experience in Python applied to test automation and evaluation.
• Expertise in Pytest and familiarity with BDD frameworks such as Behave or Cucumber.
• Knowledge of LLM evaluation approaches and AI testing concepts.
• Experience in testing AI workflows, distributed systems, or microservices.

Responsibilities

• Develop automated testing frameworks to validate MCP Servers and AI systems.
• Design evaluation strategies for AI model accuracy, safety, and reliability.
• Create automated tests using Python, Pytest, and BDD frameworks; integrate into CI/CD.
• Collaborate with engineering, QA and product teams to define quality metrics and acceptance criteria.
• Maintain documentation for test cases, evaluation pipelines, and validation strategies.

Skills

Python programming

Test automation

Agile delivery

Communication

Tools

Pytest

Behave/Cucumber

CI/CD

Containers

Job description

EPAM Systems in London is seeking a Python QA Automation Engineer to join an onsite team, contributing to an AI-driven enterprise project. You will develop automated testing frameworks and evaluation pipelines for MCP components within our AI platform, ensuring robust quality and compliance across intelligent automation solutions.

You will work with engineering and product teams in a Classic Agile environment to guarantee reliability and performance of agent-driven workflows in enterprise-scale