Senior Test Automation AI Engineer

EPAM Systems; España; Hybrid; PHP 5,084,000 - 7,988,000; Full time

Job summary

EPAM Systems in Madrid is seeking a Senior Test Automation AI Engineer to design, implement and maintain test automation frameworks for an AI/ML platform. You will ensure quality across APIs, UIs, data pipelines and AI-driven solutions in a hybrid work setting in central Madrid.

Join EPAM to shape test automation strategy for enterprise financial services, applying best practices, governance and audit-ready reporting in a dynamic private banking tech environment.

Qualifications

• 5+ years of experience in test automation engineering for enterprise or complex systems.
• Proficient in Python and test frameworks like Playwright, pytest or Behave.
• Strong understanding of best practices, clean coding and maintainable design.
• Hands-on with containerization and Kubernetes in CI/CD environments.
• Familiar with BDD and Gherkin syntax for scenario-based automation.
• Ability to design and execute functional and non-functional tests including performance checks.
• Excellent problem-solving and documentation skills in English.

Responsibilities

• Define and implement test automation framework architecture aligned with enterprise standards.
• Design and develop reusable automated test components for UI and API testing.
• Automate test cases using Python-based frameworks and BDD tools.
• Build AI/ML-specific test cases and evaluation pipelines for model outputs.
• Integrate automated tests into CI/CD pipelines using GitLab.
• Use Docker and Kubernetes for dynamic, reproducible test environments.
• Maintain automation stability and improve reliability, reducing false positives.
• Collaborate with cross-functional teams ensuring traceability from stories to results.
• Produce audit-ready execution evidence and reports per compliance standards.

Skills

Python

Playwright

pytest

Behave

BDD

Gherkin

GitLab CI/CD

Docker

Kubernetes

Test automation basics

English fluency

Tools

GitLab CI/CD

Docker

Kubernetes

Job description

We're looking for a Senior Test Automation AI Engineer to join our team in Madrid, Spain in a hybrid working mode. In this role, you will design, implement and maintain test automation frameworks for an AI and MLOps platform, ensuring quality across APIs, UIs, data pipelines and AI-driven solutions such as LLM-based assistants and ML workflows. This is a hybrid role based in Madrid's city center, which offers the opportunity to shape test automation strategy in a highly innovative environment, applying best practices to support critical business use cases and ensuring compliance with enterprise testing policies and governance requirements. An ideal opportunity for those eager to thrive in a dynamic environment and make a significant impact in private banking technology. Join EPAM and contribute to shaping the future of financial services in Spain!

Responsibilities

• Define and implement test automation framework architecture and patterns aligned with enterprise standards
• Design and develop reusable automated test components for UI and API testing
• Automate test cases using Python-based frameworks such as Playwright, pytest and BDD tools
• Build AI/ML-specific test cases and evaluation pipelines for model outputs
• Integrate automated tests into CI/CD pipelines using GitLab for continuous validation
• Use Docker and Kubernetes for dynamic, reproducible test environments
• Maintain and continuously improve automation stability and reliability, reducing false positives
• Collaborate with cross-functional teams to ensure test alignment and traceability from user stories to results
• Produce audit-ready execution evidence and reports according to compliance standards
• Act as a technical consultant for test automation design and practices within the AI engineering group

Requirements

• 5+ years of experience in test automation engineering focusing on enterprise or complex systems
• Proficiency in Python and experience with test frameworks such as Playwright, pytest or Behave
• Solid understanding of test automation best practices, clean coding and maintainable design patterns
• Hands-on experience with GitLab CI/CD, containerization and Kubernetes environments
• Familiarity with BDD and Gherkin syntax for scenario-based automation
• Ability to design and execute functional and non-functional tests including performance and reliability checks
• Strong problem-solving and analytical skills with quality-driven mindset
• English fluency for collaboration and documentation

Nice to have

• Experience in testing AI/ML systems, MLOps platforms or data pipelines
• Knowledge of contract testing and service virtualization
• Exposure to synthetic data preparation and anonymization techniques
• Familiarity with compliance requirements in regulated industries such as finance