Senior Test Automation AI Engineer

EPAM Systems; Madrid; Hybrid; EUR 70,000 - 100,000; Full time

Benefits offered by this job

Private health insurance

EPAM Employees Stock Purchase Plan

100% paid sick leave

Referral Program

Professional certification

Language courses

Job summary

EPAM Systems in Madrid, Spain, is seeking a Senior Test Automation AI Engineer to design, implement and maintain test automation frameworks for an AI and MLOps platform in a hybrid role based in Madrid’s city center.

You will automate UI and API tests, build AI/ML-specific test cases, and integrate tests into GitLab CI/CD with Docker and Kubernetes environments. English fluency required for collaboration and documentation.

Qualifications

• 5+ years of experience in test automation engineering for complex systems.
• Proficiency in Python and test frameworks like Playwright, pytest or Behave.
• Knowledge of test automation best practices and clean coding patterns.
• Experience with CI/CD (GitLab), containers and Kubernetes.

Responsibilities

• Define and implement test automation framework architecture and patterns aligned with enterprise standards.
• Design and develop reusable automated test components for UI and API testing.
• Automate test cases using Python-based frameworks such as Playwright, pytest and BDD tools.
• Build AI/ML-specific test cases and evaluation pipelines for model outputs.
• Integrate automated tests into CI/CD pipelines using GitLab for continuous validation.
• Use Docker and Kubernetes for dynamic, reproducible test environments.
• Maintain and continuously improve automation stability and reliability, reducing false positives.
• Collaborate with cross-functional teams to ensure test alignment and traceability from user stories to results.
• Produce audit-ready execution evidence and reports according to compliance standards.
• Act as a technical consultant for test automation design and practices within the AI engineering group.

Skills

Python

Playwright

pytest

Behave

BDD

Gherkin

English fluency

Tools

GitLab CI/CD

Docker

Kubernetes

Job description

We're looking for a Senior Test Automation AI Engineer to join our team in Madrid, Spain in a hybrid working mode. In this role, you will design, implement and maintain test automation frameworks for an AI and MLOps platform, ensuring quality across APIs, UIs, data pipelines and AI-driven solutions such as LLM-based assistants and ML workflows.

This is a hybrid role based in Madrid's city center, which offers the opportunity to shape test automation strategy in a highly innovative environment, applying best practices to support critical business use cases and ensuring compliance with enterprise testing policies and governance requirements. An ideal opportunity for those eager to thrive in a dynamic environment and make a significant impact in private banking technology. Join EPAM and contribute to shaping the future of financial services in Spain!

Responsibilities

• Define and implement test automation framework architecture and patterns aligned with enterprise standards
• Design and develop reusable automated test components for UI and API testing
• Automate test cases using Python-based frameworks such as Playwright, pytest and BDD tools
• Build AI/ML-specific test cases and evaluation pipelines for model outputs
• Integrate automated tests into CI/CD pipelines using GitLab for continuous validation
• Use Docker and Kubernetes for dynamic, reproducible test environments
• Maintain and continuously improve automation stability and reliability, reducing false positives
• Collaborate with cross-functional teams to ensure test alignment and traceability from user stories to results
• Produce audit-ready execution evidence and reports according to compliance standards
• Act as a technical consultant for test automation design and practices within the AI engineering group

Requirements

• 5+ years of experience in test automation engineering focusing on enterprise or complex systems
• Proficiency in Python and experience with test frameworks such as Playwright, pytest or Behave
• Solid understanding of test automation best practices, clean coding and maintainable design patterns
• Hands-on experience with GitLab CI/CD, containerization and Kubernetes environments
• Familiarity with BDD and Gherkin syntax for scenario-based automation
• Ability to design and execute functional and non-functional tests including performance and reliability checks
• Strong problem-solving and analytical skills with quality-driven mindset
• English fluency for collaboration and documentation

Nice to have

• Experience in testing AI/ML systems, MLOps platforms or data pipelines
• Knowledge of contract testing and service virtualization
• Exposure to synthetic data preparation and anonymization techniques
• Familiarity with compliance requirements in regulated industries such as finance

We offer

• Private health insurance
• EPAM Employees Stock Purchase Plan
• 100% paid sick leave
• Referral Program
• Professional certification
• Language courses

EPAM is a leading digital transformation services and product engineering company with 61,700+ EPAMers in 55+ countries and regions. Since 1993, our multidisciplinary teams have been helping make the future real for our clients and communities around the world. In 2018, we opened an office in Spain that quickly grew to over 1,450 EPAMers distributed between the offices in Málaga, Madrid and Cáceres as well as remotely across the country. Here you will collaborate with multinational teams, contribute to numerous innovative projects, and have an opportunity to learn and grow continuously.

Why Join EPAM

• WORK AND LIFE BALANCE. Enjoy more of your personal time with flexible work options, 24 working days of annual leave and paid time off for numerous public holidays.
• CONTINUOUS LEARNING CULTURE. Craft your personal Career Development Plan to align with your learning objectives. Take advantage of internal training, mentorship, sponsored certifications and LinkedIn courses.
• CLEAR AND DIFFERENT CAREER PATHS. Grow in engineering or managerial direction to become a People Manager, in-depth technical specialist, Solution Architect, or Project/Delivery Manager.
• STRONG PROFESSIONAL COMMUNITY. Join a global EPAM community of highly skilled experts and connect with them to solve challenges, exchange ideas, share expertise and make friends.