Senior Test Automation AI Engineer

EPAM Systems; Madrid; On-site; EUR 70,000 - 110,000; Full time

Benefits offered by this job

Private health insurance

EPAM Employee stock purchase plan

Paid sick leave

Referral program

Professional certifications

Language courses

Job summary

EPAM Systems, Inc. in Madrid is seeking a Senior Test Automation AI Engineer to design, implement and maintain scalable test automation frameworks for AI/ML platforms, APIs, UIs and data pipelines in a hybrid work setting.

You will automate using Python with Playwright and pytest, integrate tests into GitLab CI/CD, and build AI/ML test cases, while collaborating with cross-functional teams to ensure traceability and audit-ready evidence.

Qualifications

• 5+ years of experience in test automation engineering for enterprise or complex systems.
• Strong Python proficiency and experience with Playwright/pytest/Behave.
• Solid understanding of test automation best practices and maintainable design.

Responsibilities

• Define and implement test automation framework architecture aligned with enterprise standards.
• Design and develop reusable automated test components for UI and API testing.
• Automate test cases using Python-based frameworks (Playwright, pytest, Behave) and BDD tools.
• Build AI/ML-specific test cases and evaluation pipelines for model outputs.
• Integrate automated tests into CI/CD pipelines using GitLab for continuous validation.
• Use Docker and Kubernetes to create dynamic, reproducible test environments.
• Maintain and improve automation stability, reducing false positives.
• Collaborate with cross-functional teams to ensure traceability from user stories to results.
• Produce audit-ready execution evidence and reports per compliance standards.

Skills

Test automation

Python

BDD

English

Tools

Playwright

pytest

Behave

GitLab CI/CD

Docker

Kubernetes

Gherkin

Job description

We're looking for a Senior Test Automation AI Engineer to join our team in Madrid, Spain in a hybrid working mode. In this role, you will design, implement and maintain test automation frameworks for an AI and MLOps platform, ensuring quality across APIs, UIs, data pipelines and AI-driven solutions such as LLM-based assistants and ML workflows.This is a hybrid role based in Madrid's city center, which offers the opportunity to shape test automation strategy in a highly innovative environment, applying best practices to support critical business use cases and ensuring compliance with enterprise testing policies and governance requirements. An ideal opportunity for those eager to thrive in a dynamic environment and make a significant impact in private banking technology. Join EPAM and contribute to shaping the future of financial services in Spain!ResponsibilitiesDefine and implement test automation framework architecture and patterns aligned with enterprise standardsDesign and develop reusable automated test components for UI and API testingAutomate test cases using Python-based frameworks such as Playwright, pytest and BDD toolsBuild AI/ML-specific test cases and evaluation pipelines for model outputsIntegrate automated tests into CI/CD pipelines using GitLab for continuous validationUse Docker and Kubernetes for dynamic, reproducible test environmentsMaintain and continuously improve automation stability and reliability, reducing false positivesCollaborate with cross-functional teams to ensure test alignment and traceability from user stories to resultsProduce audit-ready execution evidence and reports according to compliance standardsAct as a technical consultant for test automation design and practices within the AI engineering groupRequirements5+ years of experience in test automation engineering focusing on enterprise or complex systemsProficiency in Python and experience with test frameworks such as Playwright, pytest or BehaveSolid understanding of test automation best practices, clean coding and maintainable design patternsHands-on experience with GitLab CI/CD, containerization and Kubernetes environmentsFamiliarity with BDD and Gherkin syntax for scenario-based automationAbility to design and execute functional and non-functional tests including performance and reliability checksStrong problem-solving and analytical skills with quality-driven mindsetEnglish fluency for collaboration and documentationNice to haveExperience in testing AI/ML systems, MLOps platforms or data pipelinesKnowledge of contract testing and service virtualizationExposure to synthetic data preparation and anonymization techniquesFamiliarity with compliance requirements in regulated industries such as financeWe offerPrivate health insuranceEPAM Employees Stock Purchase Plan100% paid sick leaveReferral ProgramProfessional certificationLanguage coursesEPAM is a leading digital transformation services and product engineering company with 61,700+ EPAMers in 55+ countries and regions. Since 1993, our multidisciplinary teams have been helping make the future real for our clients and communities around the world. In 2018, we opened an office in Spain that quickly grew to over 1,450 EPAMers distributed between the offices in Málaga, Madrid and Cáceres as well as remotely across the country. Here you will collaborate with multinational teams, contribute to numerous innovative projects, and have an opportunity to learn and grow continuously.Why Join EPAMWORK AND LIFE BALANCE. Enjoy more of your personal time with flexible work options, 24 working days of annual leave and paid time off for numerous public holidays.CONTINUOUS LEARNING CULTURE. Craft your personal Career Development Plan to align with your learning objectives. Take advantage of internal training, mentorship, sponsored certifications and LinkedIn courses.CLEAR AND DIFFERENT CAREER PATHS. Grow in engineering or managerial direction to become a People Manager, in-depth technical specialist, Solution Architect, or Project/Delivery Manager.STRONG PROFESSIONAL COMMUNITY. Join a global EPAM community of highly skilled experts and connect with them to solve challenges, exchange ideas, share expertise and make friends.