Senior AI/ML Test Automation Architect

Bank Julius Bär & Co. Ltd.; Madrid; On-site; EUR 85,000 - 110,000; Full time

Job summary

Julius Baer invites a Senior Test Automation Engineer to join the ML & AI ART in Madrid. You will own architecture, design, and execution of automated tests across APIs, UIs, and data pipelines supporting AI/ML platforms in a regulated financial environment.

The role requires hands-on Python with Playwright, API testing, and strong collaboration with ML engineers and product teams. You will implement scalable test patterns, drive CI/CD test integration, and ensure robust test data handling while

Qualifications

• 5–7 years in test automation, preferably in regulated environments
• Strong Python experience with Playwright for UI and API validation
• Experience with CI/CD pipelines and test management tools
• Exposure to AI/ML testing is a plus

Responsibilities

• Define and evolve the test automation framework architecture for the ML & AI ART
• Automate tests across UI, API, and data pipelines using Python-based tools
• Build contract tests (e.g. Pact) for APIs and microservices
• Integrate tests in GitLab CI/CD or similar pipelines
• Manage test data, including synthetic or anonymised datasets
• Design AI/ML-specific test cases for evaluating LLM outputs
• Maintain end-to-end traceability from Jira to tests and defects

Skills

Python

Test automation

CI/CD

Framework design

English communication

Education

Bachelor's or Master's in Computer Science/Engineering

Tools

Playwright-Python

Requests + pytest

Behave/pytest-bdd

Docker

Kubernetes

Jira

Git

Xray

Job description

Julius Baer invites a Senior Test Automation Engineer to join the ML & AI ART in Madrid. You will own architecture, design, and execution of automated tests across APIs, UIs, and data pipelines supporting AI/ML platforms in a regulated financial environment.

The role requires hands-on Python with Playwright, API testing, and strong collaboration with ML engineers and product teams. You will implement scalable test patterns, drive CI/CD test integration, and ensure robust test data handling while