Senior AI/ML Test Automation Engineer

Juliusbaer

Madrid

On-site

EUR 60,000 - 100,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Julius Baer is seeking a Senior Test Automation Engineer to lead the automation strategy for the ML & AI ART. You will own architecture and hands-on delivery of tests for APIs, UIs, data pipelines, and AI/ML components, collaborating with ML engineers, data engineers, and product teams.

You will design scalable patterns, implement tests with Python, and drive QA in GitLab CI/CD environments, ensuring traceability, reproducibility, and audit-ready artefacts across dev-to-prod environments.

Qualifications

  • Proven expertise in Python-based test automation and framework ownership.
  • Hands-on experience in CI/CD pipelines and test data management.
  • Experience with UI and API automation using Playwright-Python and pytest.
  • Strong knowledge of BDD/Gherkin and contract testing concepts.

Responsibilities

  • Define and evolve the technical test automation approach and framework architecture.
  • Automate identified test cases using Python-based frameworks and maintain test data builders.
  • Integrate automated tests in GitLab CI/CD pipelines and ensure reliable test execution.
  • Design and implement AI/ML-specific test cases for LLM outputs and RAG workflows.
  • Maintain contract tests (e.g., Pact) for API boundaries and microservices.
  • Collaborate with Product Owners, ML/AI engineers, and QA teams for test strategy alignment.

Skills

Python-based testing
Playwright-Python
Gherkin/BDD
CI/CD
API testing
Docker
Kubernetes basics
Jira QA integration
Test framework design
English fluency

Education

BSc or MSc in CS/Engineering

Tools

Git
Allure
pytest
Xray

Job description

Julius Baer is seeking a Senior Test Automation Engineer to lead the automation strategy for the ML & AI ART. You will own architecture and hands-on delivery of tests for APIs, UIs, data pipelines, and AI/ML components, collaborating with ML engineers, data engineers, and product teams.

You will design scalable patterns, implement tests with Python, and drive QA in GitLab CI/CD environments, ensuring traceability, reproducibility, and audit-ready artefacts across dev-to-prod environments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI/ML Test Automation Engineer
Senior AI/ML Test Automation Engineer

Julius Baer Group • Madrid

On-site
EUR 55,000 - 75,000
Senior AI/ML Test Automation Architect
Senior AI/ML Test Automation Architect

Bank Julius Bär & Co. Ltd. • Madrid

On-site
EUR 85,000 - 110,000
AI Integration & Automation Engineer
AI Integration & Automation Engineer

Dreamwork • Madrid

On-site
EUR 55,000 - 90,000
AI Test Automation Engineer 100% (f/m/d)
AI Test Automation Engineer 100% (f/m/d)

Julius Baer Group • Madrid

On-site
EUR 55,000 - 75,000
Automation Platform Engineer – Test & DevOps
Automation Platform Engineer – Test & DevOps

Julius Baer Group • Madrid

On-site
EUR 55,000 - 85,000
AI Platform Engineer – Secure, Scalable DevOps for AI
AI Platform Engineer – Secure, Scalable DevOps for AI

Julius Baer Group • Madrid

On-site
EUR 55,000 - 90,000
AI Test Automation Engineer 100% (f/m/d)
AI Test Automation Engineer 100% (f/m/d)

Juliusbaer • Madrid

On-site
EUR 60,000 - 100,000
Senior QA Automation Engineer – Playwright & API
Senior QA Automation Engineer – Playwright & API

Julius Baer Group • Madrid

On-site
EUR 55,000 - 75,000
Senior Test Automation Engineer 100% (f/m/d)
Senior Test Automation Engineer 100% (f/m/d)

Bank Julius Bär & Co. Ltd. • Madrid

On-site
EUR 85,000 - 110,000
Senior QA Automation Engineer – UI/API Testing Lead
Senior QA Automation Engineer – UI/API Testing Lead

Julius Baer Group • Madrid

On-site
EUR 60,000 - 90,000