Senior AI Automation Tester - Python & GenAI Clinical Apps

EPAM Systems, Inc.; Polska; Hybrid; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Health insurance

Hybrid by design

Relocation opportunities

Employee Stock Purchase Plan

Job summary

EPAM Systems, Inc. is seeking a Senior Automation Tester in Python to develop automated test frameworks for AI-powered clinical applications.

You will validate non-deterministic AI outputs and ensure GxP compliance through IQ/OQ/PQ qualification, working across Safety, Regulatory, Clinical Operations, and SAGE tooling. The role emphasizes building test strategies, integrating tests into CI/CD, and collaborating with data scientists and backend developers to define acceptance criteria and

Qualifications

• 5+ years of hands-on QA/test automation experience.
• Experience building automated test suites from scratch.
• Knowledge of CI/CD test integration and quality gates.

Responsibilities

• Build automated test frameworks from scratch for AI-powered clinical apps using Playwright, Selenium, and pytest.
• Design and execute test strategies for non-deterministic AI outputs, including accuracy and prompt regression.
• Integrate automated tests into CI/CD pipelines with block-on-failure and coverage thresholds.
• Execute IQ/OQ/PQ scripts and generate qualification evidence packages.
• Collaborate with Data Scientists and Backend Developers to define testable acceptance criteria.

Skills

Python

Test automation

API testing

CI/CD

AI/GenAI testing

Playwright

Selenium

Cypress

pytest

Jenkins

GitHub Actions

Postman/Newman

Locust

Tools

Playwright

Selenium

Cypress

pytest

Jenkins

GitHub Actions

Postman/Newman

Job description

EPAM Systems, Inc. is seeking a Senior Automation Tester in Python to develop automated test frameworks for AI-powered clinical applications.

You will validate non-deterministic AI outputs and ensure GxP compliance through IQ/OQ/PQ qualification, working across Safety, Regulatory, Clinical Operations, and SAGE tooling. The role emphasizes building test strategies, integrating tests into CI/CD, and collaborating with data scientists and backend developers to define acceptance criteria and