Senior Python Automation Tester for AI-Driven Clinical Apps

EPAM Systems Inc; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

EPAM Systems is seeking a Senior Automation Tester in Python to join Production Pods. This role focuses on automated test frameworks for AI/GenAI-powered clinical applications, validating non-deterministic AI outputs, and ensuring GxP compliance through IQ/OQ/PQ qualification.

You will design tests across Safety, Regulatory, Clinical Operations, and SAGE platform tooling, and collaborate with data scientists and backend developers to define acceptance criteria.

Qualifications

• 5+ years hands-on QA/test automation experience.
• Experience building automated test suites from scratch for AI-powered apps.
• Experience with AI/GenAI validation, GxP awareness, IQ/OQ/PQ.

Responsibilities

• Build automated test frameworks from scratch for AI-powered clinical apps using Playwright, Selenium, and pytest.
• Design and execute test strategies for non-deterministic AI outputs, including accuracy and prompt regression.
• Integrate automated tests into CI/CD pipelines with gatekeeping and coverage thresholds.
• Execute GxP-compliant IQ/OQ/PQ scripts and compile qualification evidence packages.
• Manage AI-specific test data, including edge cases and golden datasets.
• Monitor model drift and performance over time; document test plans and evidence.
• Collaborate with Data Scientists and Backend Developers to define testable acceptance criteria.

Skills

Playwright

Selenium

Cypress

pytest

Python

CI/CD

API testing

REST APIs

Tools

Jira/Xray

TestRail

Zephyr

Postman/Newman

Jenkins

GitHub Actions

Job description

EPAM Systems is seeking a Senior Automation Tester in Python to join Production Pods. This role focuses on automated test frameworks for AI/GenAI-powered clinical applications, validating non-deterministic AI outputs, and ensuring GxP compliance through IQ/OQ/PQ qualification.

You will design tests across Safety, Regulatory, Clinical Operations, and SAGE platform tooling, and collaborate with data scientists and backend developers to define acceptance criteria.