Lead AI Memory & Regression Test Engineer

EPAM Systems Inc; United States; Remote; USD 110,000 - 150,000; Full time

Job summary

EPAM Systems Inc seeks a Senior/Lead Automation Tester in Python to own functional and regression test suites for agent memory behavior within an Enterprise Agent Development Platform. You will design and execute tests for short-term and long-term memory, validate memory extraction, and build Python automation for memory workflows on AWS.

Requirements include 3+ years in QA for AI/ML or conversational AI, experience testing stateful agents, API testing, and GDPR-focused validation, with strong

Qualifications

• 3+ years of QA engineering experience in AI/ML or conversational AI systems.
• Experience testing stateful agent behaviors including memory retention.
• Background in functional test automation for API-driven services.
• Knowledge of regression testing methodologies.
• Proficiency in English at a B2+ level.

Responsibilities

• Own functional and regression test suites for agent memory behavior.
• Design and execute tests for short-term and long-term memory across sessions.
• Validate memory extraction to ensure correct facts and preferences are captured.
• Conduct memory retrieval testing to verify relevant context is used.
• Perform memory lifecycle testing (TTL expiration, user deletion, namespace isolation).
• Run agent regression testing to ensure memory quality does not degrade responses.
• Build Python test automation for memory workflows.

Skills

Python

Test automation

QA engineering

AI/ML testing

Memory testing

API testing

Regression testing

English proficiency

Tools

AWS

LangGraph

LangChain

Job description

EPAM Systems Inc seeks a Senior/Lead Automation Tester in Python to own functional and regression test suites for agent memory behavior within an Enterprise Agent Development Platform. You will design and execute tests for short-term and long-term memory, validate memory extraction, and build Python automation for memory workflows on AWS.

Requirements include 3+ years in QA for AI/ML or conversational AI, experience testing stateful agents, API testing, and GDPR-focused validation, with strong