Senior Data Quality Engineer

EPAM Systems; Chennai District; On-site; INR 900,000 - 1,300,000; Full time

Job summary

EPAM Systems in Chennai is seeking a highly skilled Data Quality Engineer (Automation) to join our data engineering team. You will design, develop, and execute automated tests for ETL workflows and validate data quality across large datasets.

The ideal candidate will have strong Python scripting, SQL proficiency, and hands-on experience with test automation frameworks and CI/CD practices across Azure, AWS, and GCP.

Qualifications

• 5.5+ years of experience in data quality testing and ETL automation.
• Proficient in SQL for data validation and test automation.
• Hands-on Python scripting for framework development.
• Experience with at least one test automation framework.
• Exposure to cloud data services on Azure, AWS, or GCP.
• Familiar with CI/CD practices and version control.

Responsibilities

• Design, develop, and execute automated test scripts for ETL workflows.
• Perform end-to-end data validation and DWH testing on large datasets.
• Collaborate with data engineers, analysts, and stakeholders on test strategies.
• Develop reusable test automation frameworks using Python and SQL.
• Integrate automated tests into CI/CD pipelines for continuous testing.
• Validate data transformation across Azure, AWS, and GCP.
• Participate in Agile ceremonies and sprint planning.

Skills

ETL automation

Data Warehousing testing

SQL for data validation

Python scripting

Test automation frameworks

CI/CD

Agile/Scrum

Cloud platforms

Azure

AWS

GCP

Tools

Jenkins

Git

Azure DevOps

Job description

We are seeking a highly skilled and detail-oriented Data Quality Engineer (Automation) to join our data engineering team.

The ideal candidate will have a strong background in ETL automation, data warehouse testing, and cloud data services, along with hands-on experience in test automation frameworks and CI/CD practices.

Responsibilities

• Design, develop, and execute automated test scripts for validating ETL workflows and data pipelines
• Perform end-to-end data validation, reconciliation, and DWH/DB testing across large datasets
• Collaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are met
• Develop reusable and scalable test automation frameworks using Python and SQL
• Integrate automated tests into CI/CD pipelines to ensure continuous testing and delivery
• Validate data transformation logic and completeness across different cloud platforms (Azure, AWS, GCP)
• Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story grooming

Requirements

• Experience: 5.5 + Years
• Strong hands-on experience in ETL automation and Data Warehouse/Data Lake testing
• Proficient in SQL for data validation and test automation
• Good knowledge of Python for scripting and framework development
• Experience with one or more Test Automation Frameworks
• Exposure to Cloud Data Services across major platforms
• Azure (ADF, ADB)
• AWS (Glue, Lambda, Redshift)
• GCP (BigQuery)
• Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps)
• Familiarity with Agile/Scrum methodologies

Nice to have

• Experience working with data observability or data quality tools (e.g., Great Expectations, Deequ)
• Basic understanding of data governance and metadata management concepts
• Certification in cloud platforms (Azure/AWS/GCP) is a plus