Data Quality Engineer - Senior / Lead

Epam Systems; Hyderabad; Hybrid; INR 1,600,000 - 2,800,000; Full time

Job summary

Epam Systems in Hyderabad is seeking a Senior/Lead Data Quality Engineer focused on ETL/ELT testing and DWH/DB quality across cloud platforms. You will craft Python- and SQL-driven automation, integrate tests with CI/CD, and partner with stakeholders to keep pipelines accurate.

Responsibilities include implementing automated test scripts for ETL workflows, validating data on large datasets, and developing scalable frameworks in Python/SQL.

Qualifications

• 4-12 years of professional experience in ETL automation and testing for Data Warehouse/Data Lake environments.
• Strong SQL skills for data validation, reconciliation, and automating quality checks.
• Hands-on Python ability for scripting and developing automation frameworks.
• Experience with one or more Test Automation Frameworks in a delivery setting.
• Exposure to Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), and GCP (BigQuery) cloud data services.
• Working knowledge of CI/CD tooling and practices, including Jenkins, Git, and Azure DevOps.
• Familiarity with Agile/Scrum processes and team rituals.

Responsibilities

• Implement automated test scripts to validate ETL workflows and end-to-end data pipelines.
• Conduct full data validation and reconciliation, including DWH/DB testing on large datasets.
• Partner with data engineers, analysts, and stakeholders to define test strategy and meet data quality standards.
• Develop reusable, scalable test automation frameworks using Python and SQL.
• Connect automated tests into CI/CD pipelines to support continuous testing and delivery.
• Assess data transformation logic and completeness across Azure, AWS, and GCP.
• Support Agile ceremonies by contributing to planning, retrospectives, and story grooming.

Skills

ETL testing

SQL data validation

Python scripting

CI/CD

Test automation frameworks

Cloud platforms (Azure/AWS/GCP)

Agile/Scrum practices

Tools

Jenkins

Git

Azure DevOps

Job description

We are looking for a Data Quality Engineer (Senior / Lead) focused on ETL/ELT testing and DWH/DB quality across cloud platforms. You will craft Python- and SQL-driven automation, integrate tests with CI/CD, and partner with stakeholders to keep pipelines accurate.

Responsibilities

• Implement automated test scripts to validate ETL workflows and end-to-end data pipelines
• Conduct full data validation and reconciliation, including DWH/DB testing on large datasets
• Partner with data engineers, analysts, and stakeholders to define test strategy and meet data quality standards
• Develop reusable, scalable test automation frameworks using Python and SQL
• Connect automated tests into CI/CD pipelines to support continuous testing and delivery
• Assess data transformation logic and completeness across Azure, AWS, and GCP
• Support Agile ceremonies by contributing to planning, retrospectives, and story grooming

Requirements

• 4-12 years of professional experience in ETL automation and testing for Data Warehouse/Data Lake environments
• Strong SQL skills for data validation, reconciliation, and automating quality checks
• Hands‑on Python ability for scripting and developing automation frameworks
• Experience with one or more Test Automation Frameworks in a delivery setting
• Exposure to Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), and GCP (BigQuery) cloud data services
• Working knowledge of CI/CD tooling and practices, including Jenkins, Git, and Azure DevOps
• Familiarity with Agile/Scrum processes and team rituals

Nice to have

• Experience using data quality or observability tooling such as Great Expectations or Deequ
• Basic grasp of data governance and metadata management principles
• Cloud platform certifications in Azure, AWS, or GCP are a plus