Data Quality Engineer

EPAM Systems; Coimbatore District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

EPAM Systems seeks a Data Quality Engineer focused on ETL/ELT testing and DWH/DB quality across cloud platforms. You will craft Python- and SQL-driven automation, integrate tests with CI/CD, and partner with stakeholders to keep pipelines accurate.

Responsibilities include validating ETL workflows, data reconciliation, and developing scalable test frameworks for Azure, AWS, and GCP environments in an Agile setting.

Qualifications

• 4-6 years of professional ETL automation and data warehouse testing experience.
• Strong SQL skills for data validation and automated quality checks.
• Hands-on Python for scripting and automation framework development.
• Experience with at least one Test Automation Framework in delivery settings.
• Exposure to Azure, AWS, and GCP data services.
• Knowledge of CI/CD practices with Jenkins, Git, and Azure DevOps.
• Familiarity with Agile/Scrum methodologies.
• Nice-to-have: experience with Great Expectations or Deequ.
• Nice-to-have: cloud platform certifications in Azure, AWS, or GCP.

Responsibilities

• Implement automated tests to validate ETL workflows and end-to-end data pipelines.
• Conduct full data validation and reconciliation in DWH/DB on large datasets.
• Define test strategy with data engineers and stakeholders to ensure data quality.
• Develop reusable, scalable test automation frameworks using Python and SQL.
• Connect automated tests into CI/CD pipelines to enable continuous testing and delivery.
• Assess data transformation logic and completeness across Azure, AWS, and GCP.
• Support Agile ceremonies with planning, retrospectives, and story grooming.

Skills

SQL

Python

ETL testing

CI/CD

Agile/Scrum

Test automation framework

Cloud platforms (Azure, AWS, GCP)

Jenkins

Git

Azure DevOps

Tools

Great Expectations

Deequ

Job description

We are looking for a Data Quality Engineer focused on ETL/ELT testing and DWH/DB quality across cloud platforms. You will craft Python- and SQL-driven automation, integrate tests with CI/CD, and partner with stakeholders to keep pipelines accurate.

Responsibilities

• Implement automated test scripts to validate ETL workflows and end-to-end data pipelines
• Conduct full data validation and reconciliation, including DWH/DB testing on large datasets
• Partner with data engineers, analysts, and stakeholders to define test strategy and meet data quality standards
• Develop reusable, scalable test automation frameworks using Python and SQL
• Connect automated tests into CI/CD pipelines to support continuous testing and delivery
• Assess data transformation logic and completeness across Azure, AWS, and GCP
• Support Agile ceremonies by contributing to planning, retrospectives, and story grooming

Requirements

• 4-6 years of professional experience in ETL automation and testing for Data Warehouse/Data Lake environments
• Strong SQL skills for data validation, reconciliation, and automating quality checks
• Hands-on Python ability for scripting and developing automation frameworks
• Experience with one or more Test Automation Frameworks in a delivery setting
• Exposure to Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), and GCP (BigQuery) cloud data services
• Working knowledge of CI/CD tooling and practices, including Jenkins, Git, and Azure DevOps
• Familiarity with Agile/Scrum processes and team rituals

Nice to have

• Experience using data quality or observability tooling such as Great Expectations or Deequ
• Basic grasp of data governance and metadata management principles
• Cloud platform certifications in Azure, AWS, or GCP are a plus