Data Quality Engineer - Senior / Lead

Epam Systems; Chennai; Hybride; INR 1 200 000 - 2 100 000; Plein temps

Résumé du poste

Epam Systems is seeking a Data Quality Engineer focused on ETL/ELT testing and DWH/DB quality across cloud platforms. You will craft Python- and SQL-driven automation, integrate tests with CI/CD, and partner with stakeholders to keep pipelines accurate.

Responsibilities include implementing automated test scripts for ETL workflows, validating large data sets, and building reusable test frameworks while aligning with Azure, AWS and GCP services.

Qualifications

• 5 to 14 years of experience in ETL automation and testing for Data Warehouse/Data Lake environments
• Strong SQL skills for data validation and automating quality checks; Python for scripting
• Experience with one or more Test Automation Frameworks and cloud platforms (Azure, AWS, GCP)

Responsabilités

• Implement automated test scripts to validate ETL workflows and data pipelines
• Conduct full data validation and reconciliation for DWH/DB testing
• Partner with data engineers, analysts, and stakeholders to define test strategy
• Develop reusable, scalable test automation frameworks using Python and SQL
• Connect automated tests into CI/CD pipelines for continuous testing and delivery
• Collaborate with stakeholders to assess data transformation logic across cloud services
• Support Agile ceremonies by contributing to planning, retrospectives, and story grooming

Connaissances

SQL for data validation

Python scripting

Test automation frameworks

CI/CD tooling

Agile/Scrum

Outils

Jenkins

Git

Azure DevOps

BigQuery

Azure Data Factory

Description du poste

We are looking for a Data Quality Engineer focused on ETL/ELT testing and DWH/DB quality across cloud platforms. You will craft Python- and SQL-driven automation, integrate tests with CI/CD, and partner with stakeholders to keep pipelines accurate.

Responsibilities

• Implement automated test scripts to validate ETL workflows and end-to-end data pipelines
• Conduct full data validation and reconciliation, including DWH/DB testing on large datasets
• Partner with data engineers, analysts, and stakeholders to define test strategy and meet data quality standards
• Develop reusable, scalable test automation frameworks using Python and SQL
• Connect automated tests into CI/CD pipelines to support continuous testing and delivery
• Assess data transformation logic and completeness across Azure, AWS, and GCP
• Support Agile ceremonies by contributing to planning, retrospectives, and story grooming
  

Requirements

5 to 14 years years of professional experience in ETL automation and testing for Data Warehouse/Data Lake environments

• Strong SQL skills for data validation, reconciliation, and automating quality checks
• Hands-on Python ability for scripting and developing automation frameworks
• Experience with one or more Test Automation Frameworks in a delivery setting
• Exposure to Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), and GCP (BigQuery) cloud data services
• Working knowledge of CI/CD tooling and practices, including Jenkins, Git, and Azure DevOps
• Familiarity with Agile/Scrum processes and team rituals
  

Nice to have

• Experience using data quality or observability tooling such as Great Expectations or Deequ
• Basic grasp of data governance and metadata management principles
• Cloud platform certifications in Azure, AWS, or GCP are a plus