Data Quality Engineer

EPAM Systems; Gurugram District; On-site; INR 1,200,000 - 1,600,000; Full time

Job summary

EPAM Systems is seeking a Data Quality Engineer to strengthen data reliability by automating tests for ETL/ELT and DWH/DB workflows. You will validate large datasets with SQL and Python, build test automation frameworks, and integrate checks into CI/CD across Azure, AWS, and GCP.

The role requires 4-6 years of ETL automation and data warehouse testing experience, with proficiency in SQL, Python, and at least one test automation framework.

Qualifications

• 4-6 years of ETL automation and data warehouse testing experience
• Strong SQL for automated validations
• Python scripting for test frameworks
• Experience with at least one Test Automation Framework
• Exposure to cloud data services: Azure, AWS, GCP
• Understanding CI/CD with Jenkins, Git, and Azure DevOps
• Agile/Scrum delivery experience

Responsibilities

• Develop and run automated tests that validate ETL workflows and data pipelines
• Perform end-to-end reconciliation and DWH/DB testing across high-volume datasets
• Coordinate with data engineers, analysts, and stakeholders to define test approaches and uphold data quality standards
• Create scalable, reusable Python and SQL-based test automation frameworks
• Embed automated test execution into CI/CD pipelines for continuous testing and delivery
• Verify transformation logic and data completeness across Azure, AWS, and GCP
• Participate in sprint planning, retrospectives, and story grooming as part of Agile ceremonies

Skills

SQL

Python

ETL testing

Data validation

CI/CD practices

Agile/Scrum

Tools

Great Expectations

Deequ

Jenkins

Git

Azure DevOps

BigQuery

Redshift

Job description

We are looking for a Data Quality Engineer to strengthen data reliability through automated testing of ETL/ELT and DWH/DB flows. You will use SQL and Python to validate large datasets, develop test automation frameworks, and connect checks to CI/CD across Azure, AWS, and GCP.

Responsibilities

• Develop and run automated tests that validate ETL workflows and data pipelines
• Perform end-to-end reconciliation and DWH/DB testing across high-volume datasets
• Coordinate with data engineers, analysts, and stakeholders to define test approaches and uphold data quality standards
• Create scalable, reusable Python and SQL-based test automation frameworks
• Embed automated test execution into CI/CD pipelines for continuous testing and delivery
• Verify transformation logic and data completeness across Azure, AWS, and GCP
• Participate in sprint planning, retrospectives, and story grooming as part of Agile ceremonies
  
  

Requirements

• 4-6 years of relevant experience in ETL automation plus Data Warehouse/Data Lake testing
• Proficiency in SQL to create automated validations and support data quality testing
• Working knowledge of Python for scripting and building automation framework components
• Experience using at least one Test Automation Framework
• Exposure to cloud data services, including Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), and GCP (BigQuery)
• Understanding of CI/CD practices and tools such as Jenkins, Git, and Azure DevOps
• Comfort with Agile/Scrum ways of working in delivery teams
  
  

Nice to have

• Hands-on experience with Great Expectations, Deequ, or similar data observability/data quality tools
• Introductory understanding of data governance and metadata management
• Relevant cloud certifications (Azure/AWS/GCP)