Walk-in | Senior/Lead Data Quality Engineer

EPAM Systems Inc; Gurugram District; Hybrid; INR 800,000 - 1,400,000; Full time

Job summary

EPAM Systems Inc., Gurugram, is seeking a data quality engineer focused on ETL automation and data warehouse testing. The role emphasizes building scalable test frameworks and validating data across large pipelines.

You will collaborate with data engineers and analysts, apply Python and SQL to automate tests, and integrate them into CI/CD pipelines across Azure, AWS, and GCP environments. Fluency in English (B2+) is required.

Qualifications

• Hands-on experience in Data Quality Engineering.
• ETL automation and data warehouse/testing expertise.
• Proficient in SQL for data validation and automation.
• Strong Python scripting for framework development.
• Experience with test automation frameworks and CI/CD.
• Familiar with Azure/AWS/GCP cloud data services.
• English proficiency at B2 level or higher.

Responsibilities

• Design, develop, and execute automated tests for ETL workflows.
• Validate data across data warehouses and data lakes.
• Collaborate with data engineers and analysts to define test strategies.
• Develop reusable test automation frameworks using Python and SQL.
• Integrate tests into CI/CD pipelines for continuous delivery.
• Validate data transformation logic across Azure, AWS, GCP.

Skills

ETL automation

Data quality

SQL

Python

CI/CD

Agile/Scrum

Test automation

Cloud data services

English B2+

Tools

Azure Data Factory

AWS Glue

BigQuery

Jenkins

Git

Azure DevOps

Job description

The ideal candidate will have a strong background in ETL automation, data warehouse testing, and cloud data services, along with hands-on experience in test automation frameworks and CI/CD practices.

Responsibilities

• Design, develop, and execute automated test scripts for validating ETL workflows and data pipelines
• Perform end-to-end data validation, reconciliation, and DWH/DB testing across large datasets
• Collaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are met
• Develop reusable and scalable test automation frameworks using Python and SQL
• Integrate automated tests into CI/CD pipelines to ensure continuous testing and delivery
• Validate data transformation logic and completeness across different cloud platforms (Azure, AWS, GCP)
• Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story grooming

Requirements

• Hands-on experience in Data Quality Engineering
• Strong hands-on experience in ETL automation and Data Warehouse/Data Lake testing
• Proficiency in SQL for data validation and test automation
• Good knowledge of Python for scripting and framework development
• Experience with one or more Test Automation Frameworks
• Knowledge of Cloud Data Services, including Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), or GCP (BigQuery)
• Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps)
• Familiarity with Agile/Scrum methodologies with a proven ability to contribute effectively
• English language proficiency at an Upper-Intermediate level (B2) or higher

Nice to have

• Experience working with data observability or data quality tools (e.g., Great Expectations, Deequ)
• Basic understanding of data governance and metadata management concepts
• Certification in cloud platforms (Azure/AWS/GCP)