Senior Data Quality Engineer

EPAM Systems; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

EPAM Systems in Bengaluru seeks a highly skilled Data Quality Engineer (Automation) to strengthen our data engineering team. The role emphasizes ETL automation, data warehouse testing, and cloud data services, with hands-on test automation and CI/CD practices.

The candidate will design and execute automated tests for ETL workflows, perform end-to-end data validation, and collaborate with data engineers to define test strategies in an Agile environment.

Qualifications

• 5.5+ years of experience in data quality engineering or related field.
• Strong hands-on experience in ETL automation and data warehouse testing.
• Proficient in SQL for data validation and test automation.
• Good knowledge of Python for scripting and framework development.
• Experience with one or more test automation frameworks.
• Exposure to Cloud Data Services across major platforms (Azure, AWS, GCP).
• Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps).
• Familiarity with Agile/Scrum methodologies.

Responsibilities

• Design, develop, and execute automated test scripts for validating ETL workflows and data pipelines.
• Perform end-to-end data validation, reconciliation, and DWH/DB testing across large datasets.
• Collaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are met.
• Develop reusable and scalable test automation frameworks using Python and SQL.
• Integrate automated tests into CI/CD pipelines to ensure continuous testing and delivery.
• Validate data transformation logic across cloud platforms (Azure, AWS, GCP).
• Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story grooming.

Skills

ETL automation

Data Warehouse testing

SQL

Python scripting

Test automation frameworks

CI/CD

Cloud data services

Agile/Scrum

Tools

Jenkins

Git

Azure DevOps

Job description

We are seeking a highly skilled and detail-oriented Data Quality Engineer (Automation) to join our data engineering team.

The ideal candidate will have a strong background in ETL automation, data warehouse testing, and cloud data services, along with hands-on experience in test automation frameworks and CI/CD practices.

Responsibilities

• Design, develop, and execute automated test scripts for validating ETL workflows and data pipelines
• Perform end-to-end data validation, reconciliation, and DWH/DB testing across large datasets
• Collaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are met
• Develop reusable and scalable test automation frameworks using Python and SQL
• Integrate automated tests into CI/CD pipelines to ensure continuous testing and delivery
• Validate data transformation logic and completeness across different cloud platforms (Azure, AWS, GCP)
• Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story grooming

Requirements

• Experience: 5.5 + Years
• Strong hands-on experience in ETL automation and Data Warehouse/Data Lake testing
• Proficient in SQL for data validation and test automation
• Good knowledge of Python for scripting and framework development
• Experience with one or more Test Automation Frameworks
• Exposure to Cloud Data Services across major platforms
• Azure (ADF, ADB)
• AWS (Glue, Lambda, Redshift)
• GCP (BigQuery)
• Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps)
• Familiarity with Agile/Scrum methodologies

Nice to have

• Experience working with data observability or data quality tools (e.g., Great Expectations, Deequ)
• Basic understanding of data governance and metadata management concepts
• Certification in cloud platforms (Azure/AWS/GCP) is a plus