Data Quality Engineer

EPAM Systems; Coimbatore District; Presencial; INR 1.200.000 - 1.800.000; Jornada completa

Descripción de la vacante

EPAM Systems is hiring a Data Quality Engineer focused on ETL/ELT testing and DWH/DB quality across cloud platforms. You will craft Python- and SQL-driven automation, integrate tests with CI/CD, and partner with stakeholders to keep pipelines accurate.

Responsibilities include implementing automated test scripts, performing full data validation on large datasets, and collaborating with data engineers, analysts, and Scrum teams to define test strategy and data quality standards.

Formación

• 4-6 years of experience in ETL automation and data warehouse testing.
• Strong SQL skills for data validation and reconciliation.
• Hands-on Python for scripting and automation frameworks.

Responsabilidades

• Implement automated test scripts to validate ETL workflows and data pipelines.
• Conduct full data validation and reconciliation on large datasets.
• Partner with data engineers, analysts, and stakeholders to define test strategy.
• Develop reusable, scalable test automation frameworks in Python and SQL.
• Integrate automated tests into CI/CD pipelines to enable continuous testing.
• Assess data transformation logic across Azure, AWS, and GCP.
• Support Agile ceremonies with planning, retrospectives, and grooming.

Conocimientos

ETL automation

SQL data validation

Python scripting

CI/CD tooling

Cloud platforms (Azure/AWS/GCP)

Agile/Scrum

Data quality testing

Herramientas

PyTest

Airflow

Jenkins

Azure DevOps

Descripción del empleo

We are looking for a Data Quality Engineer focused on ETL/ELT testing and DWH/DB quality across cloud platforms. You will craft Python- and SQL-driven automation, integrate tests with CI/CD, and partner with stakeholders to keep pipelines accurate.

Responsibilities

• Implement automated test scripts to validate ETL workflows and end-to-end data pipelines
• Conduct full data validation and reconciliation, including DWH/DB testing on large datasets
• Partner with data engineers, analysts, and stakeholders to define test strategy and meet data quality standards
• Develop reusable, scalable test automation frameworks using Python and SQL
• Connect automated tests into CI/CD pipelines to support continuous testing and delivery
• Assess data transformation logic and completeness across Azure, AWS, and GCP
• Support Agile ceremonies by contributing to planning, retrospectives, and story grooming

Requirements

• 4-6 years of professional experience in ETL automation and testing for Data Warehouse/Data Lake environments
• Strong SQL skills for data validation, reconciliation, and automating quality checks
• Hands-on Python ability for scripting and developing automation frameworks
• Experience with one or more Test Automation Frameworks in a delivery setting
• Exposure to Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), and GCP (BigQuery) cloud data services
• Working knowledge of CI/CD tooling and practices, including Jenkins, Git, and Azure DevOps
• Familiarity with Agile/Scrum processes and team rituals

Nice to have

• Experience using data quality or observability tooling such as Great Expectations or Deequ
• Basic grasp of data governance and metadata management principles
• Cloud platform certifications in Azure, AWS, or GCP are a plus