Data Quality Engineer

Epam Systems; Hyderabad, Chennai District, Bengaluru; In loco; INR 900.000 - 1.300.000; Tempo pieno

Descrizione del lavoro

Epam Systems in Hyderabad seeks a Data Quality Engineer focused on ETL/ELT testing and DWH/DB quality across cloud platforms. You will craft Python- and SQL-driven automation, integrate tests with CI/CD, and partner with stakeholders to ensure pipelines remain accurate.

Responsibilities include validating ETL workflows, performing full data validation on large datasets, and developing reusable test frameworks.

Competenze

• Strong SQL for data validation and reconciliation
• Hands-on Python for scripting automated tests
• Experience with ETL/ELT testing in DWH/Data Lake environments

Mansioni

• Implement automated test scripts to validate ETL workflows and data pipelines
• Perform full data validation and reconciliation for DWH/DB across large datasets
• Collaborate with data engineers and analysts to define test strategy and data quality standards
• Develop reusable test automation frameworks using Python and SQL
• Integrate tests into CI/CD pipelines to enable continuous testing and delivery
• Evaluate data transformation logic across Azure, AWS, and GCP
• Support Agile ceremonies with planning and grooming activities

Conoscenze

SQL

Python

ETL testing

Data quality

CI/CD

Git

Azure

AWS

GCP

Strumenti

Jenkins

Git

Azure DevOps

Descrizione del lavoro

We are looking for a Data Quality Engineer focused on ETL/ELT testing and DWH/DB quality across cloud platforms. You will craft Python- and SQL-driven automation, integrate tests with CI/CD, and partner with stakeholders to keep pipelines accurate.

Responsibilities

• Implement automated test scripts to validate ETL workflows and end-to-end data pipelines
• Conduct full data validation and reconciliation, including DWH/DB testing on large datasets
• Partner with data engineers, analysts, and stakeholders to define test strategy and meet data quality standards
• Develop reusable, scalable test automation frameworks using Python and SQL
• Connect automated tests into CI/CD pipelines to support continuous testing and delivery
• Assess data transformation logic and completeness across Azure, AWS, and GCP
• Support Agile ceremonies by contributing to planning, retrospectives, and story grooming

Requirements

• 4-6 years of professional experience in ETL automation and testing for Data Warehouse/Data Lake environments
• Strong SQL skills for data validation, reconciliation, and automating quality checks
• Hands-on Python ability for scripting and developing automation frameworks
• Experience with one or more Test Automation Frameworks in a delivery setting
• Exposure to Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), and GCP (BigQuery) cloud data services
• Working knowledge of CI/CD tooling and practices, including Jenkins, Git, and Azure DevOps
• Familiarity with Agile/Scrum processes and team rituals

Nice to have

• Experience using data quality or observability tooling such as Great Expectations or Deequ
• Basic grasp of data governance and metadata management principles
• Cloud platform certifications in Azure, AWS, or GCP are a plus