Data Quality Engineer

EPAM Systems; Chennai District; Sur place; INR 1 500 000 - 2 800 000; Plein temps

Avantages offerts par ce poste

Health benefits

Retirement benefits

Paid time off

LinkedIn Learning access

Learning opportunities

LinkedIn learning access

Résumé du poste

EPAM Systems, Inc. is seeking a Data Quality Engineer (Automation) to join our data engineering team in Chennai. You will design, develop, and execute automated tests for ETL workflows and large-scale data pipelines, ensuring data quality across cloud platforms.

Key focus areas include data validation, DWH testing, and building scalable test frameworks in Python with SQL, integrated into CI/CD pipelines within an Agile environment.

Qualifications

• 4–6 years of hands-on experience in ETL automation and data warehousing testing.
• Proficient in SQL for data validation and test automation.
• Strong Python scripting and framework development experience.
• Experience with one or more Test Automation Frameworks.
• Exposure to Cloud Data Services (Azure, AWS, GCP).
• Understanding of CI/CD tools and practices (Jenkins, Git, Azure DevOps).
• Familiarity with Agile/Scrum methodologies.
• Nice to have experience with data observability or data quality tools such as Great Expectations or Deequ.

Responsabilités

• Design, develop, and execute automated test scripts for ETL workflows and data pipelines.
• Perform end-to-end data validation and DWH/DB testing across large datasets.
• Collaborate with data engineers, analysts, and stakeholders to define test strategies.
• Develop reusable automated test frameworks using Python and SQL and integrate into CI/CD.
• Validate data transformation logic across Azure, AWS, and GCP; participate in Agile ceremonies.
• Validate data transformation logic across Azure, AWS, and GCP platforms.
• Participate in Agile ceremonies and contribute to sprint planning and grooming.

Connaissances

ETL automation

Data Warehouse testing

SQL

Python

CI/CD

Cloud data services

Azure

AWS

GCP

Agile/Scrum

Jenkins

Git

Azure DevOps

Outils

Jenkins

Git

Azure DevOps

Description du poste

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.We are seeking a highly skilled and detail-oriented Data Quality Engineer (Automation) to join our data engineering team.The ideal candidate will have a strong background in ETL automation, data warehouse testing, and cloud data services, along with hands-on experience in test automation frameworks and CI/CD practices.ResponsibilitiesDesign, develop, and execute automated test scripts for validating ETL workflows and data pipelinesPerform end-to-end data validation, reconciliation, and DWH/DB testing across large datasetsCollaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are metDevelop reusable and scalable test automation frameworks using Python and SQLIntegrate automated tests into CI/CD pipelines to ensure continuous testing and deliveryValidate data transformation logic and completeness across different cloud platforms (Azure, AWS, GCP)Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story groomingRequirementsExperience: 4-6 YearsStrong hands-on experience in ETL automation and Data Warehouse/Data Lake testingProficient in SQL for data validation and test automationGood knowledge of Python for scripting and framework developmentExperience with one or more Test Automation FrameworksExposure to Cloud Data Services across major platforms: Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), GCP (BigQuery)Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps)Familiarity with Agile/Scrum methodologiesNice to haveExperience working with data observability or data quality tools (e.g., Great Expectations, Deequ)Basic understanding of data governance and metadata management conceptsCertification in cloud platforms (Azure/AWS/GCP) is a plusWe offerOpportunity to work on technical challenges that may impact across geographiesVast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certificationsOpportunity to share your ideas on international platformsSponsored Tech Talks & HackathonsUnlimited access to LinkedIn learning solutionsPossibility to relocate to any EPAM office for short and long-term projectsFocused individual developmentBenefit package:Health benefitsRetirement benefitsPaid time offFlexible benefitsForums to explore beyond work passion (CSR, photography, painting, sports, etc.)