Data QA Lead – ETL & Databricks

Wipro Technologies; Quincy (MA); On-site; USD 60,000 - 135,000; Full time

Benefits offered by this job

Medical and dental benefits

Paid time off

Equal employment opportunity

Job summary

Wipro Limited is seeking a QA Engineer to join our data testing team. The role focuses on validating large-scale data pipelines and Databricks-based workloads, with emphasis on HDFS, Hive, YARN, and Delta Lake. Strong SQL skills and ETL testing experience are required.

The ideal candidate will build automated tests, integrate with Git and CI/CD pipelines, and work across AWS/Azure/GCP cloud platforms to ensure data quality and reliability in production environments.

Qualifications

• Strong foundational knowledge of HDFS, Hive, YARN, MapReduce and traditional data warehousing concepts.
• Hands-on experience testing data within the Databricks platform, including Delta Lake storage, Unity Catalog, and Databricks Notebooks.
• Advanced SQL proficiency (writing complex joins, aggregations, and window functions).
• Familiarity with version control (Git) and CI/CD pipelines to integrate testing into data deployment workflows.

Responsibilities

• Build, maintain, and scale automated testing scripts using Python, Scala, or specialized data testing tools.
• Test data within Databricks platforms and ensure data quality across pipelines and deployments.

Skills

HDFS

Hive

YARN

MapReduce

ETL testing

SQL proficiency

Tools

Git

Azure DevOps

Jenkins

GitHub Actions

Job description

Wipro Limited is seeking a QA Engineer to join our data testing team. The role focuses on validating large-scale data pipelines and Databricks-based workloads, with emphasis on HDFS, Hive, YARN, and Delta Lake. Strong SQL skills and ETL testing experience are required.

The ideal candidate will build automated tests, integrate with Git and CI/CD pipelines, and work across AWS/Azure/GCP cloud platforms to ensure data quality and reliability in production environments.