QA Lead - Data Platform with Snowflake, Databricks

Compunnel Inc.

Atlanta (GA)

On-site

USD 120,000 - 160,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Compunnel, Inc. in Atlanta area is seeking a QA Lead – Enterprise Data Platform to be the hands-on technical authority for the offshore QA team.

You will direct testing across Snowflake, Databricks, and Azure Data Factory, establish data quality standards, and own the automation roadmap with Python-based tests and SQL validations. You will partner with the Onshore Team Lead on prioritization, delivery, and stakeholder communication, mentoring senior QA engineers and driving improvements in data

Qualifications

  • 5–8 years in QA/data testing with leadership exposure.
  • Hands-on testing data pipelines on Snowflake, Databricks, Azure Data Factory.
  • Advanced SQL skills with complex queries.
  • Python for test automation using pytest, pandas, Great Expectations.
  • Experience with Azure DevOps or CI/CD tools for automated tests.
  • Knowledge of ELT/ETL, schema evolution, data reconciliation.
  • Experience leading RCA and cross-team communication.

Responsibilities

  • Define the technical testing strategy across Snowflake, Databricks, and Azure Data Factory, including data quality frameworks, validation patterns, and test data management approaches.
  • Establish and enforce QA standards, best practices, and reusable accelerators, including test harnesses, validation libraries, and SQL templates.
  • Provide technical oversight on test design for functional and regression testing, schema evolution, source-to-target validation, reconciliation, and backfill/reprocessing verification.
  • Lead complex root cause analysis for data quality incidents, including impact assessment, and coordinate resolution with data engineering teams.
  • Own the automation roadmap and review and approve Python-based test scripts, SQL-based validations, and DevOps pipeline integrations using Azure DevOps.
  • Mentor Senior QA Engineers, Automation QA Engineers, and QA Engineers/Testers and perform code and test case reviews.
  • Partner with the Onshore Team Lead on sprint planning, capacity, risk identification, and stakeholder communication.
  • Monitor data quality KPIs, dashboards, and alerts and drive continuous improvement initiatives based on trends and incident patterns.
  • Support schema changes, backward compatibility analysis, and impact assessment for upstream and downstream consumers.

Skills

QA/testing
Python automation
SQL
Azure DevOps / CI/CD
Data warehousing concepts

Tools

Snowflake
Databricks
Azure Data Factory
PySpark

Job description

Job Summary
The QA Lead – Enterprise Data Platform is the hands-on technical authority for the offshore QA team. This role owns the technical direction for testing across Snowflake, Databricks, and Azure Data Factory, establishes standards for test design and automation, and serves as the primary technical escalation point for complex data quality issues, schema changes, and root cause analysis. The QA Lead partners closely with the Onshore Team Lead on prioritization, delivery, and stakeholder communication.

Key Responsibilities
• Define the technical testing strategy across Snowflake, Databricks, and Azure Data Factory, including data quality frameworks, validation patterns, and test data management approaches.
• Establish and enforce QA standards, best practices, and reusable accelerators, including test harnesses, validation libraries, and SQL templates.
• Provide technical oversight on test design for functional and regression testing, schema evolution, source-to-target validation, reconciliation, and backfill/reprocessing verification.
• Lead complex root cause analysis for data quality incidents, including impact assessment, and coordinate resolution with data engineering teams.
• Own the automation roadmap and review and approve Python-based test scripts, SQL-based validations, and DevOps pipeline integrations using Azure DevOps.
• Mentor Senior QA Engineers, Automation QA Engineers, and QA Engineers/Testers and perform code and test case reviews.
• Partner with the Onshore Team Lead on sprint planning, capacity, risk identification, and stakeholder communication.
• Monitor data quality KPIs, dashboards, and alerts and drive continuous improvement initiatives based on trends and incident patterns.
• Support schema changes, backward compatibility analysis, and impact assessment for upstream and downstream consumers.

Required Qualifications
• 5–8 years of QA/data testing experience, with at least 2 years in a technical lead or senior individual contributor capacity.
• Strong hands-on experience testing data pipelines on Snowflake, Databricks (PySpark/SQL), and Azure Data Factory.
• Advanced SQL skills, including complex joins, window functions, reconciliation queries, and performance-aware query writing.
• Proficiency in Python for test automation, including frameworks such as pytest and libraries such as pandas, Great Expectations, or equivalent.
• Experience with Azure DevOps or equivalent CI/CD tools for automated test execution, pipeline integration, and reporting.
• Solid understanding of data warehousing concepts, ELT/ETL patterns, schema evolution, slowly changing dimensions, and data reconciliation.
• Demonstrated experience leading root cause analysis (RCA) for data incidents and communicating findings to technical and business stakeholders.
• Strong written and verbal communication skills with the ability to work across onshore and offshore time zones.

Preferred Qualifications
• Experience with data quality tools such as Great Expectations, Soda, Monte Carlo, or Collibra DQ.
• Exposure to data governance, lineage, and metadata management tooling.
• Experience with Git-based workflows, code reviews, and trunk-based development practices.

Certifications
• Azure certifications such as DP-203 or AZ-400.
• Snowflake or Databricks certifications.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

QA Lead - Enterprise Data Platform
QA Lead - Enterprise Data Platform

Compunnel Inc. • Atlanta (GA)

On-site
USD 120,000 - 160,000
QA lead
QA lead

TechDigital Group • St. Louis (MO)

On-site
USD 100,000 - 160,000
Data Quality Lead (Microsoft Azure / Power BI) Hybrid - Farmington, CT or Morristown, NJ
Data Quality Lead (Microsoft Azure / Power BI) Hybrid - Farmington, CT or Morristown, NJ

Arch Capital • Farmington (CT)

Hybrid
USD 120,000 - 180,000
QA Analyst
QA Analyst

Valiant Technologies LLC • Okemos (MI)

On-site
USD 58,000 - 86,000
QA Analyst
QA Analyst

Quantum Technologies LLC • Okemos (MI)

On-site
USD 70,000 - 110,000
QA Manager – Data Warehouse Testing
QA Manager – Data Warehouse Testing

3Core Systems, Inc • United States

Remote
USD 96,000 - 165,000
Lead Snowflake Data Engineer
Lead Snowflake Data Engineer

TechDigital Group • Rosemont (IL)

On-site
USD 120,000 - 145,000
Lead QA Resource - Platform Governance & Security Testing Specialist
Lead QA Resource - Platform Governance & Security Testing Specialist

Themesoft Inc. • Fort Mill (SC)

On-site
USD 90,000 - 120,000
Data QA Lead
Data QA Lead

Tata Consultancy Services Limited • San Ramon (CA)

On-site
USD 110,000 - 130,000
206754 - QA Lead
206754 - QA Lead

Orioninnovation • United States

Remote
USD 120,000 - 170,000