Senior Quality Engineering Manager – Data & Analytics
Location: Remote
Experience: 12+ Years
Position Overview
We are seeking an experienced Senior Quality Engineering Manager to lead enterprise Quality Engineering (QE) and testing initiatives across Data & Analytics platforms, Big Data applications, cloud data environments, and enterprise data integration solutions.
The ideal candidate will bring a combination of strong technical expertise, strategic quality leadership, and proven experience managing onsite and offshore testing teams. This individual will be responsible for defining enterprise testing strategies, driving automation initiatives, establishing quality standards, and ensuring successful delivery across complex data engineering programs.
This role requires a hands on technical leader who can oversee testing across modern data platforms while managing teams, stakeholder expectations, delivery commitments, and overall quality governance.
Key Responsibilities
- Lead and manage end to end Quality Engineering and testing delivery for enterprise Data & Analytics platforms, Big Data applications, ETL/ELT pipelines, cloud data platforms, and data integration solutions.
- Define and implement comprehensive test strategies, test plans, quality standards, automation roadmaps, and release readiness criteria across multiple projects and Agile teams.
- Provide technical leadership and oversight for testing solutions built using Databricks, Apache Spark, PySpark, Python, Hadoop/HDFS, Hive, Azure Data Factory, and SQL.
- Lead ETL/ELT testing, source to target validation, data reconciliation, data quality, integration, regression, system, performance, and end to end testing.
- Oversee complex SQL queries and automated validation frameworks to ensure data accuracy, completeness, consistency, integrity, and transformation correctness.
- Manage and mentor onsite and offshore QE teams, including resource planning, workload allocation, performance management, technical guidance, and delivery accountability.
- Drive test automation strategy and framework development using Python, PySpark, SQL, and enterprise automation tools to improve test coverage, efficiency, and reliability.
- Oversee testing of Databricks notebooks, Spark jobs, Delta Lake tables, ADF pipelines, batch processing, and workflow orchestration using Control M and Unix/Linux environments.
- Establish and monitor quality KPIs, test coverage, defect metrics, automation effectiveness, delivery risks, and release readiness dashboards.
- Lead defect triage, root cause analysis, risk assessment, issue escalation, and resolution coordination across development, engineering, architecture, and business teams.
- Collaborate with Product Owners, Data Engineers, Architects, Scrum Masters, business stakeholders, and program leadership to align testing priorities with delivery objectives.
- Manage testing schedules, estimates, resource capacity, dependencies, and deliverables to ensure quality milestones and project commitments are achieved.
- Champion BDD and TDD practices, continuous testing, CI/CD integration, test automation, and shift left Quality Engineering.
- Lead testing governance, stakeholder reporting, quality reviews, production readiness assessments, and go or no go recommendations.
- Support Agile, Scrum, and SAFe delivery practices, including sprint planning, backlog refinement, PI planning, reviews, retrospectives, and cross team coordination.
- Drive continuous improvement through standardized testing processes, reusable frameworks, automation, defect prevention, and Quality Engineering best practices.
Required Qualifications
- 12+ years of experience in Software Quality Engineering, ETL/Big Data Testing, Data Warehouse Testing, or enterprise application testing, including at least 5 years in Test Lead or Test Manager roles.
- Proven experience managing enterprise QE and testing teams, including onsite and offshore delivery, resource planning, test execution, stakeholder communication, and quality governance.
- Strong experience defining and implementing enterprise test strategies, automation frameworks, quality standards, test plans, and release readiness processes.
- Strong technical knowledge of Databricks, Apache Spark, PySpark, Python, Azure Data Factory (ADF), Hadoop/HDFS, Hive, SQL, and ETL/ELT platforms.
- Advanced SQL and data validation expertise, including source to target reconciliation, transformation validation, data quality checks, and complex backend testing.
- Experience managing testing for large scale Data Lakes, Data Warehouses, Lakehouse architectures, cloud data platforms, and enterprise data integration solutions.
- Strong understanding of Databricks Workflows, Delta Lake, ADF pipelines, batch processing, job dependencies, Unix/Linux, and Control M or equivalent enterprise scheduling tools.
- Experience leading functional, integration, regression, system, performance, API, data quality, and end to end testing.
- Experience implementing test automation using Python, PySpark, SQL, Selenium, Cucumber/BDD, PyTest, or equivalent frameworks.
- Strong knowledge of Agile/Scrum, SAFe, SDLC/STLC, CI/CD, defect management, test management, and Quality Assurance governance.
- Proven ability to manage quality metrics, test coverage, defect leakage, delivery risks, resource capacity, and stakeholder reporting.
Preferred Leadership Experience
- Experience leading geographically distributed Quality Engineering teams and managing offshore delivery models.
- Ability to balance strategic quality leadership with hands on technical oversight.
- Strong communication and executive stakeholder management skills.
- Demonstrated success improving testing efficiency, automation coverage, delivery predictability, and overall software quality.