Hybrid QA Data Engineering Lead - Databricks

SMBC; Tralee; Hybrid; EUR 90,000 - 120,000; Full time

Job summary

SMBC Group is seeking an experienced QA Data Engineering Lead to ensure data quality across Databricks platforms. This hands-on leadership role focuses on validating large-scale data pipelines using SQL, Python, PySpark and Databricks, reporting to the Director of Quality Assurance Testing.

You will lead a team of QA engineers, define testing governance, and drive ETL testing across Bronze, Silver and Gold layers, with hybrid work and attendance at the Tralee office at least three days a week.

Qualifications

• Bachelor’s degree in CS, Engineering, Data or related field, or equivalent experience.
• 7+ years in database, ETL, data warehouse or data-quality testing with QA leadership.
• Proven experience leading QA teams and technical direction in complex data environments.
• Strong hands-on Databricks, SQL and Python (PySpark, Pandas).
• Experience with Databricks Notebooks and cluster management.
• Experience with Azure or AWS.
• Experience with Jira and Agile/Scrum delivery.
• Ability to introduce data-testing processes, standards and automation.

Responsibilities

• Own the overall data QA strategy and testing governance across delivery.
• Lead a team of Database QA Engineers on testing strategy and execution.
• Develop comprehensive testing plans for complex data pipelines and data warehouse solutions.
• Review requirements to identify testable conditions, data-quality risks and acceptance criteria.
• Provide senior stakeholders with assessments of data quality, risks and release readiness.
• Support release planning with data testing coverage before production.
• Drive continuous improvement of QA processes and automation.
• Ensure SDLC alignment of testing activities.

Skills

Databricks

Advanced SQL

Python

PySpark

Pandas

Jira

Agile/Scrum

Education

Bachelor’s degree in Computer Science, Engineering, Data or related field

7+ years in database, ETL, data warehouse or data-quality testing with QA leadership

Tools

Databricks Notebooks

Cluster management

CI/CD pipelines

Git version control

Automated data-testing frameworks

Job description

SMBC Group is seeking an experienced QA Data Engineering Lead to ensure data quality across Databricks platforms. This hands-on leadership role focuses on validating large-scale data pipelines using SQL, Python, PySpark and Databricks, reporting to the Director of Quality Assurance Testing.

You will lead a team of QA engineers, define testing governance, and drive ETL testing across Bronze, Silver and Gold layers, with hybrid work and attendance at the Tralee office at least three days a week.