London Hybrid Data QA Engineer AI-Driven Lakehouse Testing

Hollybank Trustees Ltd; Greater London; Hybrid; GBP 60,000 - 85,000; Full time

Job summary

Sagacity is seeking a QA-focused data specialist to own the testing of client data platform deployments. You will design and execute structured test programmes for Databricks pipelines, validate data quality across bronze–silver–gold stages, and ensure accuracy and completeness of analytics data.

You will work with AI-assisted tooling as a core part of the workflow, collaborating with Data Engineers, UAT teams, and client stakeholders to deliver reliable data products across financial services

Qualifications

• Experience in data quality testing within multi-source data environments.
• Ability to design and execute structured test programmes for data pipelines.
• Familiarity with data contracts and schema validation in Lakehouse architectures.

Responsibilities

• Author, run, and maintain test plans across deployment phases using SPHERE YAML framework.
• Investigate failures and trace root causes across the Databricks Lakehouse stack.
• Manage QA work items in ClickUp and track resolutions through delivery lifecycle.
• Collaborate with Data Engineers to validate fixes before UAT/production.
• Coordinate with UAT stakeholders to align acceptance criteria and QA findings.
• Explain QA methodology and coverage in delivery meetings for non-technical audiences.
• Identify gaps in SPHERE and contribute change/feature requests to the platform.
• Maintain QA coverage as new data views and sources are onboarded.

Skills

SQL

Databricks

PySpark

Spark SQL

Data quality

YAML

Git

AI-assisted workflows

Tools

SPHERE

ClickUp

Databricks Unity Catalog

Job description

Sagacity is seeking a QA-focused data specialist to own the testing of client data platform deployments. You will design and execute structured test programmes for Databricks pipelines, validate data quality across bronze–silver–gold stages, and ensure accuracy and completeness of analytics data.

You will work with AI-assisted tooling as a core part of the workflow, collaborating with Data Engineers, UAT teams, and client stakeholders to deliver reliable data products across financial services