Remote Data Test Lead for Cloud Data Lakes & Big Data

Scrumconnect Consulting; Newcastle upon Tyne; On-site; GBP 60,000 - 90,000; Full time

Job summary

Scrumconnect Consulting, a UK-based digital transformation consultancy, is seeking an experienced Test Manager to lead QA across a large-scale cloud data engineering programme. You will drive testing strategy, lead end-to-end testing across data pipelines and cloud services, and mentor QA teams to improve quality and delivery.

You will ensure CI/CD integration in GitLab pipelines, work with AWS services and Apache Airflow, and build robust testing practices for scale and reliability.

Qualifications

• Proven experience as a Test Manager or QA lead within cloud and data engineering environments.
• Strong background in automated testing for cloud-native and data-centric platforms.
• Experience testing large-scale data pipelines, transformations, and distributed systems.
• Active SFIA Level 5 leadership capability and SC clearance (mandatory).

Responsibilities

• Define, implement, and manage the overall test strategy across cloud-native data platforms and applications.
• Lead end-to-end testing across data pipelines, cloud services, APIs, and distributed systems.
• Mentor Test Engineers and QA team members; drive a quality-first culture.
• Ensure automated testing is integrated within GitLab CI/CD pipelines.
• Identify risks, analyse metrics, and report quality status to stakeholders.

Skills

Python

SQL

Java

CI/CD

Test Automation

Big Data

AWS

Airflow

Data Lake

PySpark

Terraform

Docker

Tools

GitLab CI/CD

Terraform

Docker

Job description

Scrumconnect Consulting, a UK-based digital transformation consultancy, is seeking an experienced Test Manager to lead QA across a large-scale cloud data engineering programme. You will drive testing strategy, lead end-to-end testing across data pipelines and cloud services, and mentor QA teams to improve quality and delivery.

You will ensure CI/CD integration in GitLab pipelines, work with AWS services and Apache Airflow, and build robust testing practices for scale and reliability.