Technical Lead - Multi-Tenant Data Integration Platform - GCP

Vallum Associates; Barnsley; Hybrid; GBP 90,000 - 120,000; Part time

Job summary

Vallum Associates seeks a Technical Lead to steer a multi-tenant data integration platform on Google Cloud. You will own architecture decisions and lead delivery of cloud data pipelines in production.

Ideal candidates will mentor engineers, ensure reliability, security and performance, and collaborate across teams. Hybrid role with 2-3 days onsite in Sheffield, UK; Inside IR35 applies.

Qualifications

• Experience leading data engineering or integration platforms in the cloud.
• Proven track record delivering production-grade ETL/ELT pipelines.
• Strong background in Python, APIs and testing strategies.

Responsibilities

• Lead design and delivery of a multi-tenant data integration platform on GCP.
• Champion reliability, observability and security across teams.
• Mentor engineers, drive alignment and manage CI/CD pipelines with IaC.

Skills

Technical leadership

Data integration

Cloud engineering

Python

APIs

CI/CD

IaC Terraform

Airflow

GCP

Tools

Apache Airflow

Terraform

GKE

Cloud Run

BigQuery

Pub/Sub

Dataflow

Cloud Storage

Job description

The Role: Technical Lead - Multi-tenant Data Integration Platform - GCP

Location: Sheffield, UK

Position Type: Contract Inside IR35

Remote work option Available: 2-3 Days Onsite in a week

Job Description

Required experience & skills

• Proven experience as a Technical Lead / Lead Engineer delivering data engineering or integration platforms in cloud environments.
• Strong hands-on experience building production-grade ETL/ELT pipelines and orchestration with Apache Airflow.
• Solid experience on Google Cloud Platform, such as:
• Data services (e.g., BigQuery, Cloud Storage, Pub/Sub, Dataflow) and/or container platforms (e.g., GKE, Cloud Run)
• IAM, networking, secrets management, and environment separation
• Strong software engineering foundations: Python, APIs, configuration management, testing strategy, and performance tuning.
• CI/CD expertise (pipeline tooling, release controls, automated quality gates) and Infrastructure-as-Code experience (e.g., Terraform).
• Experience designing for reliability retries, idempotency, dead-letter patterns, backpressure handling, and operational resilience.
• Ability to translate complex technical topics for mixed audiences and drive alignment across teams.

Desirable

• Experience implementing or integrating data lineage/metadata management tooling (e.g., Data Catalog-style metadata, OpenLineage, DataHub, etc.).
• Experience with multi-tenant platforms (tenant isolation models, metadata-driven frameworks).
• Knowledge of data governance concepts (data quality, auditability, retention, access controls).
• Experience integrating with external vendor systems and managing vendor technical dependencies