Technical Lead, Multi-Tenant Data Integration on GCP

Vallum Associates; South Yorkshire; Hybrid; GBP 80,000 - 120,000; Full time

Job summary

Vallum Associates seeks a Technical Lead for a multi-tenant data integration platform on GCP. The role is based in Sheffield with a 2-3 day onsite pattern and a mix of remote work. You will guide engineering teams, architect complex data pipelines, and ensure cloud-native reliability and security.

The role requires strong hands-on GCP experience, Airflow, Python, and IaC (Terraform), with a focus on scalable, production-grade ETL/ELT pipelines and observability.

Qualifications

• Proven experience as a Technical Lead / Lead Engineer delivering data engineering platforms in cloud environments.
• Strong hands-on experience building production-grade ETL/ELT pipelines and orchestration with Apache Airflow.
• Solid Google Cloud Platform expertise (BigQuery, Cloud Storage, Pub/Sub, Dataflow) and container platforms (GKE, Cloud Run).
• Strong software engineering fundamentals: Python, APIs, configuration management, testing, and performance tuning.
• CI/CD pipelines and Infrastructure-as-Code (Terraform) with release controls.
• Experience designing for reliability: retries, idempotency, dead-letter handling, backpressure, resilience.
• Ability to translate complex technical topics for mixed audiences and drive alignment across teams.

Skills

Technical Leadership

Data integration

ETL/ELT pipelines

Python

CI/CD

Terraform

Airflow

GCP

Tools

Terraform

Apache Airflow

GKE

Cloud Run

BigQuery

Dataflow

Pub/Sub

IAM & Networking

Job description

Vallum Associates seeks a Technical Lead for a multi-tenant data integration platform on GCP. The role is based in Sheffield with a 2-3 day onsite pattern and a mix of remote work. You will guide engineering teams, architect complex data pipelines, and ensure cloud-native reliability and security.

The role requires strong hands-on GCP experience, Airflow, Python, and IaC (Terraform), with a focus on scalable, production-grade ETL/ELT pipelines and observability.