Data Platform Architect & ETL Lead (GCP/Airflow)

Webologix Ltd/ INC

Sheffield

On-site

GBP 90,000 - 120,000

Full time

2 days ago

Be an early applicant

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Webologix Ltd/ INC is seeking a Technical Lead to drive a multi-tenant data integration platform on Google Cloud. You’ll own the technical roadmap, design scalable ETL pipelines in Apache Airflow, and lead a team through architecture, testing, and deployment improvements.

The role combines hands-on coding with strategic leadership, focusing on reliability, data lineage, and end-to-end observability across dev, test and prod environments. Sheffield-based, on-site work with modern cloud tech stack.

Qualifications

Proven experience as a Technical Lead/Lead Engineer delivering data engineering or integration platforms in cloud environments.
Strong hands-on experience building production-grade ETL/ELT pipelines and orchestration with Apache Airflow.
Solid experience on Google Cloud Platform services (BigQuery, Cloud Storage, Pub/Sub, Dataflow) and/or container platforms (GKE, Cloud Run).
IAM, networking, secrets management, and environment separation.
Strong software engineering foundations: Python, APIs, configuration management, testing strategy, and performance tuning.
CI/CD expertise (pipeline tooling, release controls, automated quality gates) and Infrastructure-as-Code (Terraform).
Experience designing for reliability and observability, including retries, idempotency, and incident resilience.
Ability to translate complex technical topics for mixed audiences and drive alignment across teams.

Responsibilities

Own the technical roadmap for the platform and align outcomes with business priorities.
Lead solution design for new integrations and platform capabilities with maintainability in mind.
Set engineering standards and ensure adoption across the team.
Provide hands-on contribution when needed (critical ETLs, framework components, design spikes).
Design and develop robust ETL pipelines orchestrated in Apache Airflow with reliable scheduling and tracing.
Establish patterns for onboarding new source systems and delivering data to downstream vendors with traceability.
Drive data quality controls and operational runbooks.
Evolve multi-tenant architecture and optimise for performance, cost and reliability across dev/test/prod.
Improve build and deployment automation for platform services and Airflow DAGs; implement CI/CD best practices.
Enhance observability with logging, metrics, alerts and dashboards to improve MTTR and change failure rate.
Mentor engineers through code reviews and structured coaching; foster continuous improvement.