Technical Lead: Data Platform & ETL Orchestration

Test Triangle Limited; Greater London; Hybrid; GBP 120,000 - 180,000; Full time

Job summary

Test Triangle Limited seeks a full stack engineering leader to drive the delivery and technical direction of a scalable, multi-tenant data integration platform on Google Cloud Platform. You will guide the team in building robust ETLs, automating deployments, and ensuring end-to-end data lineage with clear traceability of data movement.

You will own the technical roadmap, set engineering standards, and contribute hands-on when needed to deliver high-quality pipelines and platform capabilities

Qualifications

• Proven experience as a Technical Lead / Lead Engineer delivering data engineering or integration platforms in cloud environments.
• Strong hands-on experience building production-grade ETL/ELT pipelines and orchestration with Airflow.
• Solid experience on Google Cloud Platform, such as Data services (BigQuery, Cloud Storage, Pub/Sub, Dataflow) and container platforms (GKE, Cloud Run).
• Experience with IAM, networking, secrets management, and environment separation.
• Strong software engineering foundations: Python, APIs, configuration management, architecture design, testing strategy, and performance tuning.
• CI/CD expertise (pipeline tooling, release controls, automated quality gates) and Infrastructure-as-Code (Terraform).
• Experience designing for reliability: retries, idempotency, dead-letter patterns, backpressure handling, and operational resilience.
• Ability to translate complex technical topics for mixed audiences and drive alignment across teams.

Responsibilities

• Own the technical roadmap for the platform, aligning engineering outcomes to business priorities and operational resilience.
• Lead solution design for new integrations and platform capabilities, balancing pace with long-term maintainability.
• Set engineering standards (coding, testing, documentation, observability, security) and ensure consistent adoption across the team.
• Provide hands-on contribution where needed (critical ETLs, framework components, design spikes, performance fixes).
• Design and develop robust ETL pipelines orchestrated in Airflow, including scheduling strategies, dependency management, retries, backfills, and processing.
• Establish patterns for onboarding new source systems and delivering data to downstream vendor systems with strong reliability and traceability.
• Drive data quality controls (validation, reconciliation, exception handling) and operational runbooks.
• Evolve the multi-tenant architecture: tenant isolation, configuration management, metadata-driven pipelines, and scalable runtime patterns.
• Improve build and deployment automation for both platform services and Airflow DAGs (versioning, packaging, promotions, approvals).
• Implement CI/CD best practices: automated testing, static analysis, security scanning, and controlled rollout/rollback strategies.
• Reduce manual toil by investing in self-service onboarding, templates, and engineering enablement tooling.
• Implement end-to-end data lineage (source → platform → vendor), including metadata capture and a visual representation that supports auditability and faster incident resolution.
• Enhance observability across pipelines and services: logging, metrics, alerting, and dashboards; drive measurable improvements in MTTR and change failure rate.
• Partner with product owners, data owners, architects, vendors, and governance teams to shape requirements and manage delivery expectations.
• Lead agile ceremonies and engineering planning; remove blockers and maintain delivery momentum.
• Mentor engineers through code reviews, design reviews, and structured coaching; foster a culture of continuous improvement.

Skills

Technical leadership

Lead engineer

ETL/ELT pipelines

Airflow

Google Cloud Platform

Python

CI/CD

Terraform

Observability

Data lineage

Security

Multi-tenant architecture

Tools

Airflow

BigQuery

Cloud Storage

Pub/Sub

Dataflow

GKE

Cloud Run

Terraform

Job description

Test Triangle Limited seeks a full stack engineering leader to drive the delivery and technical direction of a scalable, multi-tenant data integration platform on Google Cloud Platform. You will guide the team in building robust ETLs, automating deployments, and ensuring end-to-end data lineage with clear traceability of data movement.

You will own the technical roadmap, set engineering standards, and contribute hands-on when needed to deliver high-quality pipelines and platform capabilities