Lead Data Platform Engineer

The Guardian; London; On-site; GBP 60,000 - 100,000; Full time

Job summary

Join a forward-thinking organization as a Lead Data Platform Engineer, where you will guide a talented team in building and maintaining a robust data ecosystem on Google Cloud Platform. This role emphasizes collaboration and mentorship, allowing you to shape best practices in data engineering and cloud infrastructure. You will have the opportunity to work with cutting-edge technologies like BigQuery, Airflow, and CI/CD tools, while enhancing the architecture to align with security and operational standards. If you're passionate about data and eager to make a significant impact, this is the perfect opportunity for you.

Qualifications

• Experience in a senior/lead role as a Data Platform Engineer.
• Deep knowledge of cloud infrastructure and large scale analytics platforms.

Responsibilities

• Lead the data engineering and GCP cloud engineering practice.
• Build and maintain our data ecosystem with BigQuery at its core.

Skills

Cloud Infrastructure

Data Engineering

GCP

BigQuery

Python

Airflow

CI/CD

Terraform

Collaboration

Education

Bachelor's Degree in Computer Science or related field

Tools

Google Cloud Platform

Airflow

dbt

Kubernetes

Fivertan

Tableau

Alation

Terraform

Spark

Scala

Job description

Join our team at the Guardian and be a part of a diverse and inclusive global organisation that delivers fearless, investigative journalism, and holds power to account. Our team of award-winning journalists, cutting-edge commercial professionals, and industry-leading digital experts are committed to making a difference and represent a wide range of backgrounds and perspectives. We offer a challenging and exciting environment for career development, with a focus on training, growth and fostering an inclusive culture.

We're now looking for a Lead Data Platform Engineer. The Data Platform team design, implement and maintain the core data technology infrastructure driving the ecosystem that enables the business to make smarter decisions with data. Our primary technology is Google Cloud Platform supported by Airflow and dbt.

As technical lead on the team you'll be working closely with architects, product managers and stakeholders, helping to provide technical knowledge to support the team and guide the work. At GNM we see data as an asset that is critical for informing our business and driving performance. Data supports all areas of operations: informing our editors choices; supporting advertising revenue; and supporting our reader revenue teams to acquire more supporters and increase revenue per supporter.

About the Role

• Lead the data engineering and GCP cloud engineering practice across the organisation
• Coaching and mentoring a team of engineers
• Build and maintain our data ecosystem, including maintaining a lakehouse on Google Cloud Platform with BigQuery at its core
• Deliver operations and orchestration for all things data, specifically on Airflow, Cloud Composer
• Support integrations with key platforms such as Fivertan, Tableau, and Alation
• Enhance our architecture, align it with our infosec, multi-cloud, and architecture practices
• Champion and embed best practices for cloud and data engineering

About You

• Previous experience in a senior/lead role as a Data Platform Engineer
• Operates with deep knowledge of cloud infrastructure and large scale analytics platforms, including experience with GCP and BigQuery preferred.
• Design and deliver solutions on the technologies that drive data at the Guardian. This looks like:
  • Google Cloud Platform: BigQuery, Kubernetes
  • Python, Airflow, & DBT
  • CI/CD & Terraform
  • Nice-to-have: Spark & Scala on DataProc
• Demonstrated knowledge and experience of key operational concerns, including:
  • Security & Networks
  • Site Reliability
  • Developer Experience
  • Costs & Budgets
• Enjoys working in a collaborative environment, communicates effectively with technical and non-technical colleagues across the Guardian
• Able to mentor and coach engineers within the data platform team, balancing personal and team delivery

How to Apply

To apply, please upload your latest CV and a cover letter which outlines why you'd love to take on this role, and why you're a great match for what we're looking for.

The closing date for applications is Tuesday 6th May 2025.