Lead Data Engineer

ITV Consumer Limited 2024

City of Westminster

Hybrid

GBP 110,000 - 140,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Annual bonus
Generous holiday allowance
Pension contribution
Save as you earn (ITV shares)
Wellbeing & volunteering days
Flexible working options

Job summary

ITV Consumer Limited 2024 is seeking a Lead Data Engineer to orchestrate the real-time data ecosystem. You will balance high-level design with hands-on delivery, shaping distributed architectures and cloud-native platforms, while mentoring the squad and enforcing engineering standards.

You will drive end-to-end data pipelines, collaborate with DevOps on cloud infrastructure, and ensure scalable, reliable performance under heavy load.

Qualifications

  • Experience building real-time data ingestion and streaming pipelines.
  • Strong backend development with Python/Go and exposure to Java/Scala is a plus.
  • Ability to design scalable, cloud-native data architectures.
  • Experience mentoring engineers and managing technical debt.

Responsibilities

  • Translate business roadmaps into high-level designs for event-driven streaming solutions.
  • Lead architecture decisions and governance for the data platform.
  • Write clean, tested code and review others’ PRs to ensure quality and reliability.
  • Guard platform reliability with proactive monitoring and incident response.

Skills

Python
Go
Distributed systems
System design
Mentoring
DevOps culture

Tools

GKE
BigQuery
Pub/Sub
Dataflow
Terraform
Kubernetes
Grafana/Prometheus
Cloud Functions

Job description

As a Lead Data Engineer, you operate as a technical orchestrator and a guardian of excellence across our real-time operational data ecosystem. You are positioned at the critical intersection of high-level requirement analysis, distributed systems design, and hands-on delivery. You will balance deep data architecture with infrastructure architecture, bridging the gap between data pipelines and cloud-native container platforms. Your time will be balanced across three core pillars:

  • 40% High-Level Design & Architecture: Reviewing incoming business requirements, driving technical discussions, and mapping out scalable, distributed data architectures.
  • 40% Hands-On Engineering: Writing clean, testable code alongside the team, implementing core platform features, building reusable components and undertaking support requests.
  • 20% Mentorship & Technical Governance: Cultivating the engineering squad's capabilities, managing technical debt, and defining quality frameworks., Technical Orchestration: Translate complex business roadmaps into high-level designs, defining the structures, components, and interactions of event-driven streaming solutions.
  • Data & Infrastructure Architecture: Architect high-throughput, real-time data ingestion pipelines while partnering with DevOps specialists to ensure alignment with cloud infrastructure frameworks.
  • People Leadership & Mentoring: Oversee the technical growth and motivation of the engineering squad, running code reviews, sharing knowledge, and embedding engineering best practices.
  • Delivery Flow: Partner with the Engineering Manager and Product Managers to refine requirements into technical tasks, ensuring iterative delivery and a lean backlog.
  • Operational Excellence & SLA Management: Guard platform reliability against extreme traffic loads, establishing a proactive monitoring strategy via Grafana/Prometheus.
  • Escalation & Support: Participate in the team's weekly support rotation as a high-level escalation point, leading Root Cause Analysis when critical operational challenges arise. Polyglot Engineering Literacy: Strong backend development capability with a willingness to design, challenge, and review logic across Python and Go, with Java or Scala as valuable secondaries.
  • Cloud Native Expertise: Extensive experience with the GCP Stack (GKE, Pub/Sub, BigQuery, Dataflow, Cloud Functions) and event-driven architectures.
  • Infrastructure as Code: Deep understanding of automated infrastructure deployment using Terraform and container orchestration via Kubernetes.
  • Systems Thinking: Ability to map out complex, multi-project data flows and microservices environments, ensuring modularity and resilience.
  • Strategic Communication: Ability to articulate abstract technical designs clearly to both technical engineers and non-technical stakeholders.
  • Nice to Have: Familiarity with ESG and/or Sustainable Software Engineering principles to optimise cloud compute efficiency, or experience shifting data capabilities to "Edge" environments., Demonstrable experience leading technical system designs and defining architecture in a high-scale, cloud-native operational data environment.
  • Proven hands-on engineering experience handling high-throughput, real-time data ingestion and processing pipelines.
  • Experience mentoring engineers, managing technical debt, and steering code-first DevOps cultures.
  • Flexible working with a range of options
  • Generous holiday allowance, plus you can buy more
  • Annual bonus opportunity
  • Competitive pension contribution
  • Save as you earn - with an opportunity to buy ITV shares
  • Wellbeing and volunteering days plus a wide range of opportunities to help you live a balanced and healthy life
More about our benefits

What is the magic of ITV? It starts with a simple love of television. Watching it, creating it, talking about it. Whether it's daytime or primetime, for downtime or anytime. We're inspired by our audiences. Who helps shape what we make. Standing shoulder to shoulder with them. Because what matters to them, matters to us. Starting conversations. Winning hearts. Changing minds and sometimes even society itself. Big or small, what we make makes an impact.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Software Engineer
Lead Software Engineer

ITV plc • Greater London

Hybrid
GBP 85,000 - 105,000
Data Governance lead
Data Governance lead

ITV Consumer Limited 2024 • London Borough of Hammersmith and Fulham

Hybrid
GBP 65,000 - 95,000
Generous holiday allowance
Annual bonus opportunity
Competitive pension contribution
+1
Data Governance Lead
Data Governance Lead

ITV • Greater London

Hybrid
GBP 60,000 - 80,000
Flexible working
Holiday allowance
Annual bonus
+3
Data Engineering Lead
Data Engineering Lead

Lloyds Banking Group • West of England

On-site
GBP 90,000 - 120,000
Generous pension contribution of up to 15%
Annual performance-related bonus
Share schemes including free shares
+3
Platform Engineer
Platform Engineer

ITV Consumer Limited 2024 • City of Westminster

On-site
GBP 70,000 - 100,000
Generous holiday allowance
Annual bonus opportunity
Competitive pension contribution
+2
Lead Data Engineer
Lead Data Engineer

ITV Careers • Greater London

Hybrid
GBP 90,000 - 120,000
Lead Data Engineer
Lead Data Engineer

Itv • Greater London

Hybrid
GBP 110,000 - 170,000
Platform Engineer
Platform Engineer

Itv • Greater London, Manchester

Hybrid
GBP 50,000 - 60,000
Lead Data Engineer – Real-Time, Cloud-Native & Mentorship
Lead Data Engineer – Real-Time, Cloud-Native & Mentorship

ITV Consumer Limited 2024 • City of Westminster

Hybrid
GBP 110,000 - 140,000
Annual bonus
Generous holiday allowance
Pension contribution
+3
Platform Engineer
Platform Engineer

ITV plc • Hounslow

Hybrid
GBP 50,000 - 60,000