Lead Data Engineer

Fa Euup Saasfaprod1

Greater London

Hybrid

GBP 110,000 - 150,000

Full time

13 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Fa Euup Saasfaprod1 in London is seeking a Lead Data Engineer to orchestrate and govern a real-time data platform. Hybrid role with 1-2 days on site.

You will bridge data pipelines and cloud-native platforms, balancing architecture design with hands-on coding in Python/Go, and mentoring the team to deliver reliable, scalable solutions.

Join a fast-paced engineering organization focused on high-impact data workloads and operational excellence.

Qualifications

  • Experience leading technical system designs in high-scale cloud-native environments.
  • Hands-on engineering with real-time data ingestion and processing pipelines.
  • Mentor engineers, manage technical debt, and drive DevOps cultures.
  • Strong communication to technical and non-technical stakeholders.

Responsibilities

  • Technical Orchestration: Translate complex business roadmaps into high-level designs for event-driven streaming solutions.
  • Data & Infrastructure Architecture: Architect real-time ingestion pipelines with cloud infrastructure alignment.
  • People Leadership & Mentoring: Lead engineering squad, perform code reviews, share knowledge, enforce best practices.
  • Delivery Flow: Refine requirements into technical tasks with Engineering Manager & Product Managers.
  • Operational Excellence & SLA Management: Ensure platform reliability under extreme loads with monitoring.
  • Escalation & Support: Participate in weekly rotation, lead Root Cause Analysis for critical issues.

Skills

Python
Go
Java
Scala
Event-driven design
Systems thinking
Mentoring
Strategic communication

Tools

GKE
Pub/Sub
BigQuery
Dataflow
Cloud Functions
Terraform
Kubernetes

Job description

Workplace: White City, London - Hybrid 1-2 days a week on site Contract Type: Permanent

The Role As a Lead Data Engineer, you operate as a technical orchestrator and a guardian of excellence across our real‑time operational data ecosystem. You are positioned at the critical intersection of high‑level requirement analysis, distributed systems design, and hands‑on delivery. You will balance deep data architecture with infrastructure architecture, bridging the gap between data pipelines and cloud‑native container platforms. Your time will be balanced across three core pillars: 40% High‑Level Design & Architecture: Reviewing incoming business requirements, driving technical discussions, and mapping out scalable, distributed data architectures. 40% Hands‑On Engineering: Writing clean, testable code alongside the team, implementing core platform features, building reusable components and undertaking support requests. 20% Mentorship & Technical Governance: Cultivating the engineering squad's capabilities, managing technical debt, and defining quality frameworks.

Key Responsibilities
  • Technical Orchestration: Translate complex business roadmaps into high‑level designs, defining the structures, components, and interactions of event‑driven streaming solutions.
  • Data & Infrastructure Architecture: Architect high‑throughput, real‑time data ingestion pipelines while partnering with DevOps specialists to ensure alignment with cloud infrastructure frameworks.
  • People Leadership & Mentoring: Oversee the technical growth and motivation of the engineering squad, running code reviews, sharing knowledge, and embedding engineering best practices.
  • Delivery Flow: Partner with the Engineering Manager and Product Managers to refine requirements into technical tasks, ensuring iterative delivery and a lean backlog.
  • Operational Excellence & SLA Management: Guard platform reliability against extreme traffic loads, establishing a proactive monitoring strategy via Grafana/Prometheus.
  • Escalation & Support: Participate in the team’s weekly support rotation as a high‑level escalation point, leading Root Cause Analysis when critical operational challenges arise.
What You’ll Bring
  • Polyglot Engineering Literacy: Strong backend development capability with a willingness to design, challenge, and review logic across Python and Go, with Java or Scala as valuable secondaries.
  • Cloud Native Expertise: Extensive experience with the GCP Stack (GKE, Pub/Sub, BigQuery, Dataflow, Cloud Functions) and event‑driven architectures.
  • Infrastructure as Code: Deep understanding of automated infrastructure deployment using Terraform and container orchestration via Kubernetes.
  • Systems Thinking: Ability to map out complex, multi‑project data flows and microservices environments, ensuring modularity and resilience.
  • Strategic Communication: Ability to articulate abstract technical designs clearly to both technical engineers and non‑technical stakeholders.
Nice to Have

Nice to Have: Familiarity with ESG and/or Sustainable Software Engineering principles to optimise cloud compute efficiency, or experience shifting data capabilities to "Edge" environments.

Minimum Criteria
  • Demonstrable experience leading technical system designs and defining architecture in a high‑scale, cloud‑native operational data environment.
  • Proven hands‑on engineering experience handling high‑throughput, real‑time data ingestion and processing pipelines.
  • Experience mentoring engineers, managing technical debt, and steering code‑first DevOps cultures.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer
Lead Data Engineer

ITV • Greater London

Hybrid
GBP 90,000 - 130,000
Lead Data Engineer
Lead Data Engineer

Itv • Greater London

Hybrid
GBP 110,000 - 170,000
Lead Data Engineer
Lead Data Engineer

ITV Careers • Greater London

Hybrid
GBP 90,000 - 120,000
Lead Data Engineer
Lead Data Engineer

Placements24 • London Borough of Newham

Hybrid
GBP 90,000 - 140,000
Hybrid work arrangement
Lead Data Engineer
Lead Data Engineer

Royal Bank of Scotland • Greater London

Hybrid
GBP 90,000 - 130,000
Hybrid work
London office
Lead Data Engineer
Lead Data Engineer

Tria • City Of London

Hybrid
GBP 86,000 - 105,000
Bonus
Excellent benefits
Lead Data Engineer in London
Lead Data Engineer in London

Energy Jobline CVL • Greater London

Hybrid
GBP 86,000 - 105,000
Bonus
Excellent Benefits
Data Engineer
Data Engineer

Talent • Greater London

Hybrid
GBP 90,000 - 120,000
Lead Data Engineer
Lead Data Engineer

TRIA • Greater London

Hybrid
GBP 86,000 - 105,000
Bonus
Excellent Benefits
Lead Data Engineer - London
Lead Data Engineer - London

Datatech Analytics • City Of London

Hybrid
GBP 85,000 - 95,000