Lead Data Engineer

The BDPN; Greater London; Hybride; GBP 95 000 - 140 000; Plein temps

Avantages offerts par ce poste

Hybrid work

Private health insurance

Pension

Mintago access

Spill mental health platform

Cycle to work

Team events

Résumé du poste

Superscript is seeking a Lead Data Engineer to own the data platform, ensuring it powers BI, underwriting models, ML predictions, and data products at scale.

You will define the architectural vision, design end-to-end data pipelines, and mentor engineers while setting coding standards. The role emphasizes collaboration with Data, Tech, and business stakeholders to deliver high-impact data solutions and drive platform resilience.

Qualifications

• Deep understanding of modern data architectures (data lakehouse, event-driven pipelines, and orchestration systems).
• Strong proficiency in Python, SQL, and IaC (Terraform).

Responsabilités

• Define the architectural vision for data platform scaling with BI, ML, and real-time analytics.
• Write and review production-grade code in Python, SQL, and Terraform.
• Design and deliver end-to-end data pipelines.
• Lead development of MLOps capabilities including model deployment and monitoring.
• Own and improve data quality frameworks and observability.
• Produce detailed technical documentation for technical and non-technical stakeholders.
• Lead complex data initiatives from concept to delivery.

Connaissances

Python

SQL

Terraform

dbt

Snowflake

AWS

Prefect

MLOps

Docker

Kubernetes

Outils

dbt

Snowflake

AWS

Prefect

MLFlow

kedro

Sagemaker

FastAPI

Description du poste

As Lead Data Engineer at Superscript, you’ll be the technical and strategic owner of our data platform, the foundation that powers everything from business intelligence and underwriting models to machine learning predictions and data products.

You’ll define and drive the evolution of our modern data ecosystem to ensure it’s robust, scalable, and efficient. Working closely with stakeholders across Data, Tech, and the wider business, you’ll lead the design and delivery of data solutions that underpin our ability to understand and serve customers, manage risk intelligently, and make data-driven decisions at scale.

You’ll also act as a mentor and technical leader within the team, up-skilling others, setting engineering standards, and ensuring our data capabilities continue to be a strategic differentiator for Superscript.

What you'll get up to:

Define the architectural vision for Superscript’s data platform, ensuring it scales with our business and supports diverse use cases including BI, ML, and real-time analytics.

Write and review high-quality, production-grade code in Python, SQL, and IaC (Terraform) that sets the standard for engineering excellence.

Design and deliver end-to-end data pipelines.

Optimise performance, reliability, and cost-efficiency across all data workflows and systems.

Lead development of Superscript’s MLOps capabilities, ensuring seamless model deployment, monitoring, and feedback loops.

Own and improve data quality frameworks and observability to ensure trust in business-critical data assets.

Produce detailed technical documentation accessible to both technical and non-technical stakeholder s.

Lead complex, high-impact data initiatives from concept through to delivery, including scoping, architecture, resource planning, and execution.

Anticipate risks, identify dependencies, and clearly communicate trade-offs between speed, quality, and business impact.

Drive platform automation and resilience, ensuring rapid, reliable delivery of new data features and models.

Lead, coach and support Data Engineers and Analytics Engineers, creating an environment where individuals can grow in confidence, capability and impact.

Provide structured feedback and guidance through code reviews, pair programming, and knowledge-sharing sessions.

Collaborate with Product Managers, Analysts, and stakeholders to design impactful data products that advance business goals.

Foster a culture of experimentation, continuous improvement, and technical curiosity within the data functio n.

About you:

Deep understanding of modern data architectures (data lakehouse, event-driven pipelines, and orchestration systems).

Strong proficiency in Python, SQL, and IaC (Terraform).

Experience using dbt, Snowflake, AWS, orchestration tool like Prefect.

Experienced in building and maintaining batch and streaming data pipelines at scale.

Skilled in managing and optimising cloud infrastructure for cost and performance.

Knowledge of CI/CD, testing frameworks, version control (Git), and containerisation (Docker/Kubernetes).

Strong background in data modelling, warehousing, and supporting analytical and ML workloads.

Exposure to MLOps tools including MLFlow, kedro and Amazon Sagemaker.

Development and maintenance of real time products like APIs using FastAPI/Flask.

Operates autonomously with strong ownership and accountability.

Strategic thinker who balances immediate delivery with long-term platform evolution.

Excellent communicator who can bridge technical and business domains.

Collaborative leader who uplifts others through mentorship, clarity, and support.

Passionate about continuous improvement, technical excellence, and innovation in data engineering.

In return, we offer you:

A competitive salary and the ability to grow your career

25 days holiday - so there’s plenty of time for work, rest and play

Hybrid way of working for the perfect work / life balance

Vitality private health and dental insurance

Added benefits including competitive pension and salary sacrifice

Access to financial wellbeing platform Mintago

Full access to Spill , our mental health platform

Cycle to work scheme

Fun andmodern office environment with regular team social events