Senior Data Engineer – Real-Time AI/ML Pipelines

Livescore9; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Company Performance Bonus

Flexible Working Agreements

Private Healthcare Scheme + Employee E

Enhanced Family Leave - Maternity, Par

Subsidised Gym Membership

Annual Travel Card Loan

Ride to Work Scheme

Life Assurance (x3 salary)

Contributory Pension Plan

Virgin Family benefits

Job summary

LiveScore Group, based in London, is seeking a Senior Data Engineer to own end‑to‑end data architecture and real‑time AI workloads. You will lead design discussions, build scalable data platforms and mentor engineers across teams.

You will drive data integrity, performance and cost‑efficiency while partnering with cross‑functional stakeholders to translate complex business requirements into robust data solutions.

Qualifications

• Extensive experience in data engineering with large‑scale datasets.
• Strong SQL and Python; experience with AI‑assisted development tools.
• Deep knowledge of data‑modelling techniques.
• Proven experience with GCP data services (BigQuery, Dataflow, Pub/Sub, Vertex AI).
• Proven ability to design real‑time and large‑scale batch ELT pipelines.
• IaC experience using Terraform.
• Experience with Airflow and Docker.
• Ability to explain complex concepts to technical and non‑technical stakeholders.
• Experience applying data governance, privacy and security practices.

Responsibilities

• Lead design and delivery of robust data pipelines using GCP services like BigQuery, Dataflow, Pub/Sub and Cloud Storage.
• Own the design of data models and databases to support analytics using dimensional modelling; select Bigtable/Spanner/Firestore as needed.
• Automate data workflows and optimise storage/costs in GCP; use Cloud Composer for orchestration.
• Ensure data security by applying GCP security practices and governance policies.
• Collaborate with engineers, analysts and IT to define data requirements and deliver solutions.
• Define technical direction and evaluate new GCP features and data‑engineering tech.
• Lead remediation of pipeline failures and data‑quality incidents.
• Lead architecture decisions for scalable batch and real‑time workloads.
• Mentor engineers and promote engineering excellence.

Skills

Advanced SQL

Python

Data modelling

GCP expertise

ELT pipelines

Airflow

Terraform

Team leadership

Real-time data

Education

Bachelor's degree in a relevant field

Tools

BigQuery

Dataflow

Pub/Sub

Vertex AI

Cloud Composer

Terraform

Airflow

Docker

Job description

LiveScore Group, based in London, is seeking a Senior Data Engineer to own end‑to‑end data architecture and real‑time AI workloads. You will lead design discussions, build scalable data platforms and mentor engineers across teams.

You will drive data integrity, performance and cost‑efficiency while partnering with cross‑functional stakeholders to translate complex business requirements into robust data solutions.