Senior Cloud Data Engineer - Real-Time Sportsbook Platform

Kindred (London) Limited; Greater London; On-site; GBP 90,000 - 125,000; Full time

Job summary

FDJ UNITED is seeking a Senior Data Engineer to design and evolve the Sportsbook data platform on AWS, supporting real-time and batch processing. You will build scalable data pipelines, model data into bronze/silver/gold layers, and partner with analytics, ML, and trading teams to deliver trusted data assets.

You will work with dbt, Spark, Airflow, Kafka, and streaming technologies to ensure data quality, governance, and efficient storage.

Qualifications

• 5+ years of experience building scalable data platforms.
• Strong SQL and data modelling skills with analytical datasets.
• Experience with modern data stack tools (dbt, Spark, Airflow).
• Experience with cloud-based data platforms, ideally AWS.
• Knowledge of medallion architecture and streaming tech (Kafka/Flink).
• Understanding of data quality, testing, and observability practices.

Responsibilities

• Design and build scalable batch and streaming data pipelines.
• Develop data assets aligned to medallion architecture (bronze, silver, gold).
• Model sportsbook domain data into reusable datasets for downstream use.
• Implement data transformation logic with dbt, Spark, and SQL frameworks.
• Build and optimise streaming pipelines for near real-time data availability.
• Ensure data quality and reliability with validation frameworks and observability.
• Design data contracts and schemas for upstream/downstream integrations.
• Optimise pipelines and storage for performance and cost in AWS.
• Collaborate with analytics, data science and ML teams to translate requirements.

Skills

SQL

Data Modelling

dbt

Spark

Airflow

Tools

AWS

Cube.js

Hive Metastore/OpenMetadata

Kafka/Flink

Job description

FDJ UNITED is seeking a Senior Data Engineer to design and evolve the Sportsbook data platform on AWS, supporting real-time and batch processing. You will build scalable data pipelines, model data into bronze/silver/gold layers, and partner with analytics, ML, and trading teams to deliver trusted data assets.

You will work with dbt, Spark, Airflow, Kafka, and streaming technologies to ensure data quality, governance, and efficient storage.