Senior Data Engineer: Real-Time iGaming Data (Remote)

CreateFuture; Manchester; Hybrid; GBP 70,000 - 110,000; Full time

Benefits offered by this job

Flexible working

Hybrid/Remote options

Office hubs in Edinburgh, Leeds, Leeds

Job summary

CreateFuture in the UK is hiring a Senior Data Engineer to join our Data Practice. You’ll deliver data solutions for major operators, handling sub-second odds feeds, regulatory reporting, and large-scale cloud migrations from on-prem to cloud-native AWS architectures.

You’ll design low-latency pipelines using AWS services and streaming tech, validate data quality, and collaborate with cross-functional teams. Hybrid/remote work available across our UK hubs, with mentoring responsibilities.

Qualifications

• Extensive experience delivering data migrations to cloud platforms.
• Strong knowledge of real-time data pipelines and streaming.
• Experience with AWS data services and cloud-native architectures.
• Familiarity with iGaming data domains and regulatory reporting.

Responsibilities

• Deliver large-scale data migrations to cloud-native AWS architectures with Lakehouse implementations.
• Design, build and optimise low-latency data pipelines for real-time betting events.
• Implement data quality, validation, reconciliation and audit controls across data domains.
• Develop streaming solutions using AWS Kinesis, Kafka or MSK for real-time feeds.
• Utilise AWS services such as S3, Glue, Lambda, Athena, Redshift, Lake Formation and MWAA.
• Support regulatory reporting and ensure data pipelines are auditable and compliant.
• Collaborate with architects and cross-functional teams to design scalable data platforms.
• Mentor junior engineers and contribute to solution design sessions and client workshops.

Skills

Python

SQL

Spark

dbt

Airflow

Tools

Terraform

AWS CDK

Databricks

Snowflake

AWS Kinesis

Great Expectations

Job description

CreateFuture in the UK is hiring a Senior Data Engineer to join our Data Practice. You’ll deliver data solutions for major operators, handling sub-second odds feeds, regulatory reporting, and large-scale cloud migrations from on-prem to cloud-native AWS architectures.

You’ll design low-latency pipelines using AWS services and streaming tech, validate data quality, and collaborate with cross-functional teams. Hybrid/remote work available across our UK hubs, with mentoring responsibilities.