Senior Data Engineer - Real-Time AWS Serverless Platform

Allwyn Lottery Solutions; Greater London; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Health and life insurance

Well-being allowance

Flexible working options

Extensive training resources

Job summary

Allwyn Lottery Solutions seeks an experienced data engineer to architect and deploy AWS serverless data pipelines for real-time streams and analytics, serving international clients. You will integrate marketing tech including a real-time CDP, and lead data ingestion, processing, and monitoring across the stack.

You will also mentor application support staff and collaborate with developers to enhance the gaming platform integration, ensuring robust, cost-efficient, and scalable data solutions.

Qualifications

• Advanced AWS Serverless design and development experience is required.
• Experience with streaming technologies (SQS, Kinesis, MSK).
• Experience with NoSQL stores (DynamoDB) and serverless compute (Lambda/Glue).
• Orchestrating serverless compute with MWAA and Step Functions.
• SQL data stores such as Athena and Aurora; storage in S3.

Responsibilities

• Architect robust data ingestion streams for real-time processing and analytics.
• Contribute to platform data models (logical/physical).
• Develop ETL/ELT routines for analytics.
• Build integrations to APIs, flat files, ERP/e-commerce/CRM systems.
• Collaborate with developers to enhance gaming platform integration.
• Support testing and deployment processes.
• Develop automated monitoring, fault recovery, and diagnostics.
• Document outputs and mentor local support specialists.

Skills

AWS Serverless

Python

Data modeling

Pandas

SQL (Athena/Aurora)

Streaming (Kinesis)

NoSQL (DynamoDB)

Lambda

MWAA/Step Functions

S3 storage

APIs

CloudWatch

IAM

Cost optimization

Tools

AWS

Python

Glue

Lambda

Kinesis

S3

DynamoDB

Athena

Aurora

MWAA

Step Functions

Pandas

Job description

Allwyn Lottery Solutions seeks an experienced data engineer to architect and deploy AWS serverless data pipelines for real-time streams and analytics, serving international clients. You will integrate marketing tech including a real-time CDP, and lead data ingestion, processing, and monitoring across the stack.

You will also mentor application support staff and collaborate with developers to enhance the gaming platform integration, ensuring robust, cost-efficient, and scalable data solutions.