Senior Data Engineer — Cloud‑Native ML & Real‑Time APIs

The BDPN; Greater London; Hybrid; GBP 51,000 - 69,000; Full time

Benefits offered by this job

Flexible benefits

Hybrid work options

Annual bonus

Pension scheme

Employee discount

Job summary

Allianz in London is seeking a Senior Data Engineer to design, build and operate production-grade data and ML services, including real-time endpoints serving 10 million+ requests. You will deploy, scale, and monitor containerised apps using Docker and Kubernetes, and construct cloud solutions with Terraform.

The role emphasizes CI/CD automation via Azure DevOps or GitHub Actions, and strong Python for data pipelines.

Qualifications

• Experience deploying, monitoring and maintaining production services.
• Containerisation (Docker) & Service orchestration (Kubernetes or similar).
• Managing and maintaining real-time endpoints or APIs.
• Experience building cloud infrastructure for data or predictive services (Terraform; Azure preferred).
• CI/CD tooling experience (Azure DevOps or GitHub Actions).
• Familiarity with data governance and GDPR requirements.

Responsibilities

• Design, build, and operate production-grade data/ML services with real-time endpoints.
• Build, deploy, and orchestrate Docker containers for scalable workloads.
• Design, build, and maintain cloud solutions using Infrastructure as Code (Terraform).
• Develop monitoring to ensure reliability, performance and security of ML systems.
• Create CI/CD pipelines to automate workflows with Azure DevOps or GitHub Actions.
• Write clean, well-tested Python data pipelines and features for analytics.

Skills

Python

Agile

Communication

GDPR & Data governance

LLMs familiarity

Insurance/Financial services domain

Tools

Docker

Kubernetes

Terraform

Azure DevOps

GitHub Actions

Job description

Allianz in London is seeking a Senior Data Engineer to design, build and operate production-grade data and ML services, including real-time endpoints serving 10 million+ requests. You will deploy, scale, and monitor containerised apps using Docker and Kubernetes, and construct cloud solutions with Terraform.

The role emphasizes CI/CD automation via Azure DevOps or GitHub Actions, and strong Python for data pipelines.