Senior Data Engineer — Data Platform & Pipelines

The Alan Turing Institute; City Of London; On-site; GBP 57,000 - 69,000; Full time

Benefits offered by this job

Flexible working

Family-friendly policies

Job summary

The Alan Turing Institute is seeking a Senior Data Engineer to design and build data pipelines and infrastructure that transform complex, heterogeneous data into reliable resources. You will focus on the data layer underpinning analyst tools, including datasets, data models and serving layers, while shaping feature pipelines and evaluation data as the team grows.

You will establish and maintain the data platform across cloud and on-premise environments, addressing storage, compute, orchestration

Qualifications

• Experience designing, building and operating production data pipelines at scale.
• Experience with data models and curated datasets for analyst tools.
• Proficient in Python engineering, testing and CI/CD practices.
• Experience deploying data infra using infrastructure-as-code in cloud and/or on-premise environments.
• Ability to work within security constraints and audit requirements.

Responsibilities

• Design, build and operate robust data pipelines ingesting and structuring large data volumes.
• Maintain and evolve the data platform across cloud and on-premise environments.
• Collaborate with engineers, data scientists and partner teams to ensure secure, compliant data flows.

Skills

Python

CI/CD

Data pipelines

Data modeling

Infra as code

Cloud & on-prem

Security controls

Cross-team collaboration

Tools

Terraform

Kubernetes

Job description

The Alan Turing Institute is seeking a Senior Data Engineer to design and build data pipelines and infrastructure that transform complex, heterogeneous data into reliable resources. You will focus on the data layer underpinning analyst tools, including datasets, data models and serving layers, while shaping feature pipelines and evaluation data as the team grows.

You will establish and maintain the data platform across cloud and on-premise environments, addressing storage, compute, orchestration