Health Data Engineer — Secure Pipelines (Azure PySpark)

Our Future Health UK; Greater London; Hybrid; GBP 53,000 - 71,000; Full time

Benefits offered by this job

Pension scheme

Holiday allowance

Parental leave

Cycle to work

Home & tech savings

Referral bonus

Wellbeing support

Holborn office with flexible/remote

Job summary

Our Future Health UK is building a data platform to enable cutting-edge health research. As a Data Engineer, you will design and implement secure, scalable data pipelines powering researchers and healthcare innovators across the globe.

You'll work with Azure-based pipelines, collaborate with engineers, researchers, and domain experts, and translate architectural designs into practical, compliant solutions. A strong focus on security, governance, and quality is essential.

Qualifications

• Proven experience building production-grade data pipelines and ETL processes.
• Excellent Python skills with experience developing scalable data solutions.
• Experience with PySpark or distributed data processing frameworks.
• Experience using GitHub and modern software engineering practices.
• Understanding of cloud-based data platforms, ideally Azure.
• Experience with sensitive or regulated data and knowledge of secure data handling principles.
• Ability to review technical designs and translate them into practical implementations.
• Excellent problem-solving and stakeholder management skills.
• Experience with NHS or healthcare datasets and healthcare coding systems.

Responsibilities

• Building and maintaining data pipelines across our Azure-based platform.
• Translating technical specifications, architecture designs, and Jira tickets into secure, scalable implementations.
• Developing data transformation and ETL processes using Python and PySpark.
• Working with healthcare and NHS datasets to curate trusted, research-ready data assets.
• Reviewing and approving code through pull requests, ensuring consistency, quality, security, and adherence to engineering standards.
• Collaborating with researchers, engineers, and stakeholders to understand requirements and deliver solutions.
• Identifying risks, challenging assumptions, and asking the right questions to improve designs before implementation.
• Producing documentation, source-to-target mappings, and supporting technical standards across the platform.
• Contributing to best practices in data engineering, security, governance, and cloud architecture.

Skills

Python

Data pipelines

PySpark

GitHub

Azure

Security

NHS data

Data governance

Tools

Databricks

Kubernetes

Dagster

Azure

Job description

Our Future Health UK is building a data platform to enable cutting-edge health research. As a Data Engineer, you will design and implement secure, scalable data pipelines powering researchers and healthcare innovators across the globe.

You'll work with Azure-based pipelines, collaborate with engineers, researchers, and domain experts, and translate architectural designs into practical, compliant solutions. A strong focus on security, governance, and quality is essential.