Data Engineer: Secure Health Data Pipelines on Azure

Our Future Health; Greater London; Hybrid; GBP 56,000 - 68,000; Full time

Benefits offered by this job

Generous pension

30 days holiday + bank holidays

Enhanced parental leave

Cycle to work scheme

Home & tech savings

Employee referral bonus

Wellbeing support

Central London office with flexible/ro

Job summary

Our Future Health in London is seeking a Data Engineer to design and build secure, scalable data pipelines on Azure. You will translate architectural designs and Jira tickets into reliable solutions, working with NHS datasets to curate trusted data assets for health research.

The role emphasizes security, governance, and auditable pipelines, with collaboration across researchers, engineers and stakeholders.

Qualifications

• Proven experience building production‑grade data pipelines and ETL processes.
• Excellent Python skills with experience developing scalable data solutions.
• Experience with PySpark or distributed data processing frameworks.
• Experience using GitHub and modern software engineering practices.
• Understanding of cloud‑based data platforms, ideally Azure.
• Experience working with sensitive or regulated data and knowledge of secure data handling principles.
• Ability to review technical designs and architecture documents and translate them into practical implementations.
• Excellent problem‑solving skills and an ability to challenge requirements constructively.
• Experience conducting code reviews and maintaining engineering standards.
• Excellent stakeholder management and communication skills.
• Experience working with NHS or healthcare datasets.
• Knowledge of healthcare coding systems and standards such as SNOMED CT, ICD, or READ codes.
• Experience with Databricks.
• Experience with Kubernetes.
• Experience using Dagster or other workflow orchestration platforms.
• SQL and data modelling experience.
• Understanding of metadata management and data governance frameworks.

Responsibilities

• Building and maintaining data pipelines across our Azure-based platform.
• Translating technical specifications, architecture designs, and Jira tickets into secure, scalable implementations.
• Developing data transformation and ETL processes using Python and PySpark.
• Working with healthcare and NHS datasets to curate trusted, research-ready data assets.
• Reviewing and approving code through pull requests, ensuring consistency, quality, security, and adherence to engineering standards.
• Collaborating with researchers, engineers, and stakeholders to understand requirements and deliver solutions.
• Identifying risks, challenging assumptions, and asking the right questions to improve designs before implementation.
• Producing documentation, source-to-target mappings, and supporting technical standards across the platform.
• Contributing to best practices in data engineering, security, governance, and cloud architecture.

Skills

Python

PySpark

SQL

GitHub

Databricks

Kubernetes

Dagster

Azure

Data modelling

Data governance

Tools

Databricks

Dagster

Kubernetes

Job description

Our Future Health in London is seeking a Data Engineer to design and build secure, scalable data pipelines on Azure. You will translate architectural designs and Jira tickets into reliable solutions, working with NHS datasets to curate trusted data assets for health research.

The role emphasizes security, governance, and auditable pipelines, with collaboration across researchers, engineers and stakeholders.