Data engineer in health research

Our Future Health UK; Greater London; Hybrid; GBP 56,000 - 68,000; Full time

Benefits offered by this job

Generous Pension Scheme

30 Days Holiday + Bank Holidays

Enhanced Parental Leave

Cycle to Work Scheme

Home & Tech Savings

Employee Referral Bonus

Wellbeing Support

Central London office in Holborn with

Flexible and remote working

Job summary

Our Future Health UK is building a data platform to power health research at unprecedented scale from our London hub. As a Data Engineer, you will design and implement secure, scalable data pipelines using Python, PySpark, and Azure for researchers and NHS datasets.

You will work with researchers and engineers, review code, and contribute to governance and cloud architecture, with hybrid remote work options and a central London office.

Qualifications

• Proven experience building production-grade data pipelines and ETL processes.
• Excellent Python skills with experience developing scalable data solutions.
• Experience with PySpark or distributed data processing frameworks.
• Experience using GitHub and modern software engineering practices.
• Understanding of cloud-based data platforms, ideally Azure.
• Experience working with sensitive or regulated data and knowledge of secure data handling principles.

Responsibilities

• Building and maintaining data pipelines across our Azure-based platform.
• Translating technical specifications, architecture designs, and Jira tickets into secure, scalable implementations.
• Developing data transformation and ETL processes using Python and PySpark.
• Working with healthcare and NHS datasets to curate trusted, research-ready data assets.
• Reviewing and approving code through pull requests, ensuring consistency, quality, security, and adherence to engineering standards.
• Collaborating with researchers, engineers, and stakeholders to understand requirements and deliver solutions.
• Producing documentation, source-to-target mappings, and supporting technical standards across the platform.
• Contributing to best practices in data engineering, security, governance, and cloud architecture.

Skills

Data pipelines

Python

PySpark

Git/GitHub

Azure

Secure data handling

Code reviews

Stakeholder management

NHS healthcare data

Tools

Databricks

Kubernetes

Dagster

SQL

Job description

Описание

We're creating a data platform that enables cutting‑edge health research at unprecedented scale. As a Data Engineer, you'll play a critical role in designing and building the secure, high‑quality data pipelines that power research used by scientists and healthcare innovators around the world.

Задачи

• Building and maintaining data pipelines across our Azure-based platform
• Translating technical specifications, architecture designs, and Jira tickets into secure, scalable implementations
• Developing data transformation and ETL processes using Python and PySpark
• Working with healthcare and NHS datasets to curate trusted, research‑ready data assets
• Reviewing and approving code through pull requests, ensuring consistency, quality, security, and adherence to engineering standards
• Collaborating with researchers, engineers, and stakeholders to understand requirements and deliver solutions
• Identifying risks, challenging assumptions, and asking the right questions to improve designs before implementation
• Producing documentation, source‑to‑target mappings, and supporting technical standards across the platform
• Contributing to best practices in data engineering, security, governance, and cloud architecture

Требования

• Proven experience building production‑grade data pipelines and ETL processes
• Excellent Python skills with experience developing scalable data solutions
• Experience working with PySpark or distributed data processing frameworks
• Experience using GitHub and modern software engineering practices
• Understanding of cloud‑based data platforms, ideally Azure
• Experience working with sensitive or regulated data and knowledge of secure data handling principles
• Ability to review technical designs and architecture documents and translate them into practical implementations
• Excellent problem‑solving skills and an ability to challenge requirements constructively when needed
• Experience conducting code reviews and maintaining engineering standardsExcellent stakeholder management and communication skills
• Будет плюсом: Experience working with NHS or healthcare datasets; Knowledge of healthcare coding systems and standards such as SNOMED CT, ICD, or READ codes; Experience with Databricks; Experience with Kubernetes; Experience using Dagster or other workflow orchestration platforms; SQL and data modelling experience; Understanding of metadata management and data governance frameworks

Условия

Salary from £62,000 per annum. We are interested in applications from people with a range of experience for this role

• Generous Pension Scheme - We invest in your future with employer contributions of up to 12%
• 30 Days Holiday + Bank Holidays - Enjoy a generous holiday allowance with the flexibility to take bank holidays when it suits you
• Enhanced Parental Leave - Supporting you during life's biggest moments
• Cycle to Work Scheme - Save 25-39% on a new bike and accessories through salary sacrifice
• Home & Tech Savings - Get up to 8% off on IKEA and Currys products, spreading the cost over 12 months through salary sacrifice
• £1,000 Employee Referral Bonus - Know someone amazing? Get rewarded for bringing them on board!
• Wellbeing Support - Access to Mental Health First Aiders, plus 24/7 online GP services and an Employee Assistance Programme for you and your family
• A Great Place to Work - We have a lovely Central London office in Holborn, and offer flexible and remote working arrangements