Enable job alerts via email!

Senior Data Engineer (NHS)

Our Future Health UK

London

On-site

GBP 70,000 - 110,000

Full time

3 days ago

Be an early applicant

Boost your interview chances

Create a job specific, tailored resume for higher success rate.

Job summary

A leading company in health data is seeking a Senior Data Engineer to join their mission-driven team, focusing on building data pipelines from NHS health data. The role includes collaborating with multidisciplinary teams and following best practices in data engineering to provide valuable insights for researchers.

Benefits

Generous Pension Scheme - Employer contributions up to 12%

30 Days Holiday + Bank Holidays

Career Growth & Development - £500 per year for learning

Cycle to Work Scheme

Wellbeing Support - Mental Health First Aiders

Employee Referral Bonus - £1,000

Qualifications

Experience with NHS datasets and understanding of primary/secondary care data.
Experience in building scalable data pipelines.
Familiarity with data transformation formats like Apache Parquet.

Responsibilities

Support data pipeline construction from providers to primary data store.
Develop data transformation logic according to user needs.
Collaborate with data scientists to understand data requirements.

Skills

Data Pipeline Building

Python

Communication

Data Transformation

Agile Development

Tools

Docker

Kubernetes

Spark

Databricks

Azure

Get AI-powered advice on this job and more exclusive features.

We're looking for a Senior Data Engineer to join our supportive and mission-driven Data Team. This is an exciting opportunity to work on a nationally significant programme powered by NHS health data — helping researchers solve complex challenges on a truly industrial with global significance.

In this role, you'll bring your experience working with NHS datasets to help design, build, and maintain data pipelines that enable trusted, high-quality insights. You'll collaborate closely with colleagues across multiple disciplines — from Researchers and Epidemiologists to Software Engineers and Product Leads — contributing to a shared code base that delivers real-world health data for discovery.

What You'll Be Doing:

Support the build of data pipelines from data providers to our primary data store and trusted research environment. Support the design, scoping and build of data flows
Produce logic for data transformation steps as code, which meets the requirements for our end users and builds well curated, accessible and quality controlled data for analysis
Contribute to code base for multiple data pipelines while ensuring best coding practises are used
The opportunity to work with Data Scientists and Epidemiologists to understand their data requirements and collaborate with them to deliver the data needed for their projects
Keep abreast of best practice in data engineering across industry, research and Government and facilitating the adoption of these standards

Requirements

Experience building and maintaining robust, scalable and efficient data pipelines. Capable of processing very large amounts of data based on feeds from multiple systems using a range of different technologies
You're an empathetic communicator, comfortable bridging technical and non-technical perspectives
You're confident working with NHS health data and understand the nuances of secondary and primary care datasets (Hospital Episodes Statistics, Death registry data, A&E data etc) as well as Primary care (GP data) would be advantageous
Highly proficient in Python with solid command line knowledge and Unix skills
Good understanding of cloud environments (ideally Azure), distributed computing and optimising workflows and pipelines
Understanding of common data transformation and storage formats, e.g. Apache Parquet, Delta tables
Understanding of containerisation (e.g. Docker) and deployment (e.g. Kubernetes)
Working knowledge using Spark, Databricks, Data Lakes
Follow best practices like code review, clean code and unit tests.
You're comfortable working in an agile development team, familiar with version control and Git/GitHub
Awareness/interest of data standards such as GA4GH ( https://www.ga4gh.org/) and FAIR (https://www.go-fair.org/fair-principles/)
You're experienced in contributing to and navigating shared codebases within multi-person teams

Benefits

Competitive base salary
Generous Pension Scheme - We invest in your future with employer contributions of up to 12%
30 Days Holiday + Bank Holidays - Enjoy a generous holiday allowance with the flexibility to take bank holidays when it suits you
Enhanced Parental Leave - Supporting you during life's biggest moments
Career Growth & Development - £500 per year to spend on Learnerbly, our learning platform, plus regular appraisals and development opportunities
Cycle to Work Scheme - Save 25-39% on a new bike and accessories through salary sacrifice
Home & Tech Savings - Get up to 8% off on IKEA and Currys products, spreading the cost over 12 months through salary sacrifice
£1,000 Employee Referral Bonus - Know someone amazing? Get rewarded for bringing them on board!
Wellbeing Support - Access to Mental Health First Aiders, plus 24/7 online GP services and an Employee Assistance Programme for you and your family
A Great Place to Work - We have a lovely Central London office in Holborn, and offer flexible and remote working arrangements

Join us - let's prevent disease together.

Seniority level

Seniority level
Mid-Senior level

Employment type

Employment type
Full-time

Job function

Industries
IT Services and IT Consulting

Referrals increase your chances of interviewing at Our Future Health UK by 2x

London, England, United Kingdom 4 hours ago

London, England, United Kingdom 21 hours ago

London, England, United Kingdom 4 hours ago