Senior Data Engineer, Healthcare: Scalable Pipelines

Remote Worker LTD.; United States; Remote; USD 98,000 - 119,000; Full time

Benefits offered by this job

Competitive base salary

Generous pension scheme

30 days holiday + bank holidays

Parental leave

Cycle to work

Home & tech savings

EV scheme

Employee referral bonus

Wellbeing support

Central London office with flexible/ro

Job summary

Our Future Health, the UK's largest health research programme, is seeking a Senior Data Engineer with deep healthcare data expertise to design scalable pipelines and data products for research use. You will work across engineering, data science and epidemiology to deliver trusted datasets, and help set technical direction.

You will transform OMOP/FHIR data, implement quality controls, collaborate with researchers and product teams, and publish clear documentation while leveraging Azure, Spark,

Qualifications

• Proven data engineering experience in large-scale environments.
• Experience designing and maintaining scalable data pipelines from multiple sources.
• Experience with healthcare data across academia, healthcare, life sciences or health tech.
• Knowledge of OMOP and/or FHIR data models.
• Experience transforming data between CDMs.
• Understanding of healthcare terminologies (SNOMED CT, ICD-10).
• Proficiency in Python and software engineering best practices.
• Good command-line and Unix/Linux skills.
• Experience with Azure cloud, Spark, Databricks and data lake architectures.
• Experience with Docker/Kubernetes and Git workflows.
• Experience working in Agile delivery teams.

Responsibilities

• Designing and building scalable data pipelines ingesting healthcare data into trusted research environments.
• Developing data transformation logic in Python to create curated datasets.
• Contributing to shared codebases with testing, reviews and clean coding standards.
• Collaborating with data scientists, epidemiologists and product teams to deliver data solutions.
• Implementing data quality, validation and governance controls at scale.
• Transforming healthcare data to common data models like OMOP and FHIR.
• Creating reusable data products for multiple stakeholders.
• Producing clear technical documentation for pipelines and architectures.
• Supporting data flows across the healthcare data ecosystem.
• Leveraging Azure, Databricks, Spark and Data Lakes for high performance solutions.
• Promoting data standards and best practices across the team.
• Staying updated on trends in healthcare, research and data engineering.

Skills

Data engineering

Python

Unix/Linux

Agile delivery

Stakeholder collaboration

Education

Master's degree in Computer Science or related field

Tools

Azure

Spark

Databricks

Delta Lake

Parquet

Docker

Kubernetes

Git/GitHub

Job description

Our Future Health, the UK's largest health research programme, is seeking a Senior Data Engineer with deep healthcare data expertise to design scalable pipelines and data products for research use. You will work across engineering, data science and epidemiology to deliver trusted datasets, and help set technical direction.

You will transform OMOP/FHIR data, implement quality controls, collaborate with researchers and product teams, and publish clear documentation while leveraging Azure, Spark,