Genomics Data Engineer: Scalable Cloud Pipelines

Genomics England; Greater London; Hybrid; GBP 68,000 - 83,000; Full time

Benefits offered by this job

Generous Leave

Pension

Headspace access

Learning budget

Flexible working

Job summary

Genomics England is seeking an experienced Data Engineer to design, build and optimise large-scale data pipelines for genomic and clinical data. You will work on AWS-based data platforms, leveraging Python and modern orchestration tools to deliver secure, scalable data services.

The role sits in the Generate Research Data (GRD) service, collaborating with internal and external partners to onboard new data and support the National Genomic Research Library.

Qualifications

• Proven hands-on experience designing and optimising data pipelines.
• Strong AWS and cloud data engineering skills.
• Strong Python coding and CI/CD experience.
• Experience with data models and delivering reliable data products.
• Understanding of data quality, lineage, metadata management and governance.
• Experience with regulated healthcare data and security considerations.
• Knowledge of healthcare data standards (FHIR, HL7) is a bonus.

Responsibilities

• Designing, building and optimising scalable data pipelines from data acquisition to delivery.
• Handling large volumes of clinical and genomic data with data lineage and de-identification.
• Building data solutions in AWS and cloud-first architectures.
• Collaborating with engineering, QA, architecture and product teams to deliver integrated data services.
• Supporting machine learning and data visualisation initiatives with reliable data pipelines.

Skills

Data pipelines

Python

AWS

ETL/ELT

Data modeling

Data governance

Security/compliance

Tools

Prefect

Tableau

Semarchy

Aspera

Globus

RDBMS

Job description

Genomics England is seeking an experienced Data Engineer to design, build and optimise large-scale data pipelines for genomic and clinical data. You will work on AWS-based data platforms, leveraging Python and modern orchestration tools to deliver secure, scalable data services.

The role sits in the Generate Research Data (GRD) service, collaborating with internal and external partners to onboard new data and support the National Genomic Research Library.