Bio Data Engineer: AI-Driven Pipelines & Lakehouse

Relation; Greater London; On-site; GBP 90,000 - 120,000; Full time

Job summary

Relation, a TechBio company in London, is hiring a Research Data Engineer to design and build scalable data systems powering next-generation predictive models of cellular behaviour. You will work on multi-modal scientific datasets, enabling efficient model training and experimentation across wet and dry labs.

You will scale data platforms, ensure data quality, and collaborate with ML scientists and research engineers to translate insights into impact for patients.

Qualifications

• Degree in CS, Engineering, or related quantitative field.
• Excellent Python engineering skills.
• Cloud-native data infrastructure (AWS S3 / GCS) and Infrastructure-as-Code (Terraform).
• Experience designing data pipelines for large, heterogeneous datasets.
• Experience with modern data processing engines (Spark, Polars, Dask, DuckDB).
• Hands-on with workflow orchestration (Airflow, Dagster, Prefect) and containers (Docker, Kubernetes).
• Knowledge of columnar formats (Parquet, Zarr, TileDB, HDF5) and lakehouse tech.
• Experience partnering with scientific/research users.
• Bonus: biomedical/genomics data; regulated pharma environments; data governance.

Responsibilities

• Design, build, and maintain scalable data pipelines ingesting multi-modal scientific data.
• Optimise data movement, storage layouts, and access patterns for analytics and ML.
• Stand up and evolve cloud-native data lake / lakehouse infrastructure.
• Implement data versioning, lineage, and quality monitoring.
• Partner with data scientists to ensure fast and seamless data workflows.
• Collaborate with ML scientists and researchers to design data representations for model training.
• Build and operate workflow orchestration for production pipelines and large-scale batch jobs.
• Ensure infrastructure meets security, audit, and governance requirements.
• Champion engineering best practices across the data platform.
• Contribute to architecture decisions across the broader ML platform.

Skills

Python

Workflow orchestration

Data pipelines

Cloud data infra

Terraform

Docker

Kubernetes

Spark

Education

Degree in CS/Engineering

Tools

AWS S3

GCS

Airflow

Job description

Relation, a TechBio company in London, is hiring a Research Data Engineer to design and build scalable data systems powering next-generation predictive models of cellular behaviour. You will work on multi-modal scientific datasets, enabling efficient model training and experimentation across wet and dry labs.

You will scale data platforms, ensure data quality, and collaborate with ML scientists and research engineers to translate insights into impact for patients.