Senior Data Engineer

Black Swans Exist

United States

Remote

USD 100,000 - 140,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Black Swans Exist seeks a Senior Data Engineer to build the data foundation for a life sciences SaaS platform. You will design scalable data pipelines, ingestion and transformation components, and robust data models for complex experimental datasets.

You will connect data sources, backend services, and modelling workflows, implementing batch and streaming data flows with Airflow, Flyte, or similar tools. You will collaborate with scientists, engineers, and customers to translate data

Qualifications

  • Strong Python experience across backend and data engineering.
  • Experience designing production data pipelines and ETL/ELT processes.
  • Strong SQL and relational database experience, ideally PostgreSQL.
  • Experience with data modelling and query optimisation for large datasets.

Responsibilities

  • Designing and building scalable data pipelines and backend data services.
  • Developing ingestion, transformation, and data-serving components for scientific data.
  • Building data models and storage schemas for complex experimental datasets.
  • Connecting data sources, backend services, computational engines, and modelling workflows.
  • Building batch and streaming workflows using tools such as Airflow, Flyte, or similar.
  • Improving data validation, quality checks, lineage, observability, and reliability.
  • Leading data architecture decisions across pipelines, data models, governance, access, quality, lineage, and compliance.
  • Supporting customer discussions around data requirements, onboarding, solution design, and technical trade-offs.
  • Working directly with scientists, engineers, customers, and technical stakeholders.

Skills

Python
ETL/ELT
SQL
PostgreSQL
Airflow
Flyte
REST APIs
Cloud platforms
CI/CD
Data quality
Data governance
Data modelling

Job description

Senior Data Engineer — Scientific Data Platforms / Life Sciences SaaS

Remote — Europe / UK based

We are supporting a search for a Senior Data Engineer within a growing life sciences software and solutions company building data-heavy products for scientific and technical teams.

This is a strong opportunity for someone who wants to build data systems close to real life sciences problems, not just generic BI or warehouse work. The platform supports complex scientific workflows where experimental data, model inputs, data quality, structure, lineage, and reliability really matter.

The role sits between backend engineers, data scientists, modelling specialists, domain experts, infrastructure teams, and customer stakeholders. You would help design the data foundation behind a modern life sciences software platform, covering ingestion, transformation, data models, data services, orchestration, quality checks, governance, and customer-facing data architecture.

This would suit someone who enjoys working with complex, messy, high-value scientific data and turning it into reliable systems that scientists, engineers, and customers can actually use. It is also a customer-facing role, so you would need to be comfortable understanding scientific data requirements, discussing technical trade-offs, and translating them into practical architecture and platform decisions.

There is room to shape the data architecture, standards, reference designs, and governance approach as the platform grows. It should be especially interesting for someone who wants more ownership than a narrow pipeline-building role, but does not want to move fully away from technical, data-heavy, scientific or life sciences workflows.

The role will focus on:
  • Designing and building scalable data pipelines and backend data services
  • Developing ingestion, transformation, and data-serving components for scientific data
  • Building data models and storage schemas for complex experimental datasets
  • Connecting data sources, backend services, computational engines, and modelling workflows
  • Building batch and streaming workflows using tools such as Airflow, Flyte, or similar
  • Improving data validation, quality checks, lineage, observability, and reliability
  • Leading data architecture decisions across pipelines, data models, governance, access, quality, lineage, and compliance
  • Supporting customer discussions around data requirements, onboarding, solution design, and technical trade-offs
  • Working directly with scientists, engineers, customers, and technical stakeholders
We are looking for someone with:
  • Strong Python experience across backend and data engineering
  • Experience designing production data pipelines and ETL/ELT processes
  • Strong SQL and relational database experience, ideally PostgreSQL
  • Experience with data modelling and query optimisation for large datasets
  • Experience with workflow orchestration tools such as Airflow, Flyte, or similar
  • Experience with REST APIs, asynchronous processing, and data integration
  • Good understanding of cloud-based data systems, containers, CI/CD, and production operations
  • Strong focus on data quality, security, maintainability, lineage, and governance
  • Confidence working with customers, scientists, engineers, and non-technical stakeholders
Nice to have:
  • Experience with Azure, AWS, or GCP
  • Experience with Azure Data Factory, Synapse, Microsoft Fabric, ADLS, Databricks, Spark, Snowflake, or BigQuery
  • Experience with Kafka, Event Hubs, streaming data, time-series data, or scientific datasets
  • Familiarity with dbt, Great Expectations, Pandera, OpenLineage, data catalogues, or metadata tooling
  • Experience in life sciences, biotech, pharma, regulated software, scientific SaaS, or complex technical data environments

This is not a generic data platform role. It is for someone who wants to build the data layer behind complex life sciences software, where data quality, structure, and traceability directly affect how useful the product is for scientific and technical teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data & Integration Engineer
Senior Data & Integration Engineer

Evolution USA • United States

On-site
USD 140,000 - 190,000
Senior Scientific Data Engineer
Senior Scientific Data Engineer

Motion Recruitment • Cambridge (MA)

On-site
USD 140,000 - 200,000
Medical Insurance
Dental Benefits
Vision Benefits
+5
Senior Life Sciences Data Engineer – Cambridge, MA
Senior Life Sciences Data Engineer – Cambridge, MA

Motion Recruitment • Cambridge (MA)

On-site
USD 140,000 - 200,000
Medical Insurance (employer paid)
Dental Benefits
Vision Benefits
+4
Senior Life Sciences Data Engineer - Cambridge, MA
Senior Life Sciences Data Engineer - Cambridge, MA

Motion Recruitment • Cambridge (MA)

On-site
USD 140,000 - 200,000
Medical Insurance
Dental Benefits
Vision Benefits
+4
Senior Data Platform Engineer - Life Sciences SaaS (Remote)
Senior Data Platform Engineer - Life Sciences SaaS (Remote)

Black Swans Exist • United States

Remote
USD 100,000 - 140,000
Scientific Data Architect
Scientific Data Architect

Insilico Search Partners • Boston (MA)

On-site
USD 100,000 - 130,000
Senior Data Engineer
Senior Data Engineer

Zoominfo • United States

Remote
USD 110,000 - 170,000
Remote work
Senior Data Engineer
Senior Data Engineer

83zero • Baltimore (MD)

On-site
USD 120,000 - 150,000
Senior Data Engineer
Senior Data Engineer

Recru • Houston (TX)

On-site
USD 130,000 - 180,000
Senior Data Engineer- Data Platform
Senior Data Engineer- Data Platform

vida • United States

Remote
USD 160,000 - 170,000
Remote-eligible role
US-based role (visa not sponsor)