Senior Data Platform Engineer — Cloud Pipelines & AI

Engg; Cambridge (MA); On-site; USD 140,000 - 180,000; Full time

Job summary

Flagship Pioneering’s Scientific Cloud team seeks a Lead Data Engineer to architect and deliver scalable data pipelines and platform solutions across I&O, Lab IT, and PI Tech. You will shape data infrastructure and set standards for reliability and performance.

In this senior IC role, you will mentor engineers, work with scientific stakeholders, and apply AI tools to accelerate pipeline development while ensuring secure, compliant data handling across cloud-first environments.

Qualifications

• 6+ years of hands-on data engineering experience, preferably in life sciences or healthcare.
• Strong design and operation of cloud-native data architectures in AWS.
• Advanced Python and SQL for pipelines and automation.
• Experience with Dagster, dbt, Spark, Iceberg, Lake Formation, Athena, Glue.
• Solid Git, CI/CD, CDK, containers (Docker) and ECS.
• Experience with structured and unstructured data (CSV, JSON, Parquet, imaging).
• Proven track record of leading complex cross-functional projects with stakeholders.
• Practical use of generative AI tools to accelerate pipelines.

Responsibilities

• Serve as technical lead on complex data engineering projects across interdependent systems.
• Lead implementation of data infrastructure, platforms, tools, and data products.
• Improve reliability of data storage solutions (lakehouses, marts, warehouses).
• Build backend and integration pipelines for data lakes and marts.
• Establish engineering standards for testing, docs, releases, monitoring.
• Lead platform observability, management, resilience, capacity and performance.
• Mentor junior engineers and promote repeatable engineering standards.
• Collaborate with I&O, Lab IT and data science teams to align architectures.

Skills

Python

SQL

Dagster

dbt

Spark

Iceberg

Lake Formation

Athena

Glue

AWS

Docker

ECS

Git

CI/CD

AI tooling

Data pipelines

Education

AWS Solutions Architect Associate

Data Analytics Certification

Tools

Dagster

dbt

Spark

Iceberg

Lake Formation

Athena

Glue

CDK

Docker

ECS

Job description

Flagship Pioneering’s Scientific Cloud team seeks a Lead Data Engineer to architect and deliver scalable data pipelines and platform solutions across I&O, Lab IT, and PI Tech. You will shape data infrastructure and set standards for reliability and performance.

In this senior IC role, you will mentor engineers, work with scientific stakeholders, and apply AI tools to accelerate pipeline development while ensuring secure, compliant data handling across cloud-first environments.