Senior / Staff Data Engineer

Biohub; New York (NY); On-site; USD 241,000 - 338,000; Full time

Benefits offered by this job

Generous 401(k) employer match

Paid time off for volunteering

Funding for family-forming benefits

Relocation support

Job summary

Biohub is seeking a Data Engineer to design and implement data pipelines for genomic and imaging data at scale. This role requires strong software engineering skills and experience with distributed computing frameworks.

The ideal candidate will have 8+ years of experience and familiarity with cloud infrastructure like AWS. The role offers a competitive salary ranging from $241,000 to $338,000 annually.

Qualifications

• 8+ years experience building reliable, operable data systems at scale (100s terabytes to petabytes).
• Strong software engineering fundamentals.
• Experience deploying distributed computing frameworks like Databricks, Spark, or Ray for large-scale data processing.

Responsibilities

• Design and build data pipelines that process genomic and imaging data at petabyte scale.
• Solve performance and bandwidth challenges with creative engineering.
• Collaborate with AI Research teams.

Skills

Building reliable, operable data systems at scale

Strong software engineering fundamentals

Deploying distributed computing frameworks

Experience with cloud infrastructure

AI-native development practices

Education

8+ years experience in data systems

Tools

Databricks

Spark

Ray

AWS

Job description

Biohub is the first large-scale initiative bringing frontier AI models, massive compute, and frontier experimental capabilities under one roof. We're building a general‑purpose system to accelerate scientific discovery, integrating frontier AI models, biological foundation models, and lab capabilities, with the ultimate goal of curing disease. Our technology powers scientists around the world, translating AI capabilities into tools that accelerate research everywhere.

The Team

Biohub is a 501(c)(3) biomedical research organization building the first large‑scale scientific initiative combining frontier AI with frontier biology to solve disease. We build the technology to help scientists around the world use AI‑powered biology to study how cells operate, organize, and work as part of systems to understand why disease happens and how to correct it. With our compute capacity, AI research and engineering, and state‑of‑the‑art technology for measuring, imaging, and programming biology, we are enabling scientists worldwide to use AI‑powered biology to advance our understanding of human health.

The Opportunity

The role is part of the Data Engineering team, which focuses on owning the strategy, sourcing and implementation for data supporting AI research and development. Our goal is to maximize the speed, agility, and capability of biological AI research by connecting public data resources and Biohub's experimental platforms to AI systems. The data that trains biological frontier models comes in dozens of modalities (sequences, images, spatial coordinates, time series, molecular structures, metadata, publication artifacts) each with its own noise characteristics, biases, and information content. The question of how to represent this data for learning is one of the most important open problems in biological AI.

As a data engineer at Biohub, you'll be designing systems that ingest data from public repositories, transform heterogeneous biological formats into AI‑ready datasets, combine that with proprietary datasets, and deliver training datasets to researchers pushing the boundaries of what's possible in biological AI. The infrastructure you build will directly shape what our models can learn.

We're a small team with significant resources and long time horizons. We use AI tools aggressively in our own work—Claude Code, agents for workflow automation, LLMs for metadata extraction. We care about code quality, operational reliability, and building systems that scale. And we care about the biology: we want engineers who can recognize when a pipeline output is technically correct but scientifically wrong.

If you want to work at the intersection of large‑scale infrastructure and frontier science, with real autonomy and the chance to build something genuinely new, we'd like to talk.

What You'll Do

• Design and build data pipelines that process genomic and imaging data at petabyte scale
• Solve performance and bandwidth challenges with creative engineering
• Build agent‑based systems for automated dataset curation, quality control, and workflow generation
• Create tooling for data cataloging and registration that makes datasets discoverable and accessible
• Collaborate with AI Research teams to translate model requirements into data specifications, and with our scientists to integrate public and internal data into large‑scale AI‑ready datasets
• Improve pipeline reliability and observability, working toward 99%+ success rates without manual intervention

What You’ll Bring

• 8+ years experience building reliable, operable data systems at scale (100s terabytes to petabytes)
• Strong software engineering fundamentals
• Experience deploying distributed computing frameworks like Databricks, Spark, or Ray for large‑scale data processing
• Experience with cloud infrastructure (AWS preferred) and HPC environments
• Comfort with ambiguity; ability to make progress when requirements are evolving
• Interest in AI‑native development practices and tooling
• Nice to have: Background in computational biology, bioinformatics, or life sciences and experience with genomics datasets and formats (FASTQ, BAM, VCF) or imaging formats (OME‑Zarr, HDF5)

Compensation

The future anticipated Redwood City, CA, and New York City, NY base pay range for a role in this field is $241,000–$338,000 annually. Compensation ranges will vary based on job‑related skills, level of experience, and knowledge. Actual placement in range is based on job‑related skills and experience, as evaluated throughout the interview process.

Benefits for the Whole You

• Provides a generous employer match on employee 401(k) contributions to support planning for the future
• Paid time off to volunteer at an organization of your choice
• Funding for select family‑forming benefits
• Relocation support for employees who need assistance moving

If you’re interested in a role but your previous experience doesn’t perfectly align with each qualification in the job description, we still encourage you to apply as you may be the perfect fit for this or another role.