Senior Data Engineer, AI Biomedical Platform (Remote)

Absentia Labs; San Francisco (CA); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Equity participation

Flexible remote or hybrid work

Job summary

Absentia Labs is seeking a Senior Data Engineer to own the design and evolution of a biomedical data platform. You will work with autonomy on long-horizon architectural decisions while remaining hands-on in implementation.

The role is ideal for engineers who thrive in ambiguity and value data correctness as much as scale. You will collaborate with ML researchers, scientists, and product leads and influence data modeling and schema evolution.

Qualifications

• 5+ years in data engineering or ML infra with production ownership.
• Experience designing and operating large-scale data pipelines.
• Strong Python and data-centric software engineering practices.
• Deep experience with cloud platforms (AWS/GCP/Azure) and security primitives.
• Familiarity with distributed processing and orchestration systems (Spark/Beam/Ray/Airflow).
• Experience supporting ML/AI workloads and reproducible training workflows.
• Strong architectural judgment and cross-disciplinary communication.

Responsibilities

• Architect and lead end-to-end data systems for large biomedical datasets.
• Define and evolve schema-driven data models across heterogeneous sources.
• Establish data quality, provenance, lineage, and versioning practices.
• Build and maintain cloud-native data infrastructure with focus on scalability.
• Design pipelines for batch and streaming ML training, evaluation, and inference.
• Partner with ML engineers, scientists, and product leads to translate needs into data abstractions.
• Make trade-offs around performance, cost, and correctness in production.
• Provide technical leadership through design reviews and mentorship.
• Address systemic risks in data integrity and operational complexity.

Skills

Python

Data pipelines

System design

Collaboration

Mentorship

Tools

Spark

Beam

Ray

Airflow

Dagster

Terraform

Docker

Kubernetes

AWS/GCP/Azure

Kafka

Pub/Sub

Kinesis

Job description

Absentia Labs is seeking a Senior Data Engineer to own the design and evolution of a biomedical data platform. You will work with autonomy on long-horizon architectural decisions while remaining hands-on in implementation.

The role is ideal for engineers who thrive in ambiguity and value data correctness as much as scale. You will collaborate with ML researchers, scientists, and product leads and influence data modeling and schema evolution.