Molecular AI ML Infrastructure Engineer — Fast Pipelines

Genesis Molecular AI; San Mateo (CA); Presencial; USD 140 000 - 210 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health benefits

401(k) plan

Open PTO

Free lunches and dinners

Family leave

Disability insurance

Resumo da oferta

Genesis Molecular AI seeks a Machine Learning Infrastructure Engineer to build data and orchestration systems powering molecular AI. You will design and optimize our in-house orchestration framework and the data preprocessing pipelines that run on top of it.

You will collaborate with ML researchers, computational chemists, and software engineers to reduce latency, enable lazy evaluation and caching, and improve reproducibility across complex scientific workflows.

Qualificações

• Experience building or operating large-scale ETL, data processing, or workflow systems.
• Familiarity with Kubernetes and containerized compute environments.
• Experience with cloud object storage and high-performance computing.
• Knowledge of molecular data formats and tools a plus.

Responsabilidades

• Design and evolve our in-house workflow orchestration framework: DAG construction, execution, scheduling, caching, observability.
• Build and optimize large-scale preprocessing pipelines for protein structures and chemical datasets.
• Profile workflows to remove bottlenecks and reduce latency across distributed systems.
• Develop abstractions for lazy execution and artifact reuse to avoid unnecessary recomputation.
• Collaborate with ML researchers and scientific software engineers to translate workflows into scalable pipelines.
• Improve developer experience for researchers and engineers working on pipelines.

Conhecimentos

DAGs

Distributed systems

Data-intensive pipelines

Workflow orchestration

Performance optimization

Caching & memoization

Python & engineering

Cloud & Kubernetes

ETL pipelines

Formação académica

Experience with data-intensive systems or equivalent

Ferramentas

Apache Spark

GCP Dataflow / Apache Beam

Dagster

Airflow

Kubernetes

Terraform

Open source workflow engines

Descrição da oferta de emprego

Genesis Molecular AI seeks a Machine Learning Infrastructure Engineer to build data and orchestration systems powering molecular AI. You will design and optimize our in-house orchestration framework and the data preprocessing pipelines that run on top of it.

You will collaborate with ML researchers, computational chemists, and software engineers to reduce latency, enable lazy evaluation and caching, and improve reproducibility across complex scientific workflows.