Senior Data Engineer, Scientific Data Ingestion & AI

Mithrl; San Francisco (CA); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Comprehensive PPO health coverage

401(k) with top-tier plans

High ownership and autonomy

Job summary

A cutting-edge biotech company in San Francisco is seeking a Data Engineer to build AI-powered data ingestion pipelines from various sources. The role demands strong expertise in data engineering and Python, with a focus on data normalization and quality control. As part of a dynamic team, you will collaborate with product and bioinformatics experts to ensure clean, consistent, analysis-ready data. This position offers competitive benefits and high autonomy in a fast-paced environment.

Qualifications

• 5+ years of experience in data engineering with tabular or semi-structured data.
• Strong fluency in Python and data processing tools.
• Experience with messy spreadsheets and data normalization.

Responsibilities

• Build and own an AI-powered ingestion pipeline.
• Develop schema mapping and data transformation logic.
• Ensure data quality through validation and quality control.

Skills

Data engineering

Python

Data processing (Pandas, Polars, PyArrow)

ETL/ELT pipelines design

Data wrangling

Tools

Nextflow

AWS S3

Job description

A cutting-edge biotech company in San Francisco is seeking a Data Engineer to build AI-powered data ingestion pipelines from various sources. The role demands strong expertise in data engineering and Python, with a focus on data normalization and quality control. As part of a dynamic team, you will collaborate with product and bioinformatics experts to ensure clean, consistent, analysis-ready data. This position offers competitive benefits and high autonomy in a fast-paced environment.