End-to-End Data Pipelines & Quality Engineer

Kindredventures; San Francisco (CA); Presencial; USD 140.000 - 210.000; Jornada completa

Descripción de la vacante

Kindredventures is building a Large Physics foundation Model and seeks a Data Engineer to own data end-to-end, from source discovery to ingestion pipelines ensuring training-ready quality. You will build petabyte-scale pipelines, implement QA checks, and collaborate with researchers to translate datasets into model performance improvements.

This role demands problem-solving, fast execution, and adaptability in a dynamic research environment located in San Francisco, CA.

Formación

• Must have experience building end-to-end data pipelines.
• Strong data quality and QA checks.
• Experience collaborating with researchers to translate datasets into model improvements.

Responsabilidades

• Own data end-to-end from source discovery to ingestion pipelines.
• Build and maintain petabyte-scale pipelines with QA checks.
• Collaborate with researchers to translate datasets into model performance improvements.

Conocimientos

Data Pipelines

ETL

Python

SQL

Big Data

Cloud

Educación

Bachelor's degree in CS/CE/IS

Herramientas

Airflow

Spark

Kafka

BigQuery / Athena

Descripción del empleo

Kindredventures is building a Large Physics foundation Model and seeks a Data Engineer to own data end-to-end, from source discovery to ingestion pipelines ensuring training-ready quality. You will build petabyte-scale pipelines, implement QA checks, and collaborate with researchers to translate datasets into model performance improvements.

This role demands problem-solving, fast execution, and adaptability in a dynamic research environment located in San Francisco, CA.