Data Ingestion & Quality Engineer — End-to-End Pipelines

Kindredventures; San Francisco (CA); On-site; USD 140,000 - 210,000; Full time

Job summary

Kindredventures is building a Large Physics foundation Model and seeks a Data Engineer to own data end-to-end, from source discovery to ingestion pipelines ensuring training-ready quality. You will build petabyte-scale pipelines, implement QA checks, and collaborate with researchers to translate datasets into model performance improvements.

This role demands problem-solving, fast execution, and adaptability in a dynamic research environment located in San Francisco, CA.

Qualifications

• Must have experience building end-to-end data pipelines.
• Strong data quality and QA checks.
• Experience collaborating with researchers to translate datasets into model improvements.

Responsibilities

• Own data end-to-end from source discovery to ingestion pipelines.
• Build and maintain petabyte-scale pipelines with QA checks.
• Collaborate with researchers to translate datasets into model performance improvements.

Skills

Data Pipelines

ETL

Python

SQL

Big Data

Cloud

Education

Bachelor's degree in CS/CE/IS

Tools

Airflow

Spark

Kafka

BigQuery / Athena

Job description

Kindredventures is building a Large Physics foundation Model and seeks a Data Engineer to own data end-to-end, from source discovery to ingestion pipelines ensuring training-ready quality.

You will build petabyte-scale pipelines, implement QA checks, and collaborate with researchers to translate datasets into model performance improvements. This role demands problem-solving, fast execution, and adaptability.