Data Ingestion & Quality Engineer — End-to-End Pipelines

Kindredventures; San Francisco (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

Kindredventures is building a Large Physics foundation Model and seeks a Data Engineer to own data end-to-end, from source discovery to ingestion pipelines ensuring training-ready quality.

You will build petabyte-scale pipelines, implement QA checks, and collaborate with researchers to translate datasets into model performance improvements. This role demands problem-solving, fast execution, and adaptability.

Qualifications

• Experience building large-scale data pipelines and QA systems.
• Ability to translate data quality into model performance.

Responsibilities

• Own data end-to-end: source discovery, access, ingestion pipelines, training-ready data.

Skills

Large-scale data pipelines

QA systems

Data ingestion

Multimodal data

Vendor collaboration

Tools

Apache Spark

Ray

Beam

Job description

Kindredventures is building a Large Physics foundation Model and seeks a Data Engineer to own data end-to-end, from source discovery to ingestion pipelines ensuring training-ready quality.

You will build petabyte-scale pipelines, implement QA checks, and collaborate with researchers to translate datasets into model performance improvements. This role demands problem-solving, fast execution, and adaptability.