Member of Technical Staff — Research Engineering, Evaluation

Kindredventures

San Francisco (CA)

On-site

USD 140,000 - 200,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Kindredventures is seeking research engineers to build a central evaluation framework and scalable evaluation pipelines for models and datasets. You will design benchmarks, implement baselines, and create dashboards that translate results into actionable insights for the team.

The role emphasizes measurable rigor, collaboration with research and domain teams, and end-to-end ownership of evaluation tooling from data collection to automated metrics.

Qualifications

  • Strong software engineering skills and experience building data or evaluation pipelines at scale (e.g., large data processing, experiment infrastructure).
  • Experience turning research or model outputs into metrics, benchmarks, and visualizations that teams rely on.
  • Solid grasp of probability and statistics, with the judgment to design evaluations that measure what they claim to.

Responsibilities

  • Design and build a central, reusable evaluation framework used across models and teams.
  • Implement evaluation pipelines, benchmark suites, and baselines to make model quality measurable and comparable.
  • Build visualization and dashboard tools that turn raw results into actionable insights for the team.
  • Establish sound statistical methodology for evaluation to distinguish real improvements from noise.
  • Partner with research and domain teams to translate “good” into standardized, automated metrics.

Skills

Software engineering
Data pipelines
Metrics & visualization
Statistics
Full-stack development
Delivery ownership

Job description

Overview

Our mission is general causal intelligence; AI that is capable of (1) predicting the future and (2) identifying the actions to alter it.

To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an understanding of causality required to predict and control physical systems, starting with weather.

Our founding team has built and deployed AI against the physical world in robotics, drug discovery, and particle physics at institutions like DeepMind, Waymo, Cruise, Insitro, Nabla Bio, and CERN.

We look for research engineers who are excited to tackle unsolved problems. Progress is only as trustworthy as its measurement. As our model, data, and reasoning efforts multiply, every team needs to know, precisely and comparably, whether a change made the model better. Your mission is to build the central evaluation framework that the entire research organization runs on: the pipelines, the metrics, and the tools that turn results into shared understanding.

Responsibilities
  • Design and build a central, reusable evaluation framework that every model and every team runs through

  • Implement evaluation pipelines, benchmark suites, and baselines that make model quality measurable and comparable across efforts

  • Build the visualization and dashboard tools that turn raw results into shared, actionable understanding for the whole team

  • Establish sound statistical methodology for evaluation, so teams can distinguish real improvements from noise

  • Partner with research and domain teams to translate what "good" means in each domain into standardized, automated metrics

What we\'re looking for

We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains.

  • Strong software engineering skills and experience building data or evaluation pipelines at scale

  • Experience turning research or model outputs into metrics, benchmarks, and visualizations that teams rely on

  • Solid grasp of probability and statistics, with the judgment to design evaluations that measure what they claim to

  • Full-stack range: comfortable building both backend pipelines and the frontend tools people read results in

  • Owns deliverables end-to-end, from collecting requirements to autonomously driving execution

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Member of Technical Staff — Research Engineering, Evaluation
Member of Technical Staff — Research Engineering, Evaluation

Causal Labs • San Francisco (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff — Data Ingestion & Quality
Member of Technical Staff — Data Ingestion & Quality

Causal • San Francisco (CA)

On-site
USD 120,000 - 160,000
Member of Technical Staff — Research, Physics
Member of Technical Staff — Research, Physics

Kindredventures • San Francisco (CA)

On-site
USD 150,000 - 230,000
Member of Technical Staff — Research, Physics
Member of Technical Staff — Research, Physics

Causal Labs • San Francisco (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff — Research, Physics
Member of Technical Staff — Research, Physics

Causal • San Francisco (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff — Data Ingestion & Quality
Member of Technical Staff — Data Ingestion & Quality

Kindredventures • San Francisco (CA)

On-site
USD 120,000 - 180,000
Member of Technical Staff — Product Engineering
Member of Technical Staff — Product Engineering

Causal Labs • San Francisco (CA)

On-site
USD 150,000 - 190,000
Member of Technical Staff — ML Research, Planning
Member of Technical Staff — ML Research, Planning

Kindredventures • San Francisco (CA)

On-site
USD 150,000 - 230,000
Member of Technical Staff — Research, Operations & Decision Science
Member of Technical Staff — Research, Operations & Decision Science

Kindredventures • San Francisco (CA)

On-site
USD 150,000 - 190,000
Member of Technical Staff — Product Engineering
Member of Technical Staff — Product Engineering

Kindredventures • San Francisco (CA)

On-site
USD 115,000 - 165,000