Research Engineer: AI Twin Systems & Scalable Experiments

outset

United States

On-site

USD 120,000 - 180,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Outset is redefining how research is conducted with AI-powered user interviews. The Research Engineer will ensure experiments run exactly as designed, with reproducible results and scalable pipelines, under the Head Scientist.

You will enable scientists to test modeling approaches, manage data pipelines, and keep code aligned with the shipped product. You should have several years of software engineering experience in a research setting, strong Python skills, cloud exposure, and familiarity with

Qualifications

  • Several years of software engineering experience, including work in a lab or comparable research setting.
  • Strong Python; ability to read/audit code from AI agents and tooling.
  • Experience building and operating large-scale data pipelines for human behavior data.
  • Fundamentals: file systems, libraries, databases, SQL, tabular data, Git workflows.
  • Experience with cloud infrastructure and running many jobs concurrently.
  • Understanding of ML and transformer models, model APIs, and fine-tuning basics.
  • Code written should be deterministic, reproducible, cost-aware, and well-documented.

Responsibilities

  • Own evaluation infrastructure to test competing modeling approaches.
  • Implement measurement pipelines with deterministic, traceable outputs.
  • Maintain versioned evaluation datasets with held-out sets.
  • Build and maintain data pipelines for human-participant data and model training data.
  • Keep research code in step with production product for timely shipping of improvements.
  • Detect and prevent threats to evaluation validity.
  • Track compute and API spend across experiments and production costs.
  • Manage repositories, code review, and reproducibility of coding workflow.
  • Identify implementation choices for correctness and efficiency and propose changes.

Skills

Software engineering
Python
Cloud infrastructure
ML fundamentals
Deterministic/reproducible coding
Git-based workflows

Tools

vLLM
SGLang
SQL
Git

Job description

Outset is redefining how research is conducted with AI-powered user interviews. The Research Engineer will ensure experiments run exactly as designed, with reproducible results and scalable pipelines, under the Head Scientist.

You will enable scientists to test modeling approaches, manage data pipelines, and keep code aligned with the shipped product. You should have several years of software engineering experience in a research setting, strong Python skills, cloud exposure, and familiarity with

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Engineer: AI Systems for Scalable Insights
Research Engineer: AI Systems for Scalable Insights

Outset • San Francisco (CA)

On-site
USD 150,000 - 210,000
Research Engineer, AI Systems & Evaluation
Research Engineer, AI Systems & Evaluation

AItoolnavio • San Francisco (CA)

On-site
USD 140,000 - 210,000
Research Scientist — AI‑Driven User Research & Digital Twins
Research Scientist — AI‑Driven User Research & Digital Twins

Outset • San Francisco (CA)

On-site
USD 150,000 - 230,000
Research Scientist, AI‑Driven User Insights
Research Scientist, AI‑Driven User Insights

AItoolnavio • San Francisco (CA)

On-site
USD 140,000 - 230,000
Research Scientist - AI-Driven Human Insights
Research Scientist - AI-Driven Human Insights

outset • United States

On-site
USD 140,000 - 200,000
Research Tools Engineer: Build AI Experiment Platforms
Research Tools Engineer: Build AI Experiment Platforms

Anthropic • New York (NY)

Hybrid
USD 300,000 - 405,000
Research Engineer
Research Engineer

outset • United States

On-site
USD 120,000 - 180,000
Research Engineer
Research Engineer

AItoolnavio • San Francisco (CA)

On-site
USD 140,000 - 210,000
Research Engineer, Scalable AI Data Pipelines
Research Engineer, Scalable AI Data Pipelines

Valor Capital Group • New York (NY)

Remote
USD 120,000 - 180,000
Innovative culture
Growth paths
Learning & development
+3
Research Engineer
Research Engineer

Outset • San Francisco (CA)

On-site
USD 150,000 - 210,000