Researcher, engineering capability

LineWise

San Francisco (CA)

On-site

USD 150,000 - 230,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

LineWise is seeking a research-focused engineer to evaluate AI models in real engineering contexts, from CAD/CNC workflows to simulation and design for manufacturing. You will craft evaluations, analyze failures, and run post-training experiments to quantify improvements on real tasks.

You will publish findings as papers and benchmarks, shaping datasets and metrics used across Linewise Research. The role is based in San Francisco, collaborating with engineers, operators and researchers who share

Qualifications

  • Research experience in model evaluation or post-training, such as fine-tuning or RL, shown in papers, open-source work or models you've shipped.
  • Strong Python and PyTorch, and hands-on experience training or fine-tuning large models.
  • Experience designing evaluations that hold up: clear tasks, reliable grading and results you can trust.

Responsibilities

  • Build evaluations for engineering tasks from our data: CAD modelling, CNC and CAM programming, simulation and FEA, and design review.
  • Evaluate frontier and open models on them, and find out where and why they fail.
  • Run post-training experiments on our data, and measure what improves on real tasks.
  • Propose the datasets that would raise a model's score, and work with our engineers to capture them.
  • Help set how we measure data and model quality across Linewise Research.
  • Publish what you find as papers and benchmarks.

Skills

Python
PyTorch
Model evaluation
Reinforcement learning

Tools

CAD modelling
CNC programming
CAM programming
FEA

Job description

Linewise captures how physical things are made, from the first design to the final assembly, and turns it into training data for frontier AI and robotics models. Our long-term aim is Physical RSI: recursive self-improvement for the physical world, where AI helps engineers design and plan, robots help build and inspect, and each generation makes better machines, lines and factories for the next. This role is part of Linewise Research, which develops our methods for capture, quality control, annotation and model evaluation, and our agent-native data infrastructure. All of it is built around real industrial tasks.

About the role

You'll research how well AI models do real engineering work, from CAD and CNC programming to simulation and design for manufacturing, and how to make them better. You'll build evaluations from the engineering data we capture, find where frontier models fall short, and run post-training experiments to show which data moves the score. Your results decide which datasets we build and propose to frontier labs.

What you'll do
  • Build evaluations for engineering tasks from our data: CAD modelling, CNC and CAM programming, simulation and FEA, and design review.
  • Evaluate frontier and open models on them, and find out where and why they fail.
  • Run post-training experiments on our data, and measure what improves on real tasks.
  • Propose the datasets that would raise a model's score, and work with our engineers to capture them.
  • Help set how we measure data and model quality across Linewise Research.
  • Publish what you find as papers and benchmarks.
What we're looking for
  • Research experience in model evaluation or post-training, such as fine-tuning or RL, shown in papers, open-source work or models you've shipped.
  • Strong Python and PyTorch, and hands-on experience training or fine-tuning large models.
  • Experience designing evaluations that hold up: clear tasks, reliable grading and results you can trust.
  • An interest in engineering work, and in what it takes for a model to do it well.
  • Clear written English. You can explain a result in a short write-up.
How we work
  • You own your area end to end, from the first spec to the final delivery.
  • You work closely with engineers, operators and researchers.
  • English is the working language. We're based in San Francisco, with global operations.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Researcher for Engineering Capability & Evaluation
AI Researcher for Engineering Capability & Evaluation

LineWise • San Francisco (CA)

On-site
USD 150,000 - 230,000
Data delivery lead
Data delivery lead

LineWise • United States

On-site
USD 90,000 - 140,000
Project manager, field operations
Project manager, field operations

LineWise • San Francisco (CA)

On-site
USD 120,000 - 180,000
CNC program lead
CNC program lead

LineWise • San Francisco (CA)

On-site
USD 110,000 - 170,000
Research Engineer, Physical AI (Robotics, World Models)
Research Engineer, Physical AI (Robotics, World Models)

Orbifold AI • Palo Alto (CA)

On-site
USD 180,000 - 240,000
ML Research Engineer, Data
ML Research Engineer, Data

Dreamwork • San Francisco (CA)

On-site
USD 140,000 - 190,000
AI Trainer – Mechanical Engineering
AI Trainer – Mechanical Engineering

Planet Pharma • San Francisco (CA)

Remote
USD 90,000 - 150,000
AI Trainer – PHYSICS
AI Trainer – PHYSICS

Planet Pharma • San Francisco (CA)

Remote
USD 60,000 - 110,000
Member of Technical Staff - Research Engineering
Member of Technical Staff - Research Engineering

NextToken AI Inc. • Mountain View (CA)

On-site
USD 180,000 - 240,000
ML Research Engineer, Data
ML Research Engineer, Data

Weave Robotics • San Francisco (CA)

On-site
USD 140,000 - 190,000