AI Researcher for Engineering Capability & Evaluation

LineWise

San Francisco (CA)

On-site

USD 150,000 - 230,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

LineWise is seeking a research-focused engineer to evaluate AI models in real engineering contexts, from CAD/CNC workflows to simulation and design for manufacturing. You will craft evaluations, analyze failures, and run post-training experiments to quantify improvements on real tasks.

You will publish findings as papers and benchmarks, shaping datasets and metrics used across Linewise Research. The role is based in San Francisco, collaborating with engineers, operators and researchers who share

Qualifications

  • Research experience in model evaluation or post-training, such as fine-tuning or RL, shown in papers, open-source work or models you've shipped.
  • Strong Python and PyTorch, and hands-on experience training or fine-tuning large models.
  • Experience designing evaluations that hold up: clear tasks, reliable grading and results you can trust.

Responsibilities

  • Build evaluations for engineering tasks from our data: CAD modelling, CNC and CAM programming, simulation and FEA, and design review.
  • Evaluate frontier and open models on them, and find out where and why they fail.
  • Run post-training experiments on our data, and measure what improves on real tasks.
  • Propose the datasets that would raise a model's score, and work with our engineers to capture them.
  • Help set how we measure data and model quality across Linewise Research.
  • Publish what you find as papers and benchmarks.

Skills

Python
PyTorch
Model evaluation
Reinforcement learning

Tools

CAD modelling
CNC programming
CAM programming
FEA

Job description

LineWise is seeking a research-focused engineer to evaluate AI models in real engineering contexts, from CAD/CNC workflows to simulation and design for manufacturing. You will craft evaluations, analyze failures, and run post-training experiments to quantify improvements on real tasks.

You will publish findings as papers and benchmarks, shaping datasets and metrics used across Linewise Research. The role is based in San Francisco, collaborating with engineers, operators and researchers who share

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Researcher, engineering capability
Researcher, engineering capability

LineWise • San Francisco (CA)

On-site
USD 150,000 - 230,000
AI Research Engineer — Production-Ready LLMs
AI Research Engineer — Production-Ready LLMs

WisdomAI, Inc. • San Mateo (CA)

On-site
USD 252,000 - 308,000
AI Researcher
AI Researcher

Vetto • United States

Remote
USD 120,000 - 170,000
Stock option plan
AI Engineer: Build LLM Workflows for Real-World Ops
AI Engineer: Build LLM Workflows for Real-World Ops

Scope Applied AI • San Francisco (CA)

Hybrid
USD 180,000 - 210,000
AI Research Scientist (Full-time)
AI Research Scientist (Full-time)

Alpha Z • United States

Remote
USD 120,000 - 170,000
Research Engineer, Applied AI & LLMs for Enterprise
Research Engineer, Applied AI & LLMs for Enterprise

WisdomAI • San Mateo (CA)

On-site
USD 252,000 - 308,000
AI Evaluation Scientist — Real-World ML Research
AI Evaluation Scientist — Real-World ML Research

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 170,000 - 210,000
Competitive compensation
Equity
Health benefits
+2
AI Engineer
AI Engineer

Tryscope • San Francisco (CA)

Hybrid
USD 180,000 - 210,000
Research Engineer: AI for Chip Design & RL Tools
Research Engineer: AI for Chip Design & RL Tools

OpenAI, Inc. • United States

Remote
USD 150,000 - 230,000
AI Research Engineer - Build What Comes Next in Applied AI
AI Research Engineer - Build What Comes Next in Applied AI

Evolution USA • San Francisco (CA)

On-site
USD 140,000 - 240,000