Research MTS: Frontier AI Simulation & Evaluation Engineer

Collinear AI

Sunnyvale (CA)

On-site

USD 170,000 - 210,000

Full time

4 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Competitive salary and equity packages
Health insurance

Job summary

Collinear AI in Sunnyvale, CA is seeking an MTS - Research to help build the data engine for frontier AI. You will design ultra-realistic SimLabs and evaluation stacks that stress-test agents across domains including simulation and toolcalling.

You bring a technical foundation, strong software engineering, and ML fluency with a focus on reproducibility and data-driven results. Join a small, elite team and impact the reliability of next-generation AI systems.

Qualifications

  • Bachelor’s/Master’s/PhD in CS/Math/Physics or demonstrated equivalent open-source/industry work.
  • Strong software engineering fundamentals with the ability to build robust, scalable infrastructure in a Python CLI-first environment.
  • Principled understanding of foundation models, including construction, evaluation, and optimization.
  • Experience conducting research with reproducibility and data-driven results.

Responsibilities

  • Build Agentic Environments: design ultra-realistic simulators and long-horizon environments.
  • Programmatic and Agentic Verification: develop policy-aware judges and evaluations for capability and safety.
  • Close the Loop: run post-training CPT, SFT, RL on open-source models using curated, high-signal data.
  • Collaborate with founders and researchers to shape roadmap and advance reliability.

Skills

Python
Reinforcement Learning
Research mindset
Data-driven experiments

Education

Bachelor's/Master's/PhD in CS/Math/Physics

Tools

Git
Open-source contributions

Job description

Collinear AI in Sunnyvale, CA is seeking an MTS - Research to help build the data engine for frontier AI. You will design ultra-realistic SimLabs and evaluation stacks that stress-test agents across domains including simulation and toolcalling.

You bring a technical foundation, strong software engineering, and ML fluency with a focus on reproducibility and data-driven results. Join a small, elite team and impact the reliability of next-generation AI systems.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Member of Technical Staff
Member of Technical Staff

Collinear AI • Sunnyvale (CA)

On-site
USD 170,000 - 210,000
Competitive salary and equity packages
Health insurance
MTS - Engineering
MTS - Engineering

Collinear AI • Sunnyvale (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
MTS - Staff Engineer
MTS - Staff Engineer

Collinear AI • Sunnyvale (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
MTS - AI Physics & Simulations
MTS - AI Physics & Simulations

Collinear AI • United States

On-site
USD 180,000 - 240,000
Frontier AI Research Scientist/Engineer
Frontier AI Research Scientist/Engineer

Collinear AI, Inc. • Sunnyvale (CA)

On-site
USD 160,000 - 350,000
Comprehensive medical, dental, and vision coverage
10 company holidays and flexible PTO
12 weeks of paid parental leave
+2
MTS - AI Physics & Simulations
MTS - AI Physics & Simulations

Collinear AI • San Francisco (CA)

On-site
USD 140,000 - 210,000
Applied AI Engineer: Frontier Models & Agent Capabilities
Applied AI Engineer: Frontier Models & Agent Capabilities

United States Digital Space LLC • San Francisco (CA)

On-site
USD 190,000 - 230,000
Systems & ML Infra Engineer for Frontier AI Evaluations
Systems & ML Infra Engineer for Frontier AI Evaluations

Meta • Menlo Park (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
MTS - Engineering
MTS - Engineering

Collinear AI • San Francisco (CA)

On-site
USD 150,000 - 300,000
Equity
Bonuses
Benefits
Autonomous ML Research Engineer – Frontier AI
Autonomous ML Research Engineer – Frontier AI

Autoscience • Menlo Park (CA)

On-site
USD 180,000 - 230,000
Unlimited PTO
Conference attendance support
Competitive compensation against major