Staff AI Research Engineer - Post-Training & Evaluation

True

Mountain View (CA)

On-site

USD 200,000 - 300,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

We are seeking an engineer to advance post-training and continual learning for production agents in an early-stage AI company. You will build evaluation suites, run experiments, and transform findings into reliable platform components.

Requirements include 1–5 years of hands-on ML/AI engineering, strong Python, and experience with LLM post-training, evaluation, or inference. On-site in Mountain View, CA with visa sponsorship.

Qualifications

  • 1–5 years engineering experience in AI startup or ML research.
  • Hands-on with LLM post-training, evaluation or inference.
  • Solid Python and CS fundamentals.

Responsibilities

  • Build evaluation suites, graders, and data pipelines using production workflows and traces.
  • Own post-training projects in customer settings, including data work, evaluations, reinforcement learning environments, and training runs.
  • Implement agent environments and harnesses for reproducible experiments and training data generation.
  • Run and analyze post-training experiments, reproduce promising research, and debug related systems.
  • Turn successful experiments into reliable components of a post-training and continual learning platform.

Skills

Python
ML foundations
CS fundamentals
LLM post-training
Experiment debugging
Communication

Tools

PyTorch
JAX
Reinforcement learning
vLLM
Megatron
SGLang

Job description

We are seeking an engineer to advance post-training and continual learning for production agents in an early-stage AI company. You will build evaluation suites, run experiments, and transform findings into reliable platform components.

Requirements include 1–5 years of hands-on ML/AI engineering, strong Python, and experience with LLM post-training, evaluation, or inference. On-site in Mountain View, CA with visa sponsorship.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Research Engineering
Member of Technical Staff, Research Engineering

True • Mountain View (CA)

On-site
USD 200,000 - 300,000
Member of Technical Staff, Research Engineering
Member of Technical Staff, Research Engineering

True Talent Solutions Partners • Mountain View (CA)

On-site
USD 200,000 - 300,000
Visa sponsorship
Staff ML Engineer – Post-Training & Evaluation
Staff ML Engineer – Post-Training & Evaluation

True Talent Solutions Partners • Mountain View (CA)

On-site
USD 200,000 - 300,000
Visa sponsorship
Research Engineer: Post-Training & Agentic RL Platforms
Research Engineer: Post-Training & Agentic RL Platforms

Storm3 • San Francisco (CA)

Hybrid
USD 250,000 - 400,000
Relocation package
Competitive salary
Medical, dental, and vision insurance
Senior AI Engineer — Quality & Agent Systems (Hybrid)
Senior AI Engineer — Quality & Agent Systems (Hybrid)

Glean • Mountain View (CA)

Hybrid
USD 200,000 - 280,000
Home office stipend
Education stipend
Wellness stipend
+1
Enterprise AI Agent Evaluation Infrastructure Engineer
Enterprise AI Agent Evaluation Infrastructure Engineer

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 190,000
AI Evaluation Engineer – Reinforcement Learning & Agents
AI Evaluation Engineer – Reinforcement Learning & Agents

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 210,000
Agent Evaluation Infrastructure Engineer
Agent Evaluation Infrastructure Engineer

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 190,000
Agent Post-Training Researcher
Agent Post-Training Researcher

OpenAI • San Francisco (CA)

On-site
USD 180,000 - 240,000
Artificial Intelligence Researcher - Post Training
Artificial Intelligence Researcher - Post Training

Velocity Tech • San Francisco (CA)

On-site
USD 120,000 - 180,000