Senior AI Engineer — Quality & Agent Systems (Hybrid)

Glean

Mountain View (CA)

Hybrid

USD 200,000 - 280,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Home office stipend
Education stipend
Wellness stipend
Lunch provided

Job summary

Glean in Mountain View/San Francisco is hiring a Senior AI/ML Engineer to advance our agentic AI stack. You’ll work at the intersection of research, quality, and product engineering to ship reliable, measurable improvements across models and the agent harness.

You’ll own eval design, post-training fine-tuning, and RL environments, collaborating with product and customers to turn eval insights into better enterprise outcomes.

Qualifications

  • 5+ years of industry experience in AI or ML engineering.
  • Hands-on post-training LLMs experience including adapting open-weight models.
  • Experience building evals for AI assistants and agent systems.
  • Proficient in Python or Go and ML frameworks; track record shipping production ML.
  • Product-minded with ability to turn problems into experiments.

Responsibilities

  • Use eval results and production traces to improve the stack, balancing quality, latency, and cost.
  • Work on post-training models with SFT and preference-based optimization, including data generation.
  • Build RL environments for enterprise workflows and verifiers for hill-climbing and benchmarking.
  • Improve evalsets, LLM judges and verifiers, calibrating them to human judgments for releases.
  • Collaborate with product, platform, and research teams to land quality improvements in production.

Skills

5+ years AI/ML engineering
LLM post-training experience
evals for AI assistants
Python and/or Go
strong ML framework
production ML systems
product-minded

Job description

Glean in Mountain View/San Francisco is hiring a Senior AI/ML Engineer to advance our agentic AI stack. You’ll work at the intersection of research, quality, and product engineering to ship reliable, measurable improvements across models and the agent harness.

You’ll own eval design, post-training fine-tuning, and RL environments, collaborating with product and customers to turn eval insights into better enterprise outcomes.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer - Agentic Systems & Evaluation
AI Engineer - Agentic Systems & Evaluation

Glean • San Francisco (CA)

Hybrid
USD 200,000 - 280,000
Home office stipend
Education & wellness stipends
Daily healthy lunches
Senior AI Evaluation Engineer (Hybrid: Bay Area)
Senior AI Evaluation Engineer (Hybrid: Bay Area)

Glean • Mountain View (CA)

Hybrid
USD 200,000 - 280,000
Medical, Vision, Dental
401k plan
Home office stipend
+3
Senior AI Product Engineer — Production Agent Systems
Senior AI Product Engineer — Production Agent Systems

Harrison Clarke • San Francisco (CA)

Hybrid
USD 220,000 - 300,000
Production ML Engineer — AI Assistants (Hybrid SF)
Production ML Engineer — AI Assistants (Hybrid SF)

Glean • San Francisco (CA)

Hybrid
USD 180,000 - 205,000
Medical coverage
Vision coverage
Dental coverage
+6
Senior Staff AI/ML Engineer - Cloud AI Research (Equity)
Senior Staff AI/ML Engineer - Cloud AI Research (Equity)

Google LLC • Mountain View (CA)

On-site
USD 262,000 - 364,000
Senior ML Engineer - Agentic AI for Mission-Critical Systems
Senior ML Engineer - Agentic AI for Mission-Critical Systems

Scale AI, Inc. • Denver (CO)

On-site
USD 235,000 - 294,000
Health coverage
Retirement benefits
Learning stipend
+2
Senior QA Lead for AI Agent Platform
Senior QA Lead for AI Agent Platform

Giga • San Francisco (CA)

On-site
USD 140,000 - 190,000
Dinner stipend
Wellness benefit
401(k)
+1
Senior AI Platform Engineer (Hybrid)
Senior AI Platform Engineer (Hybrid)

People In AI • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Senior AI Agent QA Engineer for CI/CD & MLOps
Senior AI Agent QA Engineer for CI/CD & MLOps

MultiPlan • McLean (VA)

On-site
USD 140,000 - 160,000
Health insurance
401k
Bonus opportunity
Senior AI/ML Research Engineer: Autonomous Agent Architect
Senior AI/ML Research Engineer: Autonomous Agent Architect

Google LLC • Mountain View (CA)

On-site
USD 174,000 - 252,000