Staff AI Systems Engineer - LLM, Evaluation, Equity

Maven

San Jose (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Physical Health Benefits
Mental Health Benefits
Emotional Health Benefits
Financial Health Benefits
Work-life Balance Support
Community Contribution Opportunities
Bonus
Equity

Job summary

Zoom is seeking an experienced software engineer to improve the quality, reliability, and performance of its AI-powered virtual agent. You will diagnose AI agent failures, optimize prompt architectures, and build evaluation pipelines to measure agent quality.

This role requires deep expertise in large language models, system design, and end-to-end evaluation. You will collaborate with research and platform teams to deliver production-grade solutions that scale.

Qualifications

  • Candidates need 10+ years of software engineering experience, including 3-5 years specifically with production-grade LLM or conversational AI systems.
  • An advanced degree in Computer Science or Engineering is required or equivalent practical experience.

Responsibilities

  • Diagnose AI agent failures and issues in production systems.
  • Improve the quality, reliability, and performance of Zoom's AI-powered virtual agent.
  • Build evaluation pipelines to measure agent quality and track improvements.

Skills

System Architecture
LLM-based Systems
Conversational AI
Prompt Engineering
Evaluation Pipelines
Machine Learning
Context Management
Prompt Chain Optimization

Education

Advanced degree in Computer Science or Engineering

Tools

DSPy
APO
GEPA

Job description

Zoom is seeking an experienced software engineer to improve the quality, reliability, and performance of its AI-powered virtual agent. You will diagnose AI agent failures, optimize prompt architectures, and build evaluation pipelines to measure agent quality.

This role requires deep expertise in large language models, system design, and end-to-end evaluation. You will collaborate with research and platform teams to deliver production-grade solutions that scale.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Software Engineer
Staff Software Engineer

Maven • San Jose (CA)

On-site
USD 180,000 - 240,000
Physical Health Benefits
Mental Health Benefits
Emotional Health Benefits
+5
Senior AI Engineer — LLM Evaluation & Production Systems
Senior AI Engineer — LLM Evaluation & Production Systems

LawPro.ai • Virginia (MN)

On-site
USD 140,000 - 200,000
Senior AI Systems Engineer - End-to-End LLM Ops | Equity
Senior AI Systems Engineer - End-to-End LLM Ops | Equity

Zello • Austin (TX), Northern (KY)

Hybrid
USD 140,000 - 190,000
Senior AI Engineer: LLM Evaluation & Production
Senior AI Engineer: LLM Evaluation & Production

LawPro.ai • Town of Florida (NY)

On-site
USD 140,000 - 210,000
Senior AI Engineer - Agent Quality & Evaluations (Remote)
Senior AI Engineer - Agent Quality & Evaluations (Remote)

vibehackers • Northern (KY)

Hybrid
USD 150,000 - 250,000
Health insurance
Parental leave
Unlimited flexible time off
+2
Senior AI Engineer: LLM Evaluation & Production
Senior AI Engineer: LLM Evaluation & Production

LawPro.ai • Georgia

On-site
USD 140,000 - 210,000
Senior AI Engineer — Remote, Build End-to-End LLM Agents
Senior AI Engineer — Remote, Build End-to-End LLM Agents

Aimlroles • Northern (KY)

Hybrid
USD 250,000 - 300,000
Remote work US/Canada
Annual bonus
Senior AI Engineer - Production LLM EvalOps
Senior AI Engineer - Production LLM EvalOps

LawPro.ai • Town of Texas (WI)

On-site
USD 140,000 - 210,000
Staff AI Platform Engineer - LLM & Agent Runtime (Equity)
Staff AI Platform Engineer - LLM & Agent Runtime (Equity)

Gusto • Denver (CO), California (MO)

Hybrid
USD 180,000 - 240,000
Senior AI Platform Engineer – LLM Agents (Remote)
Senior AI Platform Engineer – LLM Agents (Remote)

tldr • United States

Remote
USD 250,000 - 300,000
Remote across US/Canada
Biannual team offsites
Flexible PTO
+5