Staff Software Engineer — Agent Evaluation Platform

Moveworks

Santa Clara, Northern (CA, KY)

Hybrid

USD 180,000 - 240,000

Full time

21 hours ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Moveworks is seeking a Staff Software Engineer to own the evaluation platform for agent workflows. You will design and implement the judgement layer, calibration against human labels, and scalable infrastructure to score multi-step agent trajectories.

Deep expertise in backend systems (Python/Go), distributed execution, and observability is required. You will work on stateful simulations and a reusable orchestration harness at scale.

Qualifications

  • 8+ years building production backend or infrastructure systems.
  • Strong in Python or Go (ideally both).
  • Experience designing and operating systems that handle real traffic at scale.

Responsibilities

  • Own the eval platform: orchestration, validation, and scoring for agent scenarios.
  • Improve observability: OpenTelemetry data models, tracing, and dashboards.
  • Develop stateful simulation environments with hermetic runs.
  • Turn noisy agent behavior into a measurable signal for releases.
  • Collaborate across teams to scale and reliability.

Skills

Python
Go
Distributed systems
Orchestration
OpenTelemetry
Async programming
gRPC

Tools

Temporal
Airflow
Argo

Job description

Moveworks is seeking a Staff Software Engineer to own the evaluation platform for agent workflows. You will design and implement the judgement layer, calibration against human labels, and scalable infrastructure to score multi-step agent trajectories.

Deep expertise in backend systems (Python/Go), distributed execution, and observability is required. You will work on stateful simulations and a reusable orchestration harness at scale.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Staff Software Engineer — AI Agent Evaluation Platform
Staff Software Engineer — AI Agent Evaluation Platform

ServiceNow • Santa Clara (CA), Northern (KY)

Hybrid
USD 150,000 - 190,000
Senior Distributed Systems Engineer - AI Agent Orchestrator
Senior Distributed Systems Engineer - AI Agent Orchestrator

Moveworks • Mountain View (CA)

Hybrid
USD 130,000 - 170,000
Senior AI Systems Engineer, Evaluation & Orchestration
Senior AI Systems Engineer, Evaluation & Orchestration

Servicenow • Mountain View (CA)

On-site
USD 161,000 - 274,000
Health plans
401(k) with company match
Employee stock purchase plan (ESPP)
+2
Staff Software Engineer, Agent Eval Platform
Staff Software Engineer, Agent Eval Platform

ServiceNow • Santa Clara (CA), Northern (KY)

On-site
USD 150,000 - 190,000
Staff Software Engineer, Agent Eval Platform
Staff Software Engineer, Agent Eval Platform

Moveworks • Santa Clara (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
Staff Software Engineer - Agent Platform & Orchestration
Staff Software Engineer - Agent Platform & Orchestration

Decagon • United States

Remote
USD 150,000 - 230,000
Staff Fullstack Engineer - AI-Powered Web Apps
Staff Fullstack Engineer - AI-Powered Web Apps

Moveworks • Mountain View (CA)

Hybrid
USD 167,000 - 291,000
Health plans
401(k) Plan with company match
ESPP
+2
AI Agent Platform Engineering Lead
AI Agent Platform Engineering Lead

Jobtailor • San Francisco (CA)

On-site
USD 140,000 - 190,000
Staff Backend Engineer: AI Platform & Scalable Systems
Staff Backend Engineer: AI Platform & Scalable Systems

Workato • San Francisco (CA)

On-site
USD 180,000 - 240,000
Agentic Systems Engineer — Orchestration & Evaluation
Agentic Systems Engineer — Orchestration & Evaluation

Jobtailor • San Francisco (CA)

On-site
USD 180,000 - 240,000