Staff Software Engineer — Scale AI Evaluation & Orchestration

Servicenow; Mountain View (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

ServiceNow is hiring for Moveworks' AI agent evaluation platform team in Mountain View. You will design and build the judgement layer that scores multi-step agent trajectories, turning signals into training and release signals for enterprise AI.

Preferred candidates have 8+ years building production backend systems, strong Python or Go, and experience with distributed systems, orchestration, and OpenTelemetry observability.

Qualifications

• 8+ years building production backend or infrastructure systems.
• Strong in Python or Go (ideally both).
• Experience designing and operating systems that handle real traffic at scale.
• Comfort making a non-deterministic system measurable.
• Familiarity with distributed runtimes and observability tooling.

Responsibilities

• The runtime that executes multi-turn agent scenarios end-to-end.
• Establishing a reliability floor and an SLO for the evaluation harness.
• Leading orchestration of evaluation datasets, reports, and run-to-run comparisons.
• Designing and operating stateful simulations and mocks for enterprise systems.
• Developing the calibration and scoring signals that guide model improvements.

Skills

Distributed systems

Python

Go

Orchestration

OpenTelemetry

Observability

Async programming

Data pipelines

gRPC/protobuf

8+ years experience

Tools

Temporal

Airflow

Argo

OpenTelemetry tooling

Job description

ServiceNow is hiring for Moveworks' AI agent evaluation platform team in Mountain View. You will design and build the judgement layer that scores multi-step agent trajectories, turning signals into training and release signals for enterprise AI.

Preferred candidates have 8+ years building production backend systems, strong Python or Go, and experience with distributed systems, orchestration, and OpenTelemetry observability.