Senior Distributed Systems Engineer — AI Agent Orchestration

Servicenow; Mountain View (CA); Hybrid; USD 180,000 - 240,000; Full time

Job summary

ServiceNow is seeking a distributed systems engineer to power Moveworks' AI agents at scale. You will build the runtime infrastructure that orchestrates, executes, and delivers responses to enterprise users in real time, with focus on correctness, observability, and low latency.

You will own the agent orchestration engine, session management, event-driven pipelines, and state layers, working with Python or Go, SQS/Kafka, DynamoDB/Redis, and OpenTelemetry to maintain reliability under heavy load.

Qualifications

• 10+ years building production backend/infrastructure systems.
• Strong in Python or Go (ideally both).
• Experience designing and operating systems that handle real traffic at scale.

Responsibilities

• Agent orchestration engine — manage long-running sessions across multiple LLM calls and tools.
• Distributed session management with lease-based ownership and crash recovery.
• Event-driven message pipeline using SQS/Kafka and real-time streaming via gRPC.
• Structured concurrency with asynchronous tasks and graceful cancellation.
• Observability infrastructure with OpenTelemetry and distributed tracing.
• Caching and state layers using Redis and DynamoDB with per-org/per-bot scope.

Skills

Distributed systems

Async programming

Event-driven architecture

Observability

gRPC

Python or Go

Education

Bachelor's degree in CS/SE

Tools

SQS

Kafka

DynamoDB

Redis

OpenTelemetry

Job description

ServiceNow is seeking a distributed systems engineer to power Moveworks' AI agents at scale. You will build the runtime infrastructure that orchestrates, executes, and delivers responses to enterprise users in real time, with focus on correctness, observability, and low latency.

You will own the agent orchestration engine, session management, event-driven pipelines, and state layers, working with Python or Go, SQS/Kafka, DynamoDB/Redis, and OpenTelemetry to maintain reliability under heavy load.