Senior Staff Compute Engineer — AI Scheduling & Cloud Scale

ServiceNow; Santa Clara (CA); Hybrid; USD 191,000 - 334,000; Full time

Benefits offered by this job

Health plans

401(k) plan

ESPP

Donations matching

Flexible time away

Job summary

ServiceNow in Santa Clara, CA, is hiring across multiple engineering levels for compute engineering focused on scheduling, capacity, and performance across private and public clouds. You will design and evolve schedulers, build models, and apply AI/ML to improve forecasting and placement, while ensuring reliability and scale.

The role requires deep experience in large-scale SaaS, multi-tenant architectures, and proficiency in Go, Python, or Java.

Qualifications

• 12+ years of related software engineering/cloud/infrastructure automation experience with a Bachelor's, or 8+ years with a Master's, or PhD with 5+ years.
• Deep experience designing multi-tenant cloud-native SaaS at enterprise scale, including distributed data systems and APIs.
• Experience designing or operating large-scale schedulers or resource managers (Kubernetes, Slurm, or equivalents).
• Strong programming skills in Go, Python, or Java.
• Experience with capacity planning, performance engineering, or load testing at scale.
• Hands-on experience applying ML in production (models, pipelines, platforms).
• Experience with infrastructure as code and configuration management (Terraform, Ansible).
• Comfortable with virtualization and cloud infra (Azure, AWS, GCP).
• Working understanding of IP networking, storage, and load balancers.

Responsibilities

• Design and evolve compute scheduler and resource-management systems, including placement and fairness.
• Build capacity models and forecasts for private/public cloud to inform placement decisions.
• Establish performance tests, benchmarks, regression detection, and SLOs for scheduling latency/throughput.
• Apply AI/ML to forecasting and placement optimization where advantageous.
• Write declarative infrastructure code and web services with testable automation.
• Research and adopt tools/methods to improve compute efficiency and reliability.
• Partner with networking, orchestration, SRE, and FinOps for cross-team designs and cost trade-offs.
• Guide complex technical decisions and balance speed with long-term durability.
• Own production reliability and incident response for compute systems; lead post-incident improvements.
• Mentor architects and senior engineers to build leadership.

Skills

Cloud-native SaaS design

Scheduler design

Go / Python / Java

Capacity planning

ML in production

IaC (Terraform/Ansible)

Cloud platforms (Azure AWS GCP)

Networking fundamentals

Release management

Communication

Education

Bachelor's degree or higher

Tools

Kubernetes

Slurm

Job description

ServiceNow in Santa Clara, CA, is hiring across multiple engineering levels for compute engineering focused on scheduling, capacity, and performance across private and public clouds. You will design and evolve schedulers, build models, and apply AI/ML to improve forecasting and placement, while ensuring reliability and scale.

The role requires deep experience in large-scale SaaS, multi-tenant architectures, and proficiency in Go, Python, or Java.