Senior ML Engineer – AI Inference & Kubernetes DevOps

ServiceNow; California; Hybrid; USD 201,000 - 352,000; Full time

Benefits offered by this job

Health plans

401(k) Plan with company match

ESP P

Matching donations

Flexible time away plan

Family leave programs

Job summary

ServiceNow is seeking a Senior Staff Machine Learning Engineer (DevOps) to lead the AI inference platform. You will own the end-to-end lifecycle from onboarding models to deploying optimized engines across backends on Kubernetes. You will architect the gateway layer using Envoy to enforce access, observability, and advanced routing.

You will design scalable software, ensure robust testing, and drive measurable performance improvements in a fast-paced, AI-native culture.

Qualifications

• 8+ years of backend software engineering experience.
• 4+ years designing and operating distributed systems.
• 3+ years Kubernetes in production with Helm and CI/CD.
• Bachelor’s degree in computer science, software engineering, or related field.

Responsibilities

• Own end-to-end inference lifecycle: onboarding models to deployment across backends on Kubernetes.
• Architect gateway layer using Envoy and ext_proc for access control and observability.
• Build efficient, scalable software with strong testing and performance focus.
• Develop and monitor production-grade services with rigorous incident handling.

Skills

Go

Python

OOP

Design Patterns

Algorithms

Education

Bachelor’s degree in CS/SE

Tools

Kubernetes

Helm

CI/CD

Envoy

Job description

ServiceNow is seeking a Senior Staff Machine Learning Engineer (DevOps) to lead the AI inference platform. You will own the end-to-end lifecycle from onboarding models to deploying optimized engines across backends on Kubernetes. You will architect the gateway layer using Envoy to enforce access, observability, and advanced routing.

You will design scalable software, ensure robust testing, and drive measurable performance improvements in a fast-paced, AI-native culture.