Senior ML Infrastructure Engineer

Servicenow; Mountain View (CA); Hybrid; USD 190,000 - 230,000; Full time

Job summary

ServiceNow is seeking a Machine Learning Engineer to build scalable ML infrastructure for training, evaluation, and serving LLMs at our Mountain View campus. You will partner with ML, data, and product teams to productionize models at scale, ensure low latency, and drive impactful AI features.

The role demands 10+ years in ML/infra, with PyTorch and LLM experience, and strong Python/C++. This is a high-impact, fast-moving position within a leading AI-enabled platform company.

Qualifications

• Requires extensive ML infrastructure experience and leadership in building scalable systems.
• Experience with PyTorch, Hugging Face, and LLM serving frameworks.
• Proven ability to deploy end-to-end ML solutions at scale.
• Strong coding in Python and performance-oriented languages like C++.

Responsibilities

• Design, build and optimize scalable ML infrastructure for training, evaluation, and deployment of LLMs.
• Create abstractions to automate various steps in ML workflows.
• Collaborate with cross-functional teams to deliver new features and improve pipelines.
• Drive best practices in ML and data engineering across the org.

Skills

ML infrastructure

PyTorch

LLM serving

Python

C++

Education

Bachelor's in CS/CE/Math

Tools

PyTorch

Hugging Face

vLLM

TensorRT-LLM

Job description

ServiceNow is seeking a Machine Learning Engineer to build scalable ML infrastructure for training, evaluation, and serving LLMs at our Mountain View campus. You will partner with ML, data, and product teams to productionize models at scale, ensure low latency, and drive impactful AI features.

The role demands 10+ years in ML/infra, with PyTorch and LLM experience, and strong Python/C++. This is a high-impact, fast-moving position within a leading AI-enabled platform company.