ML Infrastructure Engineer for Scalable LLMs

ServiceNow; Mountain View (CA); Hybrid; USD 130,000 - 160,000; Full time

Job summary

A leading technology firm seeks a Machine Learning Engineer to build cutting-edge infrastructure for large language models. This position involves designing scalable ML systems and collaborating with cross-functional teams to enhance AI experiences. The ideal candidate has 8+ years in machine learning and strong skills in Python, and experience with frameworks like PyTorch. A Bachelor's in a relevant field is required, along with a passion for innovation. Join us to impact how customers experience AI.

Qualifications

• 8+ years of industry experience in Machine Learning or Infrastructure.
• Experience with deep learning frameworks such as PyTorch or HuggingFace.
• Expertise in Python and experience with performant languages like C++ or Go.

Responsibilities

• Design, build, and optimize scalable ML infrastructure for LLMs.
• Collaborate with cross-functional teams to build new features.
• Drive best practices in ML and data engineering.

Skills

Machine Learning

Infrastructure

Deep Learning Frameworks

Python

C++

Go

Education

Bachelor's in Computer Science, Computer Engineering, Mathematics or equivalent

Tools

PyTorch

HuggingFace

vLLM

TensorRT-LLM

Job description

A leading technology firm seeks a Machine Learning Engineer to build cutting-edge infrastructure for large language models. This position involves designing scalable ML systems and collaborating with cross-functional teams to enhance AI experiences. The ideal candidate has 8+ years in machine learning and strong skills in Python, and experience with frameworks like PyTorch. A Bachelor's in a relevant field is required, along with a passion for innovation. Join us to impact how customers experience AI.