Staff Machine Learning Engineer, Agentic Systems - Moveworks

ServiceNow; Mountain View (CA); On-site; USD 130,000 - 160,000; Full time

Job summary

A leading technology firm seeks a Machine Learning Engineer to build cutting-edge infrastructure for large language models. This position involves designing scalable ML systems and collaborating with cross-functional teams to enhance AI experiences. The ideal candidate has 8+ years in machine learning and strong skills in Python, and experience with frameworks like PyTorch. A Bachelor's in a relevant field is required, along with a passion for innovation. Join us to impact how customers experience AI.

Qualifications

• 8+ years of industry experience in Machine Learning or Infrastructure.
• Experience with deep learning frameworks such as PyTorch or HuggingFace.
• Expertise in Python and experience with performant languages like C++ or Go.

Responsibilities

• Design, build, and optimize scalable ML infrastructure for LLMs.
• Collaborate with cross-functional teams to build new features.
• Drive best practices in ML and data engineering.

Skills

Machine Learning

Infrastructure

Deep Learning Frameworks

Python

C++

Go

Education

Bachelor's in Computer Science, Computer Engineering, Mathematics or equivalent

Tools

PyTorch

HuggingFace

vLLM

TensorRT-LLM

Job description

Overview

We are looking for a Machine Learning Engineer to help build cutting edge ML infrastructure for building and serving LLMs at Moveworks. This role will be critical in building, optimizing and scaling end-to-end machine learning systems. The ML infra team covers a variety of responsibilities including distributed training and inference pipeline for large language models (LLM), model evaluation and monitoring framework, LLM latency optimization, etc. These frameworks serve as a strong foundation for our hundreds of ML and NLP models in production serving hundreds of millions of enterprise employees. We are solving many challenges on scalability of services as well as optimization of core algorithms.

In this role you will work closely with our machine learning team, data infrastructure team and every core skill. Above all, your work will impact the way our customers experience AI. Put another way, this role is absolutely critical to the long term scalability of our core AI product and ultimately the company. You will be responsible for building and productionizing ML infrastructure that runs state of the art models. If you are looking for a high-impact, fast-moving role to take your work to the next level, we should have a conversation.

Responsibilities

• Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models.
• Build abstractions to automate various steps in different ML workflows
• Collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to build new features
• Leverage your experience to drive best practices in ML and data engineering

Qualifications

• 8+ years of industry experience in Machine Learning, Infrastructure or related fields
• Experience with deep learning framework such as PyTorch or HuggingFace or LLM serving frameworks such as vLLM or TensorRT-LLM
• Experience with building and scaling end-to-end machine learning systems
• Experience building scalable micro services and ETL pipelines
• Expertise in Python and experience with performant languages such as C++ or Go
• Bachelor\'s in Computer Science, Computer Engineering, Mathematics, or equivalent field
• A love of research publications in the machine learning and software engineering communities
• Effective communicator with experience collaborating cross-functionally with other teams

Additional Information

Work Personas

We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.

Equal Opportunity Employer

ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.

Accommodations

We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact globaltalentss at servicenow dot com for assistance.

Export Control Regulations

For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities.