Senior Staff ML Engineer - Scalable LLM Infra

Moveworks; Mountain View, Northern (CA, KY); Hybrid; USD 190,000 - 280,000; Full time

Job summary

Moveworks, a leading AI-driven platform, seeks a Senior Staff ML Engineer to design and scale ML infrastructure for training, evaluation, and serving large language models. You will own end-to-end ML pipelines and collaborate with data, ML, and product teams to push the envelope of AI-enabled workflows.

You will contribute to building robust ML systems, optimize latency, and implement production-grade frameworks that support hundreds of models in enterprise environments.

Qualifications

• 10+ years of industry experience in ML, infrastructure or related fields.
• Proficient in Python; strong in C++ or Go.
• Experience with deep learning frameworks (PyTorch, HuggingFace) and LLM serving (vLLM, TensorRT-LLM).
• Experience building scalable end-to-end ML systems and microservices/ETL pipelines.
• Strong collaboration with cross-functional teams and effective communication.

Responsibilities

• Design, build and optimize scalable ML infrastructure for training, evaluation, and deployment of large language models.
• Build abstractions to automate steps in various ML workflows.
• Collaborate with engineers, data analytics, ML experts, and product teams to deliver new features.
• Drive best practices in ML and data engineering.

Skills

10+ yrs ML

End-to-end ML systems

Microservices

Python

C++

Go

Publications in ML

Cross-functional collaboration

Education

Bachelor's in CS/CE/Math

Tools

PyTorch

HuggingFace

vLLM

TensorRT-LLM

Job description

Moveworks, a leading AI-driven platform, seeks a Senior Staff ML Engineer to design and scale ML infrastructure for training, evaluation, and serving large language models. You will own end-to-end ML pipelines and collaborate with data, ML, and product teams to push the envelope of AI-enabled workflows.

You will contribute to building robust ML systems, optimize latency, and implement production-grade frameworks that support hundreds of models in enterprise environments.