ML Platform Engineer: Training & Inference for AI Models

Saviynt; Milpitas (CA); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Competitive total rewards package

Learning opportunities

Discretionary bonus plan

Job summary

Saviynt is looking for an ML Platform Engineer located in Milpitas, California. You will manage distributed training and build a secure AI foundation for identity products. The ideal candidate will have extensive experience with ML engineering and tools like Ray and PyTorch.

In this role, you will operate the full model promotion lifecycle and contribute to innovative AI solutions. A strong understanding of LLM serving engines and distributed training is essential.

We offer a competitive rewards package and opportunities for career advancement.

Qualifications

• Experience in ML engineering with time in an ML platform or MLOps role.
• Hands-on with vLLM, SGLang, or NVIDIA Triton.
• Production level experience with DDP, FSDP, NCCL collectives.

Responsibilities

• Own the Ray ecosystem end-to-end and manage KubeRay on GKE.
• Operate distributed training with Ray Train with multi-node H100 clusters.
• Build and operate the LLM inference mesh with Ray Serve.

Skills

ML engineering experience

Production Ray depth

LLM serving engines

Distributed training knowledge

RL working knowledge

Model lifecycle operations

Vector databases knowledge

Strong Python skills

Quantization techniques

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Ray

PyTorch

Flyte

Job description

Saviynt is looking for an ML Platform Engineer located in Milpitas, California. You will manage distributed training and build a secure AI foundation for identity products. The ideal candidate will have extensive experience with ML engineering and tools like Ray and PyTorch.

In this role, you will operate the full model promotion lifecycle and contribute to innovative AI solutions. A strong understanding of LLM serving engines and distributed training is essential.

We offer a competitive rewards package and opportunities for career advancement.