Lead ML Platform Engineer: Training & Inference at Scale

Paramount; Burbank (CA); On-site; USD 157,000 - 235,000; Full time

Benefits offered by this job

Benefits package

On-site & virtual events

Generous PTO

Job summary

Paramount is seeking a Senior Lead / Lead ML Platform Engineer to architect and own the technical direction for our Training and Inference infrastructure within the Applied Machine Learning Group (AMLG). You will ensure scalable, low-latency training and serving pipelines across petabytes of data in a distributed Kubernetes-based environment.

In this role you will drive adoption of AnyScale/Ray, optimize GPU utilization, mentor engineers, and set standards for deployment, monitoring, and

Qualifications

• 6-8+ years of experience in ML Infrastructure, Platform Engineering, or high-scale Backend Engineering.
• Extensive experience with Kubernetes and serving frameworks for large-scale ML models.
• Strong knowledge of GPU architecture, CUDA, and optimizing ML workloads for hardware acceleration.
• Leadership (IC4/5): owning the technical direction across multiple teams.
• Infra-as-Code and building automated MLOps pipelines (Terraform/Pulumi) beneficial.
• Distributed Systems mastery with Ray (AnyScale) or similar.
• Familiarity with ML observability tools (Prometheus, Grafana, MLFlow).
• Multi-cloud or hybrid-cloud ML environments experience.

Responsibilities

• Own the long-term architectural direction for Training and Inference domains.
• Lead implementation and optimization of Ray/AnyScale for distributed compute.
• Design and maintain Kubernetes-based inference servers optimized for GPUs.
• Navigate GPU instance trade-offs for cost, availability, and performance.
• Establish reusable patterns for CI/CD, model versioning, and canary deployments.
• Define and enforce SLIs/SLOs for the platform.
• Mentor senior engineers across ML Platform and AML pods.

Skills

Kubernetes

Python

C++

GPU acceleration

Distributed systems

Technical leadership

Tools

Ray/AnyScale

Triton

TorchServe

Prometheus

Grafana

Job description

Paramount is seeking a Senior Lead / Lead ML Platform Engineer to architect and own the technical direction for our Training and Inference infrastructure within the Applied Machine Learning Group (AMLG). You will ensure scalable, low-latency training and serving pipelines across petabytes of data in a distributed Kubernetes-based environment.

In this role you will drive adoption of AnyScale/Ray, optimize GPU utilization, mentor engineers, and set standards for deployment, monitoring, and