Senior ML Infrastructure Engineer - Cortex Training

Fdetimes; Bellevue (WA); In loco; USD 180.000 - 240.000; Tempo pieno

Descrizione del lavoro

Snowflake is seeking a Senior Software Engineer for the Cortex Training team to design and build the full stack from public training APIs to the GPU data plane. You’ll scale distributed systems for multi‑tenant GPU compute, drive end‑to‑end performance, and productionize research building blocks with Snowflake Research.

Ideal candidates bring strong distributed systems experience, hands‑on GPU/LLM infrastructure know‑how (PyTorch/DeepSpeed/Ray), and a track record delivering reliable, scalable

Competenze

• 3+ years (Intermediate) | 6+ years (Senior) building and shipping production ML systems.
• Strong distributed systems and infrastructure foundation — designing scalable, fault‑tolerant services and operating them on Kubernetes in production.
• Familiarity with GPU and LLM infrastructure — e.g., PyTorch, DeepSpeed/FSDP, Ray, CUDA/NCCL, vLLM; able to debug across the data, infrastructure, and GPU layers.
• Demonstrated ability to harden complex systems for reliability, throughput, and cost efficiency.

Mansioni

• Design and build across the full stack — from the public training APIs and SDK through the control plane to the GPU data plane.
• Scale the distributed systems that make GPU compute serverless — multi-tenant scheduling, placement, and capacity‑aware routing across regional GPU pools, with fault tolerance built in.
• Drive end‑to‑end performance at scale — keep the training, inference, and RL loops fast and the data plane responsive under heavy concurrent load, with GPUs kept saturated.
• Productionize research building blocks — partner with Snowflake Research to turn state‑of‑the‑art training and inference techniques into reliable, composable components customers can run at enterprise scale.

Conoscenze

Distributed systems

Kubernetes

Performance optimization

ML infra

GPU/LLM infra

PyTorch

DeepSpeed/FSDP

Ray

vLLM

Reliability

Formazione

BS in Computer Science

MS/PhD a plus

Strumenti

PyTorch

DeepSpeed/FSDP

Ray

CUDA/NCCL

vLLM

Descrizione del lavoro

Snowflake is seeking a Senior Software Engineer for the Cortex Training team to design and build the full stack from public training APIs to the GPU data plane. You’ll scale distributed systems for multi‑tenant GPU compute, drive end‑to‑end performance, and productionize research building blocks with Snowflake Research.

Ideal candidates bring strong distributed systems experience, hands‑on GPU/LLM infrastructure know‑how (PyTorch/DeepSpeed/Ray), and a track record delivering reliable, scalable