ML Systems Engineer — GPU Training & Inference at Scale

Digitailor; Menlo Park (CA); Presencial; USD 180.000 - 230.000; Jornada completa

Descripción de la vacante

Digitailor is seeking an experienced ML systems engineer to join its AI systems team in Menlo Park, CA. You will optimize training and inference performance for image, video, and world-model workloads, focusing on GPU kernels, distributed execution, and high-performance serving systems.

The role requires hands-on work with CUDA, Triton, and Nsight, plus collaboration across hardware, runtime, kernel, and model design to push performance gains in production.

Formación

• At least 2 years of experience in deep learning training or inference systems.
• Experience optimizing inference or training performance through GPU kernels, runtime systems, or distributed execution.
• Direct experience writing kernels for NVIDIA GPUs using CUDA, CUTLASS, Triton, or PTX.
• Authored core features in a training or inference framework (e.g., vLLM, SGLang, TensorRT-LLM, Megatron).
• Strong machine learning and CS fundamentals; degree in CS or a related quantitative field.
• Experience with PyTorch and Nsight; workloads like diffusion, video, image, or multimodal models.

Responsabilidades

• Optimize training and inference performance for image, video, and world-model workloads.
• Profile bottlenecks at kernel, memory, system, and cluster levels using Nsight and related tools.
• Implement low-level GPU optimizations with CUDA and Triton.
• Design and improve distributed training and inference engines for diffusion models.
• Improve communication performance across GPUs and nodes using NCCL, RDMA, InfiniBand, or RoCE.
• Build benchmarking and regression tools to maintain performance gains in production.
• Coordinate hardware, runtime, kernel, and model design for efficient execution.

Conocimientos

Deep learning

GPU performance

Distributed systems

PyTorch

CUDA kernels

ML fundamentals

Educación

Bachelor's degree in CS or related field

Herramientas

Nsight

CUDA

Triton

PTX

NCCL

RDMA

InfiniBand

RoCE

Descripción del empleo

Digitailor is seeking an experienced ML systems engineer to join its AI systems team in Menlo Park, CA. You will optimize training and inference performance for image, video, and world-model workloads, focusing on GPU kernels, distributed execution, and high-performance serving systems.

The role requires hands-on work with CUDA, Triton, and Nsight, plus collaboration across hardware, runtime, kernel, and model design to push performance gains in production.