Staff ML Systems Engineer — GPU & Distributed Training

Digitailor

Menlo Park (CA)

On-site

USD 180,000 - 230,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Digitailor is hiring to advance training and inference systems for image, video, and world-model workloads. You will optimize GPU kernels, distributed execution, and multi-node serving with Nsight-driven profiling.

Ideal candidates have 2+ years in ML systems, a CS degree, and hands-on experience writing kernels for NVIDIA GPUs using CUDA/CUTLASS/Triton/PTX. Visa sponsorship is available for qualified applicants.

Qualifications

  • Two years of experience in deep learning training or inference systems.
  • Hands-on ML systems or GPU performance work in current/most recent role.
  • Experience writing kernels for NVIDIA GPUs using CUDA/CUTLASS/Triton/PTX.
  • Authorship of core features in inference or training frameworks.
  • Strong CS and ML fundamentals; degree in a quantitative field.

Responsibilities

  • Optimize training and inference performance for image, video, diffusion, and world-model workloads.
  • Profile bottlenecks at kernel, memory, system, and cluster levels using Nsight and related tools.
  • Implement low-level GPU optimizations using CUDA and Triton.
  • Design and improve distributed training and inference engines for diffusion models.
  • Improve GPU-to-GPU communication with NCCL, RDMA, InfiniBand, or RoCE.
  • Build benchmarks and regression tests to preserve performance gains in production.
  • Contribute to hardware-aware kernel, runtime, and model co-design.

Skills

CUDA
Triton
CUTLASS
PTX
NCCL
RDMA
InfiniBand
RoCE
Nsight

Education

Bachelor's degree in Computer Science

Tools

NVIDIA Nsight
CUDA Toolkit
Triton Inference Server
CUTLASS
PTX
NCCL
RDMA
InfiniBand
RoCE

Job description

Digitailor is hiring to advance training and inference systems for image, video, and world-model workloads. You will optimize GPU kernels, distributed execution, and multi-node serving with Nsight-driven profiling.

Ideal candidates have 2+ years in ML systems, a CS degree, and hands-on experience writing kernels for NVIDIA GPUs using CUDA/CUTLASS/Triton/PTX. Visa sponsorship is available for qualified applicants.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Systems Engineer — GPU Training & Inference at Scale
ML Systems Engineer — GPU Training & Inference at Scale

Digitailor • Menlo Park (CA)

On-site
USD 180,000 - 230,000
Member of Technical Staff, ML Systems
Member of Technical Staff, ML Systems

Digitailor • Menlo Park (CA)

On-site
USD 180,000 - 230,000
Senior Member of Technical Staff, ML Systems
Senior Member of Technical Staff, ML Systems

Digitailor • Menlo Park (CA)

On-site
USD 180,000 - 230,000
ML Systems Engineer — Accelerate GPU Inference & Training
ML Systems Engineer — Accelerate GPU Inference & Training

Aionia Group • Menlo Park (CA)

On-site
USD 150,000 - 210,000
ML Systems Engineer: Scalable Training & GPU Kernels
ML Systems Engineer: Scalable Training & GPU Kernels

Motional • Boston (MA)

Hybrid
USD 144,000 - 192,000
Health insurance
Dental insurance
Vision coverage
+4
Senior ML Training Systems Engineer - Distributed CUDA
Senior ML Training Systems Engineer - Distributed CUDA

Genesis AI • San Francisco (CA)

On-site
USD 180,000 - 260,000
Machine Learning Engineer, GPU Performance
Machine Learning Engineer, GPU Performance

Brahma Consulting Group • San Francisco (CA)

On-site
USD 150,000 - 210,000
Senior ML Training Systems Engineer - Distributed GPU Infra
Senior ML Training Systems Engineer - Distributed GPU Infra

Baseten • San Francisco (CA)

On-site
USD 150,000 - 200,000
Competitive compensation, including equity
100% coverage of medical, dental, and vision insurance
Generous PTO policy
+2
Distributed Training Systems Engineer
Distributed Training Systems Engineer

Reflection AI Ltd • New York (NY)

On-site
USD 180,000 - 270,000
Top-tier compensation
Stock options
Health & wellness
+5
Senior ML Performance Engineer - GPU Inference & CUDA
Senior ML Performance Engineer - GPU Inference & CUDA

Mixpeek • New York (NY)

On-site
USD 140,000 - 220,000