Senior Member of Technical Staff, ML Systems

Digitailor

Menlo Park (CA)

On-site

USD 180,000 - 230,000

Full time

38 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Digitailor is hiring to advance training and inference systems for image, video, and world-model workloads. You will optimize GPU kernels, distributed execution, and multi-node serving with Nsight-driven profiling.

Ideal candidates have 2+ years in ML systems, a CS degree, and hands-on experience writing kernels for NVIDIA GPUs using CUDA/CUTLASS/Triton/PTX. Visa sponsorship is available for qualified applicants.

Qualifications

  • Two years of experience in deep learning training or inference systems.
  • Hands-on ML systems or GPU performance work in current/most recent role.
  • Experience writing kernels for NVIDIA GPUs using CUDA/CUTLASS/Triton/PTX.
  • Authorship of core features in inference or training frameworks.
  • Strong CS and ML fundamentals; degree in a quantitative field.

Responsibilities

  • Optimize training and inference performance for image, video, diffusion, and world-model workloads.
  • Profile bottlenecks at kernel, memory, system, and cluster levels using Nsight and related tools.
  • Implement low-level GPU optimizations using CUDA and Triton.
  • Design and improve distributed training and inference engines for diffusion models.
  • Improve GPU-to-GPU communication with NCCL, RDMA, InfiniBand, or RoCE.
  • Build benchmarks and regression tests to preserve performance gains in production.
  • Contribute to hardware-aware kernel, runtime, and model co-design.

Skills

CUDA
Triton
CUTLASS
PTX
NCCL
RDMA
InfiniBand
RoCE
Nsight

Education

Bachelor's degree in Computer Science

Tools

NVIDIA Nsight
CUDA Toolkit
Triton Inference Server
CUTLASS
PTX
NCCL
RDMA
InfiniBand
RoCE

Job description

About The Role

Help build and optimize the training and inference systems behind image, video, and world-model workloads. You will improve performance across GPU kernels, distributed execution, and multi-node serving, working with a team focused on making advanced models faster and more efficient.

What You'Ll Do

Optimize training and inference performance for image, video, diffusion, and world-model workloads. Profile bottlenecks at the kernel, memory, system, and cluster levels using Nsight and related tools. Implement low-level GPU optimizations using CUDA and Triton. Design and improve distributed training and inference engines for diffusion models. Improve communication performance across GPUs and nodes using NCCL, RDMA, InfiniBand, or RoCE. Build benchmarks and regression tests to preserve performance gains in production. Contribute to hardware-aware kernel, runtime, and model co-design.

What We'Re Looking For

At least two years of experience in deep learning training or inference systems, distributed systems, or related work, including at least one year of hands-on ML systems or GPU performance work in your current or most recent role. A degree in computer science or a related quantitative field, with strong computer science and machine learning fundamentals. New graduates should have a strong academic background. Direct experience writing kernels for NVIDIA GPUs using CUDA, CUTLASS, Triton, or PTX. Authorship of core features in an inference or training framework, rather than deployment or integration work alone. Experience improving inference or training performance across kernels, runtimes, or distributed execution. Experience optimizing diffusion, video, image, or other multimodal workloads is valuable. Primary experience in GPU-based ML systems, rather than AMD, FPGA, or custom-accelerator work. Compensation & Benefits Base salary is $180,000 to $230,000 USD annually. Visa sponsorship is available.

Location

On-site in Menlo Park, California, United States.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, ML Systems
Member of Technical Staff, ML Systems

Digitailor • Menlo Park (CA)

On-site
USD 180,000 - 230,000
ML Systems Engineer — GPU Training & Inference at Scale
ML Systems Engineer — GPU Training & Inference at Scale

Digitailor • Menlo Park (CA)

On-site
USD 180,000 - 230,000
Member of Technical Staff, ML Systems — Confidential AI Infrastructure Startup
Member of Technical Staff, ML Systems — Confidential AI Infrastructure Startup

Aionia Group • Menlo Park (CA)

On-site
USD 150,000 - 210,000
Member of Technical Staff
Member of Technical Staff

Digitailor • San Francisco (CA)

On-site
USD 200,000 - 300,000
Staff ML Systems Engineer — GPU & Distributed Training
Staff ML Systems Engineer — GPU & Distributed Training

Digitailor • Menlo Park (CA)

On-site
USD 180,000 - 230,000
Member of Technical Staff, MLSys
Member of Technical Staff, MLSys

Bake AI Inc. • San Mateo (CA)

On-site
USD 180,000 - 240,000
Machine Learning Engineer, GPU Performance
Machine Learning Engineer, GPU Performance

Brahma Consulting Group • San Francisco (CA)

On-site
USD 150,000 - 210,000
ML Systems Engineer — Accelerate GPU Inference & Training
ML Systems Engineer — Accelerate GPU Inference & Training

Aionia Group • Menlo Park (CA)

On-site
USD 150,000 - 210,000
Senior Inference Engineer, GPU Kernel Optimization
Senior Inference Engineer, GPU Kernel Optimization

NVIDIA • Seattle (WA)

On-site
USD 184,000 - 287,500
Senior Inference Engineer, GPU Kernel Optimization
Senior Inference Engineer, GPU Kernel Optimization

NVIDIA • Austin (TX)

On-site
USD 184,000 - 287,500
Equity
Benefits