Staff ML Systems Engineer - Performance at Scale

FDE Times

United States

On-site

USD 180,000 - 240,000

Full time

12 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Modal is building an AI infrastructure layer and seeks engineers who can make ML systems performant at scale. You will work on GPU-focused optimization, leveraging CUDA and modern ML frameworks like vLLM or TensorRT, while applying performance engineering techniques to reduce overhead and improve throughput.

Ideal candidates have 5+ years of high-quality, high-performance coding experience and familiarity with NVIDIA GPU architectures.

Qualifications

  • 5+ years of experience writing high-quality, high-performance code.

Responsibilities

  • Develop ML infrastructure that performs at scale.
  • Optimize GPU utilization and inference performance using vLLM/TensorRT.
  • Collaborate with ML teams to deploy production-ready models.
  • Analyze and improve SM occupancy and overhead to boost throughput.

Skills

5+ years of code experience
Torch / ML frameworks / inference
NVIDIA CUDA
ML performance engineering

Job description

Modal is building an AI infrastructure layer and seeks engineers who can make ML systems performant at scale. You will work on GPU-focused optimization, leveraging CUDA and modern ML frameworks like vLLM or TensorRT, while applying performance engineering techniques to reduce overhead and improve throughput.

Ideal candidates have 5+ years of high-quality, high-performance coding experience and familiarity with NVIDIA GPU architectures.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Systems Engineer - GPU Performance
Senior ML Systems Engineer - GPU Performance

Fdetimes • New York (NY)

On-site
USD 140,000 - 210,000
Senior ML Performance Engineer - GPU Inference & CUDA
Senior ML Performance Engineer - GPU Inference & CUDA

Essence Ventures • New York (NY)

Hybrid
USD 140,000 - 220,000
Senior ML Performance Engineer - GPU & Inference
Senior ML Performance Engineer - GPU & Inference

Modal Labs • New York (NY)

On-site
Confidential
Member of Technical Staff - ML Performance
Member of Technical Staff - ML Performance

FDE Times • United States

On-site
USD 180,000 - 240,000
Member of Technical Staff - ML Performance
Member of Technical Staff - ML Performance

Modal Labs • New York (NY)

On-site
USD 150,000 - 190,000
Member of Technical Staff - ML Performance
Member of Technical Staff - ML Performance

Essence Ventures • New York (NY)

Hybrid
USD 140,000 - 220,000
Member of Technical Staff - ML Performance
Member of Technical Staff - ML Performance

FDE Times • New York (NY)

On-site
USD 140,000 - 210,000
ML Performance Engineer — Optimize GPU Training at Scale
ML Performance Engineer — Optimize GPU Training at Scale

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 357,000
Equity
Benefits
Senior GPU ML Performance Engineer
Senior GPU ML Performance Engineer

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 357,000
Equity
Benefits
Member of Technical Staff, ML Systems ML Systems
Member of Technical Staff, ML Systems ML Systems

TensorScale AI, Inc. • San Francisco (CA)

On-site
USD 180,000 - 260,000