ML Systems Engineer — Accelerate GPU Inference & Training

Aionia Group

Menlo Park (CA)

On-site

USD 150,000 - 210,000

Full time

13 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Aionia Group in Menlo Park, CA is hiring a Member of Technical Staff, ML Systems to accelerate model training and inference across image, video, and world-model workloads. You will work with a founding team on kernels, runtimes, and distributed engines that power production-scale ML stacks.

You’ll optimize GPU performance, profile bottlenecks with Nsight, and implement low-level CUDA and Triton improvements.

Qualifications

  • Worked on inference or training performance — GPU kernels, runtime, or distributed execution.
  • Optimized diffusion, video, image, or other multimodal model workloads.
  • Degree in Computer Science or a related quantitative field.

Responsibilities

  • Optimize GPU and system performance for training and inference across image, video, and world-model workloads.
  • Profile and remove bottlenecks at the kernel, memory, system, and cluster level using Nsight and related tooling.
  • Write low-level optimizations in CUDA and Triton on code paths that run in production.
  • Build distributed inference and training engines for diffusion models across multiple GPUs and nodes.
  • Own communication performance — NCCL, RDMA over InfiniBand or RoCE, and disaggregated serving.
  • Build benchmarking and regression harnesses so performance gains don't slide back in production.

Skills

GPU kernel optimization
Distributed systems
Profiling
Performance optimization
Multimodal models

Education

Bachelor's degree in Computer Science or related field

Tools

CUDA
Triton
PyTorch
Nsight
NCCL
RDMA / InfiniBand

Job description

Aionia Group in Menlo Park, CA is hiring a Member of Technical Staff, ML Systems to accelerate model training and inference across image, video, and world-model workloads. You will work with a founding team on kernels, runtimes, and distributed engines that power production-scale ML stacks.

You’ll optimize GPU performance, profile bottlenecks with Nsight, and implement low-level CUDA and Triton improvements.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Systems Engineer: Scalable Training & GPU Kernels
ML Systems Engineer: Scalable Training & GPU Kernels

Motional • Boston (MA)

Hybrid
USD 144,000 - 192,000
Health insurance
Dental insurance
Vision coverage
+4
ML Systems Engineer: Inference & GPU-Driven Distributed Workloads
ML Systems Engineer: Inference & GPU-Driven Distributed Workloads

Bake AI Inc. • San Mateo (CA)

Hybrid
USD 180,000 - 240,000
Member of Technical Staff, MLSys
Member of Technical Staff, MLSys

Bake AI Inc. • San Mateo (CA)

On-site
USD 180,000 - 240,000
Machine Learning Engineer, GPU Performance
Machine Learning Engineer, GPU Performance

Brahma Consulting Group • San Francisco (CA)

On-site
USD 150,000 - 210,000
ML Infra Engineer — GPU Clusters & Distributed Systems
ML Infra Engineer — GPU Clusters & Distributed Systems

AI Breaking Wire • San Francisco (CA), Northern (KY)

Hybrid
USD 170,000 - 250,000
Industry-leading compensation and/or:?
Unlimited PTO
Top-tier medical, dental, and vision
+1
Member of Technical Staff, ML Systems — Confidential AI Infrastructure Startup
Member of Technical Staff, ML Systems — Confidential AI Infrastructure Startup

Aionia Group • Menlo Park (CA)

On-site
USD 150,000 - 210,000
ML Systems Engineer - Distributed AI & GPU
ML Systems Engineer - Distributed AI & GPU

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 152,000 - 242,000
Equity
Benefits package
Senior AI Systems Engineer — Remote GPU ML Infra
Senior AI Systems Engineer — Remote GPU ML Infra

Bright Vision Technologies • Yuba City (CA)

Remote
USD 90,000 - 100,000
Senior ML Training Systems Engineer - Distributed CUDA
Senior ML Training Systems Engineer - Distributed CUDA

Genesis AI • San Francisco (CA)

On-site
USD 180,000 - 260,000
Kernel Engineer — High-Performance AI Inference
Kernel Engineer — High-Performance AI Inference

Acceler8 Talent • Santa Clara (CA)

On-site
USD 170,000 - 350,000
Equity / stock options
Medical, dental, and vision coverage
Unlimited PTO
+1