Remote ML Performance Engineer - GPU & Systems Optimizer

Bright Vision Technologies

Eden Prairie (MN)

Remote

USD 100,000 - 150,000

Full time

9 days ago

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Bright Vision Technologies is seeking an AI Performance Engineer for a fully remote US role. You will optimize training and inference pipelines across GPUs and distributed systems, focusing on throughput, latency, and cost.

You’ll work with cross-functional teams to translate requirements into high-performance production code. The ideal candidate has extensive experience with Python, C++, and modern GPU stacks, plus hands-on experience with Triton, XLA, TorchInductor, TVM, and related tools.

Qualifications

Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field.
6+ years of experience in performance engineering, ML systems, or HPC.
Strong proficiency in Python and C++.
Hands-on experience optimizing deep learning workloads on modern GPUs.
Deep understanding of distributed training and inference techniques.
Experience with profiling tools across CPU, GPU, and distributed systems.

Responsibilities

Profile and optimize end-to-end AI training and inference pipelines for throughput, latency, and cost.
Identify and eliminate bottlenecks across data loading, model compute, communication, and memory.
Implement and tune quantization, sparsity, and pruning to reduce footprint and speed up inference.
Enable scalable distributed training with tensor parallelism and pipeline parallelism.
Tune attention using FlashAttention and related techniques.
Drive compiler-level optimizations with Triton, XLA, TorchInductor, or TVM.