GPU Performance Engineer: CUDA, Triton & Inference

Brahma Consulting Group; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Brahma is conducting this search for a client and is building a team focused on accelerating generative video and image workloads. This early engineering hire reports to the CEO and joins a founding group with deep expertise in distributed systems and ML research.

You’ll optimize GPU performance, implement CUDA/Triton kernels, and build scalable inference and training engines across multiple GPUs. Ideal candidates bring CUDA, Triton, and GPU profiling experience and a passion for deep technical

Qualifications

• 1+ years working on deep learning inference or training systems, or distributed systems.
• Hands-on experience with CUDA, Triton, PyTorch internals, or GPU profiling.
• Strong CS fundamentals and a drive to go deep on hard technical problems.

Responsibilities

• Optimize GPU performance for training and inference on image and video workloads.
• Profile and remove bottlenecks at kernel, memory, system, and cluster level.
• Write CUDA and Triton kernels that ship to production.
• Build distributed inference and training engines for diffusion models across GPUs and nodes.
• Own communication performance: NCCL, RDMA over InfiniBand or RoCE, and disaggregated serving.
• Build benchmarking and regression harnesses so performance gains hold in production.

Skills

CUDA

Triton

PyTorch internals

GPU profiling

Distributed systems

Tools

Nsight

RDMA

NCCL

Job description

Brahma is conducting this search for a client and is building a team focused on accelerating generative video and image workloads. This early engineering hire reports to the CEO and joins a founding group with deep expertise in distributed systems and ML research.

You’ll optimize GPU performance, implement CUDA/Triton kernels, and build scalable inference and training engines across multiple GPUs. Ideal candidates bring CUDA, Triton, and GPU profiling experience and a passion for deep technical