Senior DL Compiler Engineer (XLA) – Equity & Impact

NVIDIA

Washington

On-site

USD 152,000 - 288,000

Full time

8 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking versatile software engineers for the XLA team to build high-performance, production-grade AI compiler software that powers next-generation GPUs. You will work on graph optimization, partitioning, and code-generation with state-of-the-art toolchains like MLIR and LLVM, while collaborating with hardware teams to shape future accelerators.

You will contribute to scalable distributed training and inference, and you will influence user-facing components in JAX and related libraries,

Qualifications

Bachelor's, Master's or PhD in CS/CE or related field (or equivalent experience).
4+ years of experience in performance analysis and compiler optimizations.
Ability to work independently, define project goals and scope, and lead your own development effort with clean software engineering and testing practices.
Excellent C/C++ programming and software design, including debugging, performance analysis, and test design.
Strong foundation in CPU/GPU architecture and high-performance computing; distributed programming.
CUDA or OpenCL experience is desired but not required.
Experience with XLA, TVM, MLIR, LLVM, OpenAI Triton, deep learning models/algorithms, and DL framework design is a plus.
Strong interpersonal skills and capability to mentor engineers and interns.

Responsibilities

Craft compiler optimization techniques for deep learning network graphs.
Design graph partitioning and tensor sharding for distributed training and inference.
Performance tuning and analysis.
Code-generation for NVIDIA GPU backends using MLIR, LLVM and OpenAI Triton.
Design user-facing features in JAX and related libraries and other general software engineering work.
Collaborate with GPU hardware teams to design AI compiler features for next-generation GPUs.