Senior AI Compiler Engineer - XLA & DL Graphs

NVIDIA; California (MO); On-site; USD 184,000 - 288,000; Full time

Job summary

NVIDIA's XLA team is seeking versatile software engineers to design and optimize compilers for deep learning graphs, including graph partitioning, tensor sharding, and code-generation for MLIR/LLVM backends. You'll work closely with GPU hardware teams on next-generation AI compiler features.

We value deep learning experience, strong C/C++, and a track record in performance analysis and distributed programming. This role offers a competitive salary, equity, and comprehensive benefits on site.

Qualifications

• Bachelors, Masters or Ph.D. in Computer Science, Computer Engineering, related field (or equivalent experience).
• 4+ years of relevant work or research experience in performance analysis and compiler optimizations.
• Ability to work independently, define project goals and scope, and lead your own development effort adopting clean software engineering and testing practices.
• Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design.
• Strong foundation in architecture of CPU, GPUs or other high performance hardware accelerators. Knowledge of high-performance computing and distributed programming.
• CUDA or OpenCL programming experience is desired but not required.
• Experience with the following technologies is a huge plus: XLA, TVM, MLIR, LLVM, OpenAI Triton, deep learning models and algorithms, and deep learning framework design.

Responsibilities

• Crafting and implementing compiler optimization techniques for deep learning network graphs.
• Designing novel graph partitioning and tensor sharding techniques for distributed training and inference.
• Performance tuning and analysis.
• Code-generation for NVIDIA GPU backends using open-source compilers such as MLIR, LLVM and OpenAI Triton.
• Designing user facing features in JAX and related libraries and other general software engineering work.
• Working closely with GPU hardware engineering teams to design AI compiler software features for next-generation GPUs.

Skills

C/C++ programming

Performance analysis

Compiler optimization

GPU/CPU architecture

Distributed programming

OpenCL/CUDA

Education

Bachelor's degree in CS/CE

Tools

MLIR

LLVM

XLA

TVM

OpenAI Triton

Job description

NVIDIA's XLA team is seeking versatile software engineers to design and optimize compilers for deep learning graphs, including graph partitioning, tensor sharding, and code-generation for MLIR/LLVM backends. You'll work closely with GPU hardware teams on next-generation AI compiler features.

We value deep learning experience, strong C/C++, and a track record in performance analysis and distributed programming. This role offers a competitive salary, equity, and comprehensive benefits on site.