Senior AI Compiler Engineer – Large-Scale DL Training

NVIDIA Corporation

Redmond (WA)

On-site

USD 184,000 - 288,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA Corporation is seeking world-class Software Engineers for the Deep Learning Compiler Technology team to advance JaxPP, NVIDIA's open-source library for pipeline parallelism in JAX. You will design compiler transformations and build a distributed runtime across multi-GPU clusters to accelerate large-scale training.

We value advanced degrees and 6+ years in compilers and distributed systems, with hands-on experience in JAX, XLA, PyTorch, MPI, and CUDA.

Qualifications

  • Masters or PhD in Computer Science, Computer Engineering, or related field, or equivalent experience.
  • 6+ years of relevant work or research experience in compilers, distributed systems, or deep learning training.
  • Strong background in compiler design and distributed system development.
  • Experience with JAX, PyTorch, and deep learning frameworks.
  • Proficient in C/C++ and Python; skilled in debugging and performance analysis.
  • Experience with MPI and GPU programming.
  • Ability to work independently and lead development; strong communication.

Responsibilities

  • Design and implement program transformations on JAX programs (jaxpr) for large-scale training.
  • Develop compilers and runtime frameworks to accelerate deep learning training on large distributed systems.
  • Work on compiling graph IR to target code and build distributed runtime for multi-GPU pipelines.
  • Advance compiler tech for high-performance large-scale training, including mixture-of-experts models.
  • Collaborate with JAX/XLA teams and hardware teams to accelerate next-gen DL software.
  • Contribute to open-source JaxPP: testing, performance tracking, and integration with JAX.

Skills

C/C++ programming
Python programming
Distributed systems
GPU training & inference
Performance debugging
Communication skills
MPI

Education

Master's or PhD in CS/CE or related field

Tools

JAX
XLA
PyTorch
CUDA
MPI
NCCL

Job description

NVIDIA Corporation is seeking world-class Software Engineers for the Deep Learning Compiler Technology team to advance JaxPP, NVIDIA's open-source library for pipeline parallelism in JAX. You will design compiler transformations and build a distributed runtime across multi-GPU clusters to accelerate large-scale training.

We value advanced degrees and 6+ years in compilers and distributed systems, with hands-on experience in JAX, XLA, PyTorch, MPI, and CUDA.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Compiler Engineer (Distributed DL Training)
Senior AI Compiler Engineer (Distributed DL Training)

NVIDIA Corporation • United States

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior AI Compiler Engineer
Senior AI Compiler Engineer

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior AI Compiler Engineer — Distributed Training
Senior AI Compiler Engineer — Distributed Training

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior Compiler Engineer - AI
Senior Compiler Engineer - AI

NVIDIA Corporation • Redmond (WA)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior Compiler Engineer - AI
Senior Compiler Engineer - AI

Nvidia Corporation in • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior Compiler Engineer - AI
Senior Compiler Engineer - AI

2100 NVIDIA USA • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior Compiler Engineer - AI
Senior Compiler Engineer - AI

NVIDIA Corporation • United States

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior AI Compiler Engineer: Code-Gen & Optimizations
Senior AI Compiler Engineer: Code-Gen & Optimizations

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 242,000
Senior ML Inference & Compiler Architect
Senior ML Inference & Compiler Architect

NVIDIA Corporation • United States

Remote
USD 150,000 - 230,000
Senior Machine Learning Applications and Compiler Engineer, LPX
Senior Machine Learning Applications and Compiler Engineer, LPX

NVIDIA Corporation • United States

Remote
USD 150,000 - 230,000