Senior ML Inference & Compiler Architect

NVIDIA Corporation

United States

Remote

USD 150,000 - 230,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

NVIDIA Corporation is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack, bridging large-scale systems, compilers, and deep learning. You will map neural network workloads onto NVIDIA platforms with high-performance runtime components and novel compilation techniques.

Join a team working at the intersection of software and hardware to extend NVIDIA’s compiler and runtime ecosystem, collaborating across disciplines to deliver scalable inference

Qualifications

  • MS or PhD in Computer Science, Electrical/Computer Engineering, or related field, or equivalent experience, with 6 years of relevant experience.
  • Strong software engineering background with proficiency in systems level programming (e.g., C/C++ and/or Rust) and solid CS fundamentals in data structures, algorithms, and concurrency.
  • Hands on experience with compiler or runtime development, including IR design, optimization passes, or code generation.
  • Experience with LLVM and/or MLIR, including building custom passes, dialects, or integrations.
  • Familiarity with deep learning frameworks such as TensorFlow and PyTorch, and experience working with portable graph formats such as ONNX.
  • Solid understanding of parallel and heterogeneous compute architectures, such as GPUs, spatial accelerators, or other domain specific processors.
  • Strong analytical and debugging skills, with experience using profiling, tracing, and benchmarking tools to drive performance improvements.
  • Excellent communication and collaboration skills, with the ability to work across hardware, systems, and software teams.
  • Ideal candidates will have direct experience with MLIR based compilers or other multilevel IR stacks, especially in the context of graph based deep learning workloads.

Responsibilities

  • Build, develop, and maintain high-performance runtime and compiler components, focusing on end-to-end inference optimization.
  • Define and implement mappings of large-scale inference workloads onto NVIDIA’s systems.
  • Extend and integrate with NVIDIA’s SW ecosystem, contributing to libraries, tooling, and interfaces that enable seamless deployment of models across platforms.
  • Benchmark, profile, and monitor key performance and efficiency metrics to ensure the compiler generates efficient mappings of neural network graphs to our inference hardware.
  • Collaborate closely with hardware architects and design teams to feedback software observations, influence future architectures, and codesign features that unlock new performance and efficiency points.
  • Prototype and evaluate new compilation and runtime techniques, including graph transformations, scheduling strategies, and memory/layout optimizations tailored to spatial processors.
  • Publish and present technical work on novel compilation approaches for inference and related spatial accelerators at top tier ML, compiler, and computer architecture venues.

Skills

C/C++
Rust
Data structures
Algorithms
Concurrency
LLVM/MLIR
Compiler development
Code generation
DL frameworks
ONNX
GPUs & heterogeneous compute
Profiling tooling
Collaboration

Education

MS or PhD in Computer Science, Electrical/Computer Engineering, or related field

Tools

LLVM
MLIR
ONNX

Job description

NVIDIA Corporation is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack, bridging large-scale systems, compilers, and deep learning. You will map neural network workloads onto NVIDIA platforms with high-performance runtime components and novel compilation techniques.

Join a team working at the intersection of software and hardware to extend NVIDIA’s compiler and runtime ecosystem, collaborating across disciplines to deliver scalable inference

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Inference & Compiler Engineer — Equity Options
Senior ML Inference & Compiler Engineer — Equity Options

NVIDIA Corporation • United States

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior ML Systems & Compiler Engineer (LPX) – Equity
Senior ML Systems & Compiler Engineer (LPX) – Equity

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 184,000 - 288,000
Equity
Benefits
Senior Machine Learning Applications and Compiler Engineer, LPX
Senior Machine Learning Applications and Compiler Engineer, LPX

NVIDIA Corporation • United States

Remote
USD 150,000 - 230,000
Senior Machine Learning Applications and Compiler Engineer, LPX
Senior Machine Learning Applications and Compiler Engineer, LPX

NVIDIA Corporation • United States

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior Machine Learning Applications and Compiler Engineer, LPX
Senior Machine Learning Applications and Compiler Engineer, LPX

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 184,000 - 288,000
Equity
Benefits
Senior GPU Compiler Optimization Engineer for AI/ML
Senior GPU Compiler Optimization Engineer for AI/ML

NVIDIA Corporation • Washington

Hybrid
USD 184,000 - 288,000
Equity
Benefits package
Career opportunities
Senior AI Inference Compiler Engineer | Equity
Senior AI Inference Compiler Engineer | Equity

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 242,000
Equity
Benefits
Senior Deep Learning Compiler Engineer — AI Inference
Senior Deep Learning Compiler Engineer — AI Inference

NVIDIA Corporation • United States

Remote
USD 152,000 - 242,000
Senior Compiler Engineer, AI Inference Platforms
Senior Compiler Engineer, AI Inference Platforms

NVIDIA Corporation • Texas

On-site
USD 152,000 - 241,500
Equity options
Generous benefits package
Senior Compiler Engineer - AI
Senior Compiler Engineer - AI

NVIDIA Corporation • Texas

On-site
USD 184,000 - 287,500
Equity
Generous benefits package