Senior Machine Learning Applications and Compiler Engineer, LPX

NVIDIA Corporation

Santa Clara (CA)

Hybrid

USD 184,000 - 288,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA Corporation in Santa Clara, CA, is seeking aSenior Machine Learning Applications and Compiler Engineer to advance end-to-end inference optimization across its LPX stack. You will map large-scale workloads to NVIDIA systems, develop high-performance runtimes, and extend the software ecosystem for seamless model deployment across platforms.

The role requires strong C/C++/Rust, LLVM/MLIR experience, and deep learning framework familiarity.

Qualifications

  • MS or PhD in Computer Science, Electrical/Computer Engineering, or related field, or equivalent experience.
  • 5+ years of relevant experience.
  • Strong software engineering background with systems level programming (C/C++ and/or Rust).
  • Hands on experience with compiler or runtime development, including IR design, optimization passes, or code generation.
  • Experience with LLVM and/or MLIR, including building custom passes, dialects, or integrations.
  • Familiarity with deep learning frameworks such as TensorFlow and PyTorch, and experience with ONNX.
  • Solid understanding of parallel and heterogeneous compute architectures, such as GPUs or spatial accelerators.
  • Strong analytical and debugging skills with profiling and benchmarking tools.
  • Excellent communication and collaboration skills across hardware, systems, and software teams.
  • Ideal candidates will have MLIR-based compiler experience or multilevel IR stacks.

Responsibilities

  • Build, develop, and maintain high-performance runtime and compiler components, focusing on end-to-end inference optimization.
  • Define and implement mappings of large-scale inference workloads onto NVIDIA systems.
  • Extend and integrate with NVIDIA’s SW ecosystem, libraries, tooling, and interfaces for deployment across platforms.
  • Benchmark, profile, and monitor performance to ensure efficient mappings of neural networks to inference hardware.
  • Collaborate with hardware architects to feedback software observations and co-design features.
  • Prototype and evaluate new compilation and runtime techniques, including graph transformations and memory optimizations.
  • Publish and present technical work at top-tier ML, compiler, and architecture venues.

Skills

C/C++/Rust
Compiler/runtime development
LLVM/MLIR
Deep learning frameworks
GPU/Spatial accelerators
Profiling/Debugging

Education

MS/PhD in CS/EE or related

Tools

LLVM
MLIR
ONNX

Job description

We are now looking for a Senior Machine Learning Applications and Compiler Engineer!

NVIDIA is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack. You will work at the intersection of large-scale systems, compilers, and deep learning, crafting how neural network workloads map onto future NVIDIA platforms. This is your chance to be part of something outstandingly innovative!

What you’ll be doing:
  • Build, develop, and maintain high-performance runtime and compiler components, focusing on end-to-end inference optimization.
  • Define and implement mappings of large-scale inference workloads onto NVIDIA’s systems.
  • Extend and integrate with NVIDIA’s SW ecosystem, contributing to libraries, tooling, and interfaces that enable seamless deployment of models across platforms.
  • Benchmark, profile, and monitor key performance and efficiency metrics to ensure the compiler generates efficient mappings of neural network graphs to our inference hardware.
  • Collaborate closely with hardware architects and design teams to feedback software observations, influence future architectures, and codesign features that unlock new performance and efficiency points.
  • Prototype and evaluate new compilation and runtime techniques, including graph transformations, scheduling strategies, and memory/layout optimizations tailored to spatial processors.
  • Publish and present technical work on novel compilation approaches for inference and related spatial accelerators at top tier ML, compiler, and computer architecture venues.
What we need to see:
  • MS or PhD in Computer Science, Electrical/Computer Engineering, or related field, or equivalent experience, with 5 years of relevant experience.
  • Strong software engineering background with proficiency in systems level programming (e.g., C/C++ and/or Rust) and solid CS fundamentals in data structures, algorithms, and concurrency.
  • Hands on experience with compiler or runtime development, including IR design, optimization passes, or code generation.
  • Experience with LLVM and/or MLIR, including building custom passes, dialects, or integrations.
  • Familiarity with deep learning frameworks such as TensorFlow and PyTorch, and experience working with portable graph formats such as ONNX.
  • Solid understanding of parallel and heterogeneous compute architectures, such as GPUs, spatial accelerators, or other domain specific processors.
  • Strong analytical and debugging skills, with experience using profiling, tracing, and benchmarking tools to drive performance improvements.
  • Excellent communication and collaboration skills, with the ability to work across hardware, systems, and software teams.
  • Ideal candidates will have direct experience with MLIR based compilers or other multilevel IR stacks, especially in the context of graph based deep learning workloads.
Ways to stand out from the crowd:
  • Prior work on spatial or dataflow architectures, including static scheduling, pipeline parallelism, or tensor parallelism at scale.
  • Contributions to opensource ML frameworks, compilers, or runtime systems, particularly in areas related to performance or scalability.
  • Demonstrated research impact, such as publications or presentations at conferences like PLDI, CGO, ASPLOS, ISCA, MICRO, MLSys, NeurIPS, or similar.
  • Experience with large-scale AI distributed inference or training systems, including performance modeling and capacity planning for multi rack deployments.

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until July 17, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Machine Learning Applications and Compiler Engineer, LPX
Senior Machine Learning Applications and Compiler Engineer, LPX

NVIDIA Corporation • United States

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior Compiler Optimization Engineer - MLIR
Senior Compiler Optimization Engineer - MLIR

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Senior Compiler Optimization Engineer - MLIR
Senior Compiler Optimization Engineer - MLIR

NVIDIA Corporation • Redmond (WA)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior AI Compiler Engineer — CUDA/MLIR Expert (Equity)
Senior AI Compiler Engineer — CUDA/MLIR Expert (Equity)

NVIDIA Corporation • California

On-site
USD 152,000 - 241,500
Senior LLVM Compiler Engineer
Senior LLVM Compiler Engineer

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Comprehensive benefits
Senior Compiler Engineer, AI Inference Platforms
Senior Compiler Engineer, AI Inference Platforms

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 242,000
Equity
Benefits
Senior AI Compiler Engineer, Algorithms and Code-Generation
Senior AI Compiler Engineer, Algorithms and Code-Generation

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 242,000
Senior Software Engineer, GPU Code Generation for Machine Learning Inference
Senior Software Engineer, GPU Code Generation for Machine Learning Inference

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 170,000 - 260,000
Equity
Senior Machine Learning Applications and Compiler Engineer, LPX
Senior Machine Learning Applications and Compiler Engineer, LPX

NVIDIA Corporation • United States

Remote
USD 150,000 - 230,000
Senior Compiler Engineer - AI
Senior Compiler Engineer - AI

NVIDIA Corporation • Austin (TX)

On-site
USD 184,000 - 288,000