Senior ML Inference & Compiler Engineer

NVIDIA Corporation; Santa Clara (CA); On-site; USD 184,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation is seeking a Senior Machine Learning Applications and Compiler Engineer to advance end-to-end inference optimization across NVIDIA platforms. You will work at the intersection of large-scale systems, compilers, and deep learning to map neural network workloads onto cutting-edge hardware.

The role requires deep expertise in systems programming (C/C++/Rust), compiler development, and MLIR/LLVM, with experience in TensorFlow, PyTorch, and ONNX.

Qualifications

• MS or PhD in Computer Science, Electrical/Computer Engineering, or related field, or equivalent experience, with 5 years of relevant experience.
• Strong software engineering background with systems level programming (C/C++ and/or Rust) and CS fundamentals.
• Hands on experience with compiler or runtime development, including IR design, optimization passes, or code generation.
• Experience with LLVM and/or MLIR, including building custom passes, dialects, or integrations.
• Familiarity with TensorFlow and PyTorch, and portable graph formats such as ONNX.
• Understanding of parallel and heterogeneous compute architectures (GPUs, spatial accelerators).
• Excellent communication and collaboration skills across hardware, systems, and software teams.
• Ideal candidates have MLIR-based compiler or multilevel IR experience for graph-based DL workloads.

Responsibilities

• Build, develop, and maintain high-performance runtime and compiler components for end-to-end inference optimization.
• Define mappings of large-scale inference workloads onto NVIDIA systems.
• Extend and integrate with NVIDIA SW ecosystem, libraries, tooling, interfaces for model deployment.
• Benchmark, profile, and monitor performance to ensure efficient mappings to inference hardware.
• Collaborate with hardware architects to feedback software observations for future architectures.
• Prototype and evaluate new compilation and runtime techniques, including graph transformations and memory/layout optimizations.
• Publish and present technical work at ML, compiler, and architecture venues.

Skills

C/C++

Rust

Compiler development

MLIR/LLVM

Performance profiling

Concurrency

Education

MS or PhD in CS/EE or related

Tools

LLVM/MLIR

TensorFlow

PyTorch

ONNX

Job description

NVIDIA Corporation is seeking a Senior Machine Learning Applications and Compiler Engineer to advance end-to-end inference optimization across NVIDIA platforms. You will work at the intersection of large-scale systems, compilers, and deep learning to map neural network workloads onto cutting-edge hardware.

The role requires deep expertise in systems programming (C/C++/Rust), compiler development, and MLIR/LLVM, with experience in TensorFlow, PyTorch, and ONNX.