Senior Machine Learning Applications and Compiler Engineer, LPX

NVIDIA Corporation; Cambridge; Hybrid; GBP 95,000 - 135,000; Full time

Job summary

NVIDIA Corporation seeks engineers to develop algorithms and optimizations for LPX inference and compiler stack. You will map neural network workloads onto NVIDIA platforms, integrating with NVIDIA's software ecosystem and libraries.

Ideal candidates have strong systems programming skills (C/C++/Rust), experience with LLVM/MLIR, and familiarity with TensorFlow, PyTorch, and ONNX. Hybrid work model in Cambridge, UK is offered.

Qualifications

• MS or PhD in Computer Science, Electrical/Computer Engineering, or related field, or equivalent experience.
• 6 years of relevant experience.
• Strong software engineering with systems-level programming (C/C++, Rust).
• Experience with compiler/runtime development, IR design, optimization passes, or code generation.
• Experience with LLVM and/or MLIR, including building passes, dialects, or integrations.
• Familiarity with TensorFlow, PyTorch, and ONNX for graph formats.

Responsibilities

• Build and maintain high-performance runtime and compiler components for end-to-end inference optimization.
• Define mappings of large-scale inference workloads onto NVIDIA systems.
• Extend and integrate with NVIDIA SW ecosystem through libraries, tooling, and interfaces.
• Benchmark, profile, and optimize mappings to ensure efficient neural network graphs mapping to hardware.
• Collaborate with hardware architects to feedback software observations and influence future architectures.
• Prototype and evaluate new compilation/runtime techniques, including graph transformations and memory/layout optimizations for spatial processors.
• Publish and present work on compilation approaches at ML/CC venues.

Skills

C/C++

Rust

LLVM/MLIR

TensorFlow

PyTorch

ONNX

Concurrency

Profiling

System programming

Education

MS or PhD in CS/EE or related field

Tools

LLVM

MLIR

ONNX

Job description

NVIDIA is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack. You will work at the intersection of large-scale systems, compilers, and deep learning, crafting how neural network workloads map onto future NVIDIA platforms. This is your chance to be part of something outstandingly innovative!

What you’ll be doing:

• Build, develop, and maintain high-performance runtime and compiler components, focusing on end-to-end inference optimization.
• Define and implement mappings of large-scale inference workloads onto NVIDIA’s systems.
• Extend and integrate with NVIDIA’s SW ecosystem, contributing to libraries, tooling, and interfaces that enable seamless deployment of models across platforms.
• Benchmark, profile, and monitor key performance and efficiency metrics to ensure the compiler generates efficient mappings of neural network graphs to our inference hardware.
• Collaborate closely with hardware architects and design teams to feedback software observations, influence future architectures, and codesign features that unlock new performance and efficiency points.
• Prototype and evaluate new compilation and runtime techniques, including graph transformations, scheduling strategies, and memory/layout optimizations tailored to spatial processors.
• Publish and present technical work on novel compilation approaches for inference and related spatial accelerators at top tier ML, compiler, and computer architecture venues.

What we need to see:

• MS or PhD in Computer Science, Electrical/Computer Engineering, or related field, or equivalent experience, with 6 years of relevant experience.
• Strong software engineering background with proficiency in systems level programming (e.g., C/C++ and/or Rust) and solid CS fundamentals in data structures, algorithms, and concurrency.
• Hands on experience with compiler or runtime development, including IR design, optimization passes, or code generation.
• Experience with LLVM and/or MLIR, including building custom passes, dialects, or integrations.
• Familiarity with deep learning frameworks such as TensorFlow and PyTorch, and experience working with portable graph formats such as ONNX.
• Solid understanding of parallel and heterogeneous compute architectures, such as GPUs, spatial accelerators, or other domain specific processors.
• Strong analytical and debugging skills, with experience using profiling, tracing, and benchmarking tools to drive performance improvements.
• Excellent communication and collaboration skills, with the ability to work across hardware, systems, and software teams.

Ideal candidates will have direct experience with MLIR based compilers or other multilevel IR stacks, especially in the context of graph based deep learning workloads.

Ways to stand out from the crowd:

• Prior work on spatial or dataflow architectures, including static scheduling, pipeline parallelism, or tensor parallelism at scale.
• Contributions to opensource ML frameworks, compilers, or runtime systems, particularly in areas related to performance or scalability.
• Demonstrated research impact, such as publications or presentations at conferences like PLDI, CGO, ASPLOS, ISCA, MICRO, MLSys, NeurIPS, or similar.
• Experience with large-scale AI distributed inference or training systems, including performance modeling and capacity planning for multi rack deployments.

#LI-Hybrid NVIDIA pioneered accelerated computing.

Today, our AI infrastructure powers global intelligence, transforming every industry.

Learn more about NVIDIA.