ML Compiler Engineer - Frontend, Staff

d-Matrix; Toronto; Hybrid; CAD 90,000 - 150,000; Full time

Job summary

An innovative company is seeking a Senior Staff ML Compiler Engineer to drive advancements in machine learning compiler technology. In this pivotal role, you will design and optimize high-level ML representations, collaborating with a talented team to enhance performance and execution efficiency. Your expertise in modern C++, LLVM, and ML frameworks like PyTorch and TensorFlow will be crucial as you tackle complex challenges and contribute to cutting-edge solutions. Join a dynamic environment where your contributions will help shape the future of AI technology and drive impactful results in a fast-paced startup atmosphere.

Qualifications

• 10+ years of industry experience in compiler development.
• Proficiency in modern C++ and experience with LLVM/MLIR.
• Understanding of graph-level optimizations in ML compilers.

Responsibilities

• Design and optimize high-level ML representations for compilation.
• Collaborate with ML framework developers and hardware architects.
• Implement model partitioning techniques for distributed hardware.

Skills

C++ (C++14/17/20)

Compiler Development

LLVM

MLIR

PyTorch

TensorFlow

ONNX

Graph-Level Optimizations

Model Partitioning Strategies

Education

Bachelor's Degree in Computer Science

Master's Degree in Computer Science

PhD in Computer Science

Tools

LLVM

MLIR

PyTorch

TensorFlow

ONNX

Job description

Join to apply for the ML Compiler Engineer - Frontend, Staff role at d-Matrix.

At d-Matrix, we focus on unleashing the potential of generative AI to transform technology. We are leaders in software and hardware innovation, emphasizing a culture of respect, collaboration, humility, and direct communication. Our inclusive team values diverse perspectives to develop better solutions. If you are passionate about tackling challenges and driven by execution, join us to shape the endless possibilities of AI.

Location: Remote/Hybrid (onsite at our Toronto, Ontario, Canada office 2 days/week)

Role: Senior Staff ML Compiler Engineer

What You Will Do

The d-Matrix compiler team seeks exceptional candidates to develop the front-end of our machine learning compiler. Responsibilities include designing, optimizing, and lowering high-level ML representations to intermediate forms suitable for further compilation. Key contributions include:

• High-level IR transformations (graph optimization, operator fusion, canonicalization)
• Dialect and IR design for ML frameworks
• Lowering ML models from frameworks like PyTorch, TensorFlow, ONNX to compiler IRs such as MLIR and LLVM
• Performance optimization for compute graphs, including operator specialization, fusion, and memory layout transformations
• Model partitioning techniques, such as graph-based parallelism, automatic partitioning with GSPMD, and placement-aware optimizations for distributed hardware

The successful candidate will collaborate with ML framework developers, hardware architects, and performance engineers to ensure efficient model execution.

What You Will Bring

• Bachelor’s degree in computer science or related field + 10+ years of industry experience (or MS + 8+ years, PhD + 3+ years)
• Proficiency in modern C++ (C++14/17/20) and compiler development
• Experience with LLVM, MLIR, or similar compiler infrastructures
• Experience with ML frameworks like PyTorch, TensorFlow, ONNX
• Understanding of graph-level optimizations and IR transformations in ML compilers
• Experience with model partitioning strategies such as GSPMD, sharding, distributed execution

Preferred Qualifications

• Algorithm design from concept to implementation
• Experience with open-source ML compiler projects (Torch-MLIR, IREE, XLA, TVM)
• Knowledge of automatic differentiation, shape inference, type propagation
• Experience optimizing distributed execution on accelerators (GPUs, TPUs, custom hardware)
• Passion for working in a fast-paced startup environment

Equal Opportunity Employment Policy

d-Matrix is committed to fostering an inclusive environment and is an equal opportunity employer. We value humility, kindness, dedication, and a willingness to learn and embrace challenges. We do not accept external agency resumes; please apply directly through our official channels.

Additional Details

• Seniority level: Mid-Senior level
• Employment type: Full-time
• Job function: Engineering and IT
• Industry: Semiconductor Manufacturing