ML Compiler Engineer - Frontend, Staff

d-Matrix; Ontario; Hybrid; CAD 80,000 - 100,000; Full time

Job summary

An innovative firm is seeking a Senior Staff ML Compiler Engineer to join their dynamic team. This role involves developing the front-end of a machine learning compiler, focusing on optimizing high-level representations and ensuring efficient model execution. The ideal candidate will have extensive experience in compiler development and modern C++, alongside a passion for tackling complex challenges in a fast-paced environment. Join a collaborative team that values diverse perspectives and is committed to pushing the boundaries of technology in the AI space. If you are ready to make an impact in a transformative industry, this opportunity is for you.

Qualifications

• 10+ years of experience in relevant industry or 8+ with MS, 3+ with PhD.
• Strong proficiency in modern C++ and compiler development.

Responsibilities

• Design and optimize high-level machine learning representations.
• Work on graph optimization, operator fusion, and ML model transformations.

Skills

C++

Compiler Development

Machine Learning Frameworks

Graph-level Optimizations

Model Partitioning Strategies

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science

PhD in Computer Science

Tools

LLVM

MLIR

PyTorch

TensorFlow

ONNX

Job description

At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.

We value humility and believe in direct communication. Our team is inclusive, and our differing perspectives allow for better solutions. We are seeking individuals passionate about tackling challenges and are driven by execution. Ready to come find your playground? Together, we can help shape the endless possibilities of AI.

Location: Remote/Hybrid (working onsite at our Toronto, Ontario, Canada office 2 days per week)

Role: Senior Staff ML Compiler Engineer

What You Will Do:

The d-Matrix compiler team is looking for exceptional candidates to help develop the front-end of our machine learning compiler. The successful candidate will work on designing, optimizing, and lowering high-level machine learning representations to intermediate representations suitable for further compilation.

We are particularly interested in candidates who can contribute to:

1. High-level IR transformations (e.g., graph optimization, operator fusion, canonicalization).
2. Dialect and IR design for machine learning frameworks.
3. Lowering and transformation of ML models from frameworks such as PyTorch, TensorFlow, and ONNX to compiler IRs such as MLIR and LLVM.
4. Performance optimization for compute graphs, including operator specialization, fusion, and memory layout transformations.
5. Model partitioning techniques, including:
1. Graph-based parallelism strategies (e.g., pipelined model parallelism, tensor parallelism, data parallelism).
2. Automatic partitioning of large models across multiple devices using techniques like GSPMD (Generalized SPMD Partitioning).
3. Placement-aware optimizations to minimize communication overhead and improve execution efficiency on distributed hardware.

The successful candidate will join a team of experienced compiler engineers and work closely with ML framework developers, hardware architects, and performance engineers to ensure efficient model execution.

What You Will Bring:

• Minimum Qualifications:
  Bachelor's degree in computer science or a related field with 10+ years of relevant industry experience (or MS with 8+ years of experience or PhD with 3+ years of experience).
• Strong proficiency in modern C++ (C++14/17/20) and compiler development.
• Experience with modern compiler infrastructures such as LLVM, MLIR, or equivalent frameworks.
• Experience with machine learning frameworks (e.g., PyTorch, TensorFlow, ONNX).
• Solid understanding of graph-level optimizations and IR transformations in ML compilers.
• Experience with model partitioning strategies such as GSPMD, Sharding, and Distributed Execution.

Preferred Qualifications:

• Algorithm design experience, from conceptualization to implementation.
• Experience with Open-Source ML compiler projects, such as Torch-MLIR, IREE, XLA, or TVM.
• Experience with automatic differentiation, shape inference, and type propagation in ML compilers.
• Experience optimizing distributed execution of large models on accelerators (e.g., GPUs, TPUs, custom AI hardware).
• Passion for working in a fast-paced and dynamic startup environment.

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.