Compiler Engineer

Oho Group; Toronto; On-site; CAD 120,000 - 180,000; Full time

Job summary

Oho Group is seeking a hands-on compiler engineer to join a well-funded startup building a new ML compiler stack for high-performance accelerators. You will work in the middle of the compiler, transforming models into efficient programs for a new accelerator architecture.

You will own optimizations that affect workload performance, design graph and IR-level optimizations, develop passes, and lower workloads through MLIR-based pipelines while collaborating with architecture and runtime teams.

Qualifications

• Strong C++ and compiler engineering experience.
• Hands-on knowledge of LLVM, MLIR or comparable compiler infrastructure.
• Experience with graph optimization, IR transformations or lowering.
• Ability to reason across compiler decisions and hardware behavior.

Responsibilities

• Design graph and IR-level compiler optimizations.
• Develop transformation, fusion, scheduling and memory-planning passes.
• Lower workloads through MLIR-based compilation pipelines.
• Optimize data movement, parallelism and accelerator utilization.
• Analyze generated programs and eliminate performance bottlenecks.
• Collaborate with architecture, code-generation and runtime engineers.

Skills

C++

LLVM/MLIR

Graph optimization

IR transformations

Hardware awareness

PyTorch/Triton

Job description

We're working with a well-funded start-up building a new compiler and software stack for high-performance accelerated computing.

This role sits in the middle of the compiler, transforming models and computational graphs into efficient programs for a new accelerator architecture. You'll own optimizations that materially affect workload performance rather than maintaining an established toolchain.

What you'll work on

• Design graph and IR-level compiler optimizations
• Develop transformation, fusion, scheduling and memory-planning passes
• Lower workloads through MLIR-based compilation pipelines
• Optimize data movement, parallelism and accelerator utilization
• Analyze generated programs and eliminate performance bottlenecks
• Collaborate with architecture, code-generation and runtime engineers
• Help define how ML workloads should map onto the underlying hardware

What we're looking for

• Strong C++ and compiler engineering experience
• Hands-on knowledge of LLVM, MLIR or comparable compiler infrastructure
• Experience with graph optimization, IR transformations or lowering
• Ability to reason across compiler decisions and hardware behavior

Experience with PyTorch compilation, Triton, GPUs, AI accelerators, memory optimization or hardware/software co-design would be particularly valuable.

This is an opportunity to shape a compiler while both the software stack and target architecture are still evolving.