Accelerator Compiler Engineer - MLIR & GPU Optimizations

Oho Group

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

3 days ago
Be an early applicant
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

Oho Group in San Francisco is seeking a seasoned compiler engineer to own optimizations that transform models and graphs into efficient programs for a new accelerator architecture. You will shape the compiler mid-stack, focusing on performance-critical paths rather than maintaining an existing toolchain.

You’ll work across MLIR-based pipelines, optimize data movement, parallelism and hardware utilization, and collaborate with architecture, code-generation and runtime engineers to map ML

Qualifications

  • Strong C++ and compiler engineering experience.
  • Hands-on knowledge of LLVM, MLIR or comparable compiler infrastructure
  • Experience with graph optimization, IR transformations or lowering
  • Ability to reason across compiler decisions and hardware behavior
  • Experience with PyTorch compilation, Triton, GPUs, AI accelerators, memory optimization or hardware/software co-design would be particularly valuable.

Responsibilities

  • Design graph and IR-level compiler optimizations
  • Develop transformation, fusion, scheduling and memory-planning passes
  • Lower workloads through MLIR-based compilation pipelines
  • Optimize data movement, parallelism and accelerator utilization
  • Analyze generated programs and eliminate performance bottlenecks
  • Collaborate with architecture, code-generation and runtime engineers
  • Help define how ML workloads should map onto the underlying hardware

Skills

C++
LLVM/MLIR
Graph optimization
IR transformations
Lowering
PyTorch compilation
Triton
GPUs

Job description

Oho Group in San Francisco is seeking a seasoned compiler engineer to own optimizations that transform models and graphs into efficient programs for a new accelerator architecture. You will shape the compiler mid-stack, focusing on performance-critical paths rather than maintaining an existing toolchain.

You’ll work across MLIR-based pipelines, optimize data movement, parallelism and hardware utilization, and collaborate with architecture, code-generation and runtime engineers to map ML

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Compiler Engineer
Compiler Engineer

Oho Group • San Francisco (CA)

On-site
USD 180,000 - 260,000
Senior GPU Compiler Engineer — End-to-End MLIR & CUDA
Senior GPU Compiler Engineer — End-to-End MLIR & CUDA

San Francisco Tensor Company • San Francisco (CA)

On-site
USD 285,000 - 315,000
Relocation assistance
Office in San Francisco
AI Compiler Engineer: ML Accelerator Optimizer
AI Compiler Engineer: ML Accelerator Optimizer

Black Sesame Technologies Inc • San Jose (CA)

On-site
USD 100,000 - 130,000
Senior GPU Compiler Optimizer & MLIR/LLVM Innovator
Senior GPU Compiler Optimizer & MLIR/LLVM Innovator

NVIDIA • Redmond (WA)

On-site
USD 184,000 - 288,000
Equity
Benefits
ML Compiler Architect for Photonic AI Accelerator
ML Compiler Architect for Photonic AI Accelerator

Neurophos Inc. • Town of Texas (WI), Northern (KY)

Hybrid
USD 140,000 - 210,000
Health insurance
Unlimited PTO
401(k) matching & stock options
+1
Senior AI Compiler Engineer (MLIR) — Equity & Impact
Senior AI Compiler Engineer (MLIR) — Equity & Impact

NVIDIA • California (MO)

On-site
USD 152,000 - 288,000
Senior Staff Compiler Engineer - MLIR/LLVM for GPUs
Senior Staff Compiler Engineer - MLIR/LLVM for GPUs

AMD • San Jose (CA)

Hybrid
USD 180,000 - 240,000
Senior Compiler Lead for ML Acceleration
Senior Compiler Lead for ML Acceleration

Socket.dev • San Jose (CA)

Hybrid
USD 180,000 - 240,000
Senior GPU Compiler Optimization Engineer for AI/ML
Senior GPU Compiler Optimization Engineer for AI/ML

NVIDIA Corporation • Northern (KY)

Hybrid
USD 184,000 - 288,000
Equity
Benefits package
Career opportunities
ML Accelerators Software Engineer – Inference & Compiler
ML Accelerators Software Engineer – Inference & Compiler

Google Inc. • Mountain View (CA), San Francisco (CA)

On-site
USD 174,000 - 252,000