AI Compiler Engineer for Custom Silicon & MLIR (Unlimited PTO)

River AI

Palo Alto (CA)

On-site

USD 200,000 - 420,000

Full time

14 days+
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Health, dental, and vision benefits
Unlimited PTO
Relocation support

Job summary

River AI in Palo Alto or Austin is seeking an exceptional AI compiler engineer to bridge PyTorch graphs to our custom ISA. You will own kernel algorithms, IRs, and even ISA tweaks, collaborating with researchers and silicon architects.

You will design MLIR-based lowering passes, implement backends for our hardware, and optimize performance across the stack. The role requires a strong CS background and teamwork.

Qualifications

  • Bachelor's degree in Electrical Engineering or Computer Engineering with 5+ years of relevant industry experience.
  • Deep hands-on experience with MLIR or XLA for deep learning workloads.
  • Expert-level understanding of PyTorch internals and integration with external backends.
  • Proficiency in modern C/C++ for high-performance compiler infrastructure.
  • Strong knowledge of computer architecture and various chip programming models.

Responsibilities

  • Lower PyTorch models into custom hardware using MLIR dialects and LLVM-based tooling.
  • Develop and maintain the backend toolchain for our silicon including scheduling and register allocation.
  • Design tiling and fusion strategies to maximize bandwidth and minimize memory movement.
  • Integrate high-performance kernels (Triton/CUDA-like) into the compiler flow.
  • Collaborate with RTL, architecture, and performance teams to optimize ISA and compiler outcomes.

Skills

PyTorch internals
Collaborative mindset
Advanced computer architecture

Education

Bachelor’s degree in Electrical Engineering or Computer Engineering

Tools

MLIR
XLA
C/C++
LLVM-based toolchain

Job description

River AI in Palo Alto or Austin is seeking an exceptional AI compiler engineer to bridge PyTorch graphs to our custom ISA. You will own kernel algorithms, IRs, and even ISA tweaks, collaborating with researchers and silicon architects.

You will design MLIR-based lowering passes, implement backends for our hardware, and optimize performance across the stack. The role requires a strong CS background and teamwork.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Compiler Engineer, Hardware
Compiler Engineer, Hardware

River AI • Palo Alto (CA)

On-site
USD 200,000 - 420,000
Health, dental, and vision benefits
Unlimited PTO
Relocation support
Principal Compiler Engineer – MLIR & AI Silicon
Principal Compiler Engineer – MLIR & AI Silicon

Ericsson GmbH • Austin (TX), Northern (KY)

Hybrid
USD 150,000 - 230,000
Performance Kernel Engineer for Custom AI Silicon
Performance Kernel Engineer for Custom AI Silicon

River AI • Palo Alto (CA)

On-site
USD 200,000 - 420,000
Health, dental, and vision benefits
Unlimited PTO
Relocation support
MLIR Compiler Engineer for AI Hardware Backend Flexible PTO
MLIR Compiler Engineer for AI Hardware Backend Flexible PTO

Persimmons • San Jose (CA)

On-site
USD 120,000 - 150,000
Competitive salary and benefits package
Flexible PTO
401k
Software Engineer, LLVM Compiler
Software Engineer, LLVM Compiler

Meta • Bellevue (WA), Menlo Park (CA), New York (NY)

On-site
USD 180,000 - 240,000
MLIR Compiler Engineer for AI Hardware Backend Flexible PTO
MLIR Compiler Engineer for AI Hardware Backend Flexible PTO

Persimmons Inc. • San Jose (CA)

On-site
USD 180,000 - 280,000
Competitive salary and benefits
Flexible PTO
401k
Compiler Engineer
Compiler Engineer

Oho Group • San Francisco (CA)

On-site
USD 180,000 - 260,000
AI Compiler Engineer: Graph Optimizations & HW/SW Co-Design
AI Compiler Engineer: Graph Optimizations & HW/SW Co-Design

Ampere Computing • Santa Clara (CA)

Hybrid
USD 195,000 - 292,000
Health insurance
401K retirement plan
Unlimited flextime
+1
AI Engineer for AI-Driven Chip Design Tools
AI Engineer for AI-Driven Chip Design Tools

Silimate (YC S23) • Mountain View (CA)

On-site
USD 180,000 - 260,000
Salary + equity
Health/vision/dental/401k
Team meals
Lead AI Graph Compiler Engineer
Lead AI Graph Compiler Engineer

EnCharge AI • United States

Remote
USD 190,000 - 255,000