Senior Multi-Target Runtime Engineer for AI Stack

Lemurian Labs Inc.

Santa Clara (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Medical/Dental/Vision
Retirement savings plan
Wellness benefits

Job summary

Lemurian Labs Inc. in Santa Clara, CA, is hiring a Runtime Engineer to design and build the multi-target runtime at the heart of our AI compiler stack.

This is a systems role focused on low-level parallelization, kernel scheduling, performance analysis, and cross-team collaboration to push AI hardware boundaries. You’ll work with compiler and product teams to optimize execution across diverse targets.

Qualifications

  • BS degree in Computer Science, Computer Engineering, or equivalent practical experience.
  • 4+ years of experience with compilers or runtime systems.
  • Deep understanding of asynchronous and concurrent programming.
  • 4+ years of experience with C/C++ (C++14 or newer).
  • Understanding of hardware architecture and memory hierarchies.
  • Knowledge of OS kernel or hypervisor development.

Responsibilities

  • Design, develop, maintain, and improve our multi-target runtime.
  • Apply parallelization and partitioning techniques to optimize kernel execution paths.
  • Prototype and data-drive exploration of new runtime ideas.
  • Benchmark and analyze compiler outputs on target hardware.
  • Build tools to collect and analyze performance bottlenecks.
  • Collaborate with product teams to meet ML engineer needs and evolve runtime architecture.

Skills

Compiler construction
Runtime systems
Asynchronous programming
C/C++
Parallelization
Kernel scheduling
Performance analysis

Education

BS in CS/CE
Master's/PhD (preferred)

Tools

CUDA
ROCm

Job description

Lemurian Labs Inc. in Santa Clara, CA, is hiring a Runtime Engineer to design and build the multi-target runtime at the heart of our AI compiler stack.

This is a systems role focused on low-level parallelization, kernel scheduling, performance analysis, and cross-team collaboration to push AI hardware boundaries. You’ll work with compiler and product teams to optimize execution across diverse targets.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Runtime Engineer
Runtime Engineer

Lemurian Labs Inc. • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Equity
Medical/Dental/Vision
Retirement savings plan
+1
Senior AI Compiler Codegen Engineer
Senior AI Compiler Codegen Engineer

Lemurian Labs Inc. • Santa Clara (CA)

On-site
USD 170,000 - 230,000
Equity
Medical/dental/vision
Retirement savings plan
+1
Lead AI Compiler & Runtime Systems Engineer
Lead AI Compiler & Runtime Systems Engineer

Xcelerium • Irvine (CA)

Hybrid
USD 190,000 - 260,000
Comprehensive medical, dental, and vision coverage
401(k) plan
Paid time off (PTO)
+1
Low-Level Runtime Engineer for AI Accelerator Silicon
Low-Level Runtime Engineer for AI Accelerator Silicon

OpenAI • United States

Remote
USD 160,000 - 220,000
Runtime Engineer: High-Performance AI Compute
Runtime Engineer: High-Performance AI Compute

SambaNova • Palo Alto (CA)

On-site
USD 110,000 - 150,000
95% premium coverage for employee medical insurance
Dental and Vision insurance
Health Savings Account with employer contribution
+2
AI Accelerator Runtime Systems Engineer
AI Accelerator Runtime Systems Engineer

Triwill Group • United States

On-site
USD 180,000 - 240,000
Low-Level AI Accelerator Runtime Engineer
Low-Level AI Accelerator Runtime Engineer

AI Chopping Block • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
Senior AI Compiler & Runtime Architect
Senior AI Compiler & Runtime Architect

HTEC Group • Palo Alto (CA)

Hybrid
USD 200,000 - 350,000
Medical, dental and vision coverage
401(k) with Company match
Unlimited vacation
+3
Software Engineer, Model Runtime
Software Engineer, Model Runtime

OpenAI • United States

Remote
USD 180,000 - 230,000
Senior Software Engineer - AI Compiler & Runtime Infrastructure
Senior Software Engineer - AI Compiler & Runtime Infrastructure

Xcelerium • Irvine (CA)

On-site
USD 190,000 - 260,000
Comprehensive medical, dental, and vision coverage
Flexible hybrid work model
401(k) plan
+2