Runtime Engineer, Multi-Target AI Systems

Lemurian Labs; Santa Clara (CA); Hybrid; USD 150,000 - 190,000; Full time

Benefits offered by this job

Equity

Medical/Dental/Vision coverage

Retirement savings plan

Wellness benefits

Job summary

Lemurian Labs is seeking a Runtime Engineer to design and build a multi-target runtime at the heart of our AI compiler stack. This role focuses on executing optimized code across diverse hardware targets, combining low-level parallelization with kernel scheduling and performance analysis.

You will work closely with compiler and product teams to push the boundaries of AI hardware capability, delivering scalable runtime solutions for next-generation platforms.

Qualifications

• BS degree in CS/CE or equivalent practical experience.
• 4+ years of experience with compilers or runtime systems.
• Deep understanding of asynchronous and concurrent programming.
• 4+ years of experience with C/C++ (C++14 or newer).
• Knowledge of hardware architecture and memory hierarchies.

Responsibilities

• Design, develop, maintain multi-target runtime.
• Apply parallelization and partitioning to automate kernel generation.
• Rapidly prototype and data-drive exploration of new runtime ideas.
• Benchmark and analyze outputs on target hardware.
• Build tools to collect and analyze performance bottlenecks.
• Collaborate with product teams to address ML engineer needs.

Skills

Compiler/Runtimes

C/C++

Async/Concurrent

Parallelization

Kernel scheduling

Education

BS in CS/CE or equivalent

MS/PhD preferred

Tools

CUDA

ROCm

GPU programming

Linux kernel development

Job description

Lemurian Labs is seeking a Runtime Engineer to design and build a multi-target runtime at the heart of our AI compiler stack. This role focuses on executing optimized code across diverse hardware targets, combining low-level parallelization with kernel scheduling and performance analysis.

You will work closely with compiler and product teams to push the boundaries of AI hardware capability, delivering scalable runtime solutions for next-generation platforms.