Staff Compiler Engineer for AI Systems & Heterogeneous HW

The Consensus; San Francisco, Northern (CA, KY); Hybrid; USD 180,000 - 230,000; Full time

Job summary

Gimlet is hiring an experienced systems/compiler infra engineer to shape the execution stack for diverse AI workloads. You will work across compiler infrastructure, runtime systems, scheduling, memory movement, kernel orchestration, and serving optimization to run workloads efficiently in production.

We expect strong C++ and Python skills, a solid foundation in compiler theory, and a degree in a relevant field.

Qualifications

• Bachelor's degree in a relevant field.
• Strong systems and performance engineering fundamentals.
• Experience building compiler systems or execution/runtime infrastructure.
• Experience implementing IR transformations, compiler passes, or code generation systems.

Responsibilities

• Build compiler and runtime infrastructure for low latency and high throughput in AI inference workloads.
• Design execution strategies to partition and coordinate workloads across heterogeneous hardware.
• Develop compiler optimizations spanning IR transformations, scheduling, memory movement, and kernel orchestration.
• Enable new model architectures and serving techniques for production efficiency.
• Influence the architecture of an execution platform for future AI workloads.

Skills

Systems engineering

Compiler experience

IR transformations

Scheduling/Execution

C++

Python

Education

Bachelor's degree in a relevant field

Job description

Gimlet is hiring an experienced systems/compiler infra engineer to shape the execution stack for diverse AI workloads. You will work across compiler infrastructure, runtime systems, scheduling, memory movement, kernel orchestration, and serving optimization to run workloads efficiently in production.

We expect strong C++ and Python skills, a solid foundation in compiler theory, and a degree in a relevant field.