Director, AI Inference & Model Scaling

Cerebras Systems; Sunnyvale (CA); Hybrid; USD 260,000 - 340,000; Full time

Job summary

Cerebras Systems in Sunnyvale, CA is seeking an experienced engineering leader to build and scale the Inference Model Scaling organization. You will define the technical vision, strategy, and execution roadmap for a globally distributed team responsible for enabling foundation models on Cerebras hardware.

You will lead ML model compilation and optimization and develop high-performance kernels, partnering across compiler, runtime, cloud, hardware, product management, and AI research to advance

Qualifications

• 12+ years building compiler, ML systems, or infrastructure software.
• 5+ years leading engineering teams.
• Deep experience with modern compiler infrastructure (LLVM, MLIR, XLA, TVM, Torch FX, or similar).
• Strong understanding of graph compilation and optimization.
• Experience with Python and C++.
• Experience delivering production-quality software.
• Strong communication and cross-functional leadership skills.

Responsibilities

• Define the technical roadmap and strategy for the team.
• Establish technical direction across multiple teams and engineering leaders.
• Lead design reviews and establish engineering standards.
• Drive support for emerging LLM architectures and inference workloads.
• Hire, mentor, and grow a high-performing engineering team.
• Develop future technical leaders and managers.
• Drive organizational planning, headcount strategy, and investment priorities.
• Foster a strong engineering culture focused on execution, quality, and innovation.
• Scale engineering processes while maintaining execution velocity.
• Partner with Cloud Platform, ML, and Hardware teams in planning and delivering for end-to-end service enablement in Cloud and On-Premise settings.
• Work with Product Management to prioritize model enablement and customer needs.
• Collaborate closely with customers and solution architects on new model bring-up.
• Influence future hardware/software co-design through ML model enablement and optimization insights.
• Own planning, prioritization, and execution across multiple concurrent initiatives.
• Balance rapid model support with long-term ML Compiler architecture.
• Drive predictable delivery for strategic customer commitments.

Skills

Compiler infra

ML systems

Team leadership

LLVM/MLIR/XLA

Graph compilation

Python

C++

Production software

Cross-functional leadership

Education

BS/MS/PhD in CS/CE or related

Tools

LLVM

MLIR

XLA

TVM

Torch FX

Job description

Cerebras Systems in Sunnyvale, CA is seeking an experienced engineering leader to build and scale the Inference Model Scaling organization. You will define the technical vision, strategy, and execution roadmap for a globally distributed team responsible for enabling foundation models on Cerebras hardware.

You will lead ML model compilation and optimization and develop high-performance kernels, partnering across compiler, runtime, cloud, hardware, product management, and AI research to advance