Director, AI Inference Platform Engineering

SambaNovaSystems; San Jose (CA); On-site; USD 245,000 - 325,000; Full time

Benefits offered by this job

Health benefits (premium covered)

Headspace

Gympass+ membership

Job summary

SambaNova Systems is seeking an Engineering Director for the SambaStack team. You will lead a high-performing engineering group, drive architectural initiatives, and contribute technically on critical platform work across AI inference and enterprise-grade infrastructure.

You will hire, mentor, and align teams with product goals, ML, QA, and DevOps. This role blends leadership with hands-on engineering across backend systems at scale in cloud and on‑prem environments.

Qualifications

• 12+ years of software engineering experience with leadership experience.
• Hands-on contributor with strong backend skills and architectural capabilities.
• Experience with AI inference serving and production-scale workloads.
• Proven ability to drive engineering excellence and communicate with senior leadership.

Responsibilities

• Lead, grow, and inspire a software team with a focus on technical excellence.
• Own hiring for the team and build a diverse, high-performing engineering organization.
• Guide engineers through regular feedback and clear growth plans.
• Set goals, track progress, and remove blockers to maintain execution.
• Collaborate with Product, ML, QA, and DevOps leadership to align priorities.

Skills

Python

Go

Rust

AI inference

Leadership

Communication

Engineering management

Tools

Kubernetes

Helm Charts

Job description

SambaNova Systems is seeking an Engineering Director for the SambaStack team. You will lead a high-performing engineering group, drive architectural initiatives, and contribute technically on critical platform work across AI inference and enterprise-grade infrastructure.

You will hire, mentor, and align teams with product goals, ML, QA, and DevOps. This role blends leadership with hands-on engineering across backend systems at scale in cloud and on‑prem environments.