Senior AI Systems Performance Engineer

Doist; San Jose (CA); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Health insurance

HSA contributions

Dental

Vision

Disability insurance

Life insurance

FSA

Headspace

Job summary

SambaNova Systems in San Jose is seeking a talented ML performance engineer to optimize and scale state-of-the-art foundation models on our reconfigurable dataflow platform. You will work hands-on with leading models to push throughput, latency, and efficiency, bridging gaps between compiler, runtime, and hardware teams to deliver world-record AI inference performance.

The role requires a strong foundation in deep learning and systems optimization, 3+ years of experience, and proficiency in

Qualifications

• Bachelor's or higher in computer science, electrical engineering, or a related field (e.g., applied mathematics, physics, or statistics).
• 3+ years of experience in Deep learning model development and performance optimization, compiler/runtime/kernel-level optimization, or software–hardware co-design.
• Proficiency in Python or C++, with strong foundations in algorithms, data structures, and numerical computing.
• Experience with at least one major ML framework — PyTorch, TensorFlow, or JAX.
• Demonstrated ability to analyze and optimize performance in real-world ML pipelines.

Responsibilities

• Bring up and optimize cutting-edge foundation models (e.g., DeepSeek, Llama, Qwen, and others) on the SambaNova platform through the SambaNova software stack.
• Profile and enhance model performance across compiler, runtime, and hardware layers to achieve SOTA throughput and latency.
• Collaborate with machine learning, compiler, runtime, and hardware teams to deliver co-designed, high-performance AI applications.
• Integrate the latest advances in model architecture, quantization, scheduling, and memory optimization from both academia and industry.
• Develop robust, scalable, and efficient end-to-end inference solutions aligned with customer needs.
• Identify performance bottlenecks and propose dataflow or scheduling optimizations for both single-node and distributed systems.

Skills

Python

C++

PyTorch

TensorFlow

JAX

Education

Bachelor's degree in CS/EE or related

Tools

CUDA

Triton

DeepSpeed

Megatron

vLLM

TensorRT

CuDNN

Job description

SambaNova Systems in San Jose is seeking a talented ML performance engineer to optimize and scale state-of-the-art foundation models on our reconfigurable dataflow platform. You will work hands-on with leading models to push throughput, latency, and efficiency, bridging gaps between compiler, runtime, and hardware teams to deliver world-record AI inference performance.

The role requires a strong foundation in deep learning and systems optimization, 3+ years of experience, and proficiency in