Senior AI Runtime Engineer: Distributed Training & Scale

FlexAI; Santa Clara (CA); On-site; Full time

Benefits offered by this job

Competitive salary and benefits package

Work on cutting-edge AI infrastructure

High ownership and fast execution

Job summary

A forward-thinking AI infrastructure company is seeking a Staff AI Runtime Engineer to lead the design and optimization of their AI compute platform. In this leadership role, you'll enhance AI training and inference capabilities. Successful candidates will have over 8 years of experience in systems engineering, expertise with PyTorch and TensorFlow, and strong programming skills in Python and C++. This role is based in Santa Clara, CA, and offers a competitive salary along with the chance to work on cutting-edge technology.

Qualifications

• 8+ years of experience in systems/software engineering, especially in AI runtime and distributed systems.
• Proven experience optimizing and scaling deep learning runtimes for large-scale applications.
• Strong programming skills in Python and C++, with knowledge of Go or Rust being a plus.

Responsibilities

• Own the core runtime architecture supporting AI training and inference at scale.
• Design resilient runtime features within our custom PyTorch stack.
• Profile and enhance system performance across training and inference pipelines.

Skills

Systems/software engineering

AI runtime optimization

Python

C++

Distributed systems

Tools

PyTorch

TensorFlow

Kubernetes

Job description

A forward-thinking AI infrastructure company is seeking a Staff AI Runtime Engineer to lead the design and optimization of their AI compute platform. In this leadership role, you'll enhance AI training and inference capabilities. Successful candidates will have over 8 years of experience in systems engineering, expertise with PyTorch and TensorFlow, and strong programming skills in Python and C++. This role is based in Santa Clara, CA, and offers a competitive salary along with the chance to work on cutting-edge technology.