Lead AI Runtime Systems Engineer - Scale & Resilience

flexai; Santa Clara (CA); On-site; USD 180,000 - 280,000; Full time

Benefits offered by this job

Competitive salary

Growth and ownership

Collaborative, high-caliber team

Job summary

FlexAI in Santa Clara, CA is seeking a Staff AI Runtime Engineer to design, develop, and optimize the core runtime infrastructure powering distributed training and inference for large AI models. This hands-on leadership role focuses on the PyTorch-based stack, performance, and fault-tolerant execution at scale.

You'll mentor engineers, collaborate with Research, Infrastructure, and Product teams, and own key runtime components from architecture to deployment, enabling elastic, containerized

Qualifications

• 8+ years of experience in systems/software engineering with AI runtime or distributed systems exposure.
• Experience delivering PaaS services.
• Proven experience optimizing and scaling deep learning runtimes for large-scale training/inference.

Responsibilities

• Lead runtime design and development for core AI training/inference at scale.
• Profile and optimize low-level system performance across pipelines.
• Build internal tooling and observability hooks for DL workloads.
• Collaborate with Research, Infrastructure and Product to align runtime with needs.

Skills

AI runtime

Distributed systems

Python

C++

Tools

PyTorch

TensorFlow

Kubernetes

Ray

Job description

FlexAI in Santa Clara, CA is seeking a Staff AI Runtime Engineer to design, develop, and optimize the core runtime infrastructure powering distributed training and inference for large AI models. This hands-on leadership role focuses on the PyTorch-based stack, performance, and fault-tolerant execution at scale.

You'll mentor engineers, collaborate with Research, Infrastructure, and Product teams, and own key runtime components from architecture to deployment, enabling elastic, containerized