AI Infra & Cluster Engineer — Scale GPU/CPU Orchestration

Linuxcareers; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

Linuxcareers is seeking an Infrastructure/Cluster Engineer to design and operate large-scale clusters that enable AI inference at scale. The role focuses on managing diverse hardware architectures and building robust infrastructure.

The ideal candidate will possess deep expertise in Linux systems, automation tools, and orchestration technologies. Responsibilities include debugging performance issues and designing observability systems for cluster health. Experience with GPU infrastructure is a plus.

Qualifications

• Experience in infrastructure, cluster engineering, platform engineering, or distributed systems.
• Deep Linux systems experience with an emphasis on debugging.
• Strong automation skills using Terraform, Ansible, or Python.

Responsibilities

• Design and operate large-scale CPU and GPU clusters.
• Build automation solutions for infrastructure management.
• Debug complex production issues across various technology layers.

Skills

Infrastructure engineering

Linux systems

Kubernetes

Automation with Terraform

GPU infrastructure

Tools

Ansible

Python

Go

Job description

Linuxcareers is seeking an Infrastructure/Cluster Engineer to design and operate large-scale clusters that enable AI inference at scale. The role focuses on managing diverse hardware architectures and building robust infrastructure.

The ideal candidate will possess deep expertise in Linux systems, automation tools, and orchestration technologies. Responsibilities include debugging performance issues and designing observability systems for cluster health. Experience with GPU infrastructure is a plus.