Cloud Infrastructure Engineer — GPU AI Kubernetes

FriendliAI Inc.; San Francisco (CA); On-site; USD 210,000 - 270,000; Full time

Benefits offered by this job

Flexible hours

Meals provided daily

Collaborative culture

Hardware support

Equity

Job summary

FriendliAI is seeking a Cloud Infrastructure Engineer to own the architecture of our GPU-accelerated inference cloud. You will design multi-cluster Kubernetes, extend controllers, and shape how clusters are built and connected.

The role emphasizes performance, reliability, and collaboration with SRE and security teams, delivering IaC with Terraform, Helm, and GitOps while crafting SLOs and scalable networking.

Qualifications

• 5+ years designing, building, and operating large-scale Kubernetes infrastructure in production.

Responsibilities

• Own the architecture of multi-cluster, multi-tenant Kubernetes fleet across managed and self-managed clusters.

Skills

Kubernetes architecture

Go or Python

Distributed systems debugging

Cloud networking

Communication skills

SRE collaboration

Education

Bachelor's or Master's degree in CS/CE/ECE

CS/EE equivalent degree

Tools

AWS

Terraform

Helm

Ansible

Kubespray

eBPF

Cilium

Job description

FriendliAI is seeking a Cloud Infrastructure Engineer to own the architecture of our GPU-accelerated inference cloud. You will design multi-cluster Kubernetes, extend controllers, and shape how clusters are built and connected.

The role emphasizes performance, reliability, and collaboration with SRE and security teams, delivering IaC with Terraform, Helm, and GitOps while crafting SLOs and scalable networking.