Senior AI Cloud Infra Architect — Multi‑Tenant Platform

Emerald AI; Oakland (CA); Hybrid; USD 190,000 - 240,000; Full time

Benefits offered by this job

Stock options

Medical, dental, vision

401(k) matching

Flexible location

2 WFH days/week

Job summary

Emerald AI is hiring a senior infrastructure engineer to architect and stand up our managed cloud services from end to end. The role covers platform, control plane, and customer experience, with major design decisions implemented by the engineer.

The ideal candidate has 7+ years in infra or platform engineering, strong Kubernetes and Slurm experience, and hands-on work with Lustre/GPFS-like systems, Terraform/Ansible, and Python/Go. Hybrid work in the Bay Area or other US locations is supported.

Qualifications

• 7+ years of infrastructure or platform engineering, including launching a managed cloud or AI platform with production users.
• Strong experience with Kubernetes and Slurm as managed services.
• Production experience deploying or operating Lustre, GPFS, or comparable parallel filesystems (e.g., Weka, VAST).
• Deep cloud service fundamentals: control planes, tenancy and isolation, APIs, quota and metering, and paid services."
• Solid Linux, IaC with Terraform/Ansible, and programming in Python or Go.
• Familiarity with GPU infra, including high-performance networking (InfiniBand, RoCE, RDMA) and the GPU software stack.

Responsibilities

• Architect our managed services from 0→1, defining productization of GPU capacity and scalable tenant models.
• Build platform core: robust control-plane services, self-service interfaces, and automated lifecycle systems with billing integration.
• Onboard and vet infrastructure partners; evaluate bare-metal GPU vendors and network isolation.
• Design end-to-end multi-tenancy with strict isolation across compute, storage, and networking.
• Drive workload orchestration with Kubernetes and Slurm for large-scale training and inference.
• Lead high-performance storage strategy with Lustre, VAST, or Weka.
• Define SLOs, observability standards, and incident response aligned with provider SLAs.

Tools

Kubernetes

Slurm

Lustre

GPFS

VAST

Weka

Terraform

Ansible

Python

Go

Job description

Emerald AI is hiring a senior infrastructure engineer to architect and stand up our managed cloud services from end to end. The role covers platform, control plane, and customer experience, with major design decisions implemented by the engineer.

The ideal candidate has 7+ years in infra or platform engineering, strong Kubernetes and Slurm experience, and hands-on work with Lustre/GPFS-like systems, Terraform/Ansible, and Python/Go. Hybrid work in the Bay Area or other US locations is supported.