Senior AI Cloud Infrastructure Architect (Kubernetes/Slurm)

Emerald; Washington (District of Columbia); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Impactful work

Equity

Flexible location

Investors backing

Comprehensive benefits

2 WFH days

Job summary

Emerald AI is building the world’s first power-flexible managed cloud infrastructure. We are hiring a senior infrastructure engineer to architect and stand up our managed cloud services end-to-end, shaping the platform, control plane, and customer experience for a managed AI cloud.

The ideal candidate has built or led early engineering on a managed cloud or AI platform—GPU cloud, HPC, or hyperscaler—and will still write code while making major design decisions.

Qualifications

• At least 7+ years of experience in infrastructure or platform engineering, with production launch of a managed cloud/AI platform.
• Strong experience with Kubernetes and Slurm as managed services.
• Production experience deploying Lustre or equivalent parallel filesystem (GPFS, Weka, VAST, BeeGFS).
• Solid cloud service fundamentals: control planes, tenancy, APIs, quota, metering, and paid-for services.
• Deep Linux systems knowledge; IaC with Terraform/Ansible; programming in Python or Go.
• Familiarity with GPU infrastructure, including InfiniBand, RoCE, RDMA, and GPU software stacks.

Responsibilities

• Architect managed services from 0→1, define GPU capacity productization, and scalable tenant models.
• Engineer the platform core: control-plane services, self-service interfaces, and automated lifecycle systems with usage metering.
• Onboard and vet infrastructure partners; assess bare-metal GPU vendors for automation paths.
• Design end-to-end multi-tenancy with secure boundaries, QoS, and encryption across compute/storage/networking.
• Drive workload orchestration across Kubernetes and Slurm for large-scale training/inference.
• Lead high-performance storage strategy with Lustre, VAST, or Weka integrations.
• Define SLOs, observability, and incident response aligned with provider SLAs.

Skills

Kubernetes

Slurm

Python/Go

Cloud architecture

IaC (Terraform/Ansible)

Tools

Terraform

Ansible

Python

Go

Networking (InfiniBand)

Job description

Emerald AI is building the world’s first power-flexible managed cloud infrastructure. We are hiring a senior infrastructure engineer to architect and stand up our managed cloud services end-to-end, shaping the platform, control plane, and customer experience for a managed AI cloud.

The ideal candidate has built or led early engineering on a managed cloud or AI platform—GPU cloud, HPC, or hyperscaler—and will still write code while making major design decisions.