Senior AI Cloud Infrastructure Architect | Managed GPU Cloud

Emerald AI; Washington (District of Columbia); Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

Competitive pay + equity

Medical, dental, vision

401(k) matching

Flexible location (DC/Boston/Bay Area)

Job summary

Emerald AI is building the world’s first power-flexible managed cloud infrastructure. A senior infrastructure engineer will architect and stand up our end-to-end managed cloud services, from platform to control plane and customer experience.

The role requires hands-on architecture with production-scale GPU/cloud systems, strong Linux/IaC skills, and experience delivering multi-tenant platforms across diverse providers. Join a mission to scale AI sustainably while shaping product strategy.

Qualifications

• Architect and launch a managed cloud or AI platform to production users.
• Deep Linux knowledge and IaC with Terraform and Ansible.
• Experience with multi-tenant isolation, security, and service boundaries.
• Experience delivering Kubernetes/Slurm as a managed service.

Responsibilities

• Architect our managed services from 0→1, defining GPU capacity productization across providers.
• Build platform core: control-plane, self-service interfaces, and automated lifecycles including usage metering with billing.
• Evaluate infrastructure vendors and automate handoff to active tenants.
• Ensure secure multi-tenancy with compute/storage/network isolation and QoS.”
• Oversee workloads with Kubernetes and Slurm for large-scale training/inference across clouds.
• Lead storage strategy: parallel solutions like Lustre, VAST, or Weka integrated with provisioning.
• Define SLOs, observability, and incident response aligned with vendor SLAs.

Skills

Kubernetes

Slurm

Lustre

GPFS

VAST

Weka

Python

Go

InfiniBand networking

Tools

Terraform

Ansible

S3/Ceph/MinIO

Job description

Emerald AI is building the world’s first power-flexible managed cloud infrastructure. A senior infrastructure engineer will architect and stand up our end-to-end managed cloud services, from platform to control plane and customer experience.

The role requires hands-on architecture with production-scale GPU/cloud systems, strong Linux/IaC skills, and experience delivering multi-tenant platforms across diverse providers. Join a mission to scale AI sustainably while shaping product strategy.