Senior AI Cloud Infrastructure Architect (0→1)

emerald-ai; Boston, Washington, San Francisco (MA, District of Columbia, CA); Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Competitive pay

Equity

Medical benefits

Dental benefits

Vision benefits

401(k) matching

Flexible location

Work from home two days/week

Job summary

Emerald AI in Boston is seeking a senior infrastructure engineer to architect and stand up our managed cloud services from end to end. You will own design decisions for multi-tenant GPU capacity, provisioning, and the control plane, and you will implement them.

You will lead Kubernetes and Slurm environments, integrate Lustre/GPFS storage, and ensure secure isolation, observability, and scalable billing. This role blends hands-on coding with architectural leadership.

Qualifications

• 7+ years of experience in infrastructure or platform engineering with production-ready managed cloud or AI platform.
• Strong experience with Kubernetes and Slurm as managed services.
• Experience deploying Lustre/GPFS or similar parallel filesystem.
• Solid cloud fundamentals: tenancy, APIs, quotas, metering, and operations.
• Deep Linux, IaC with Terraform/Ansible, and coding in Python or Go.

Responsibilities

• Architect our managed services from 0→1, defining productization of GPU capacity and service catalogs.
• Engineer the platform core: control plane, self-service interfaces, and automated lifecycle systems.
• Onboard and vet infrastructure partners; assess bare-metal GPU vendors and network isolation.
• Design end-to-end multi-tenancy with secure boundaries and encryption.
• Drive workload orchestration: manage Kubernetes/Slurm for large-scale training and inference.
• Lead high-performance storage strategy with Lustre, VAST, or Weka.
• Ensure operational excellence with SLOs, observability, and incident response aligned to SLAs.

Skills

Infra & platform engineering

Linux systems knowledge

Tools

Kubernetes

Slurm

Lustre

GPFS

Weka

VAST

Terraform

Ansible

Python

Go

Job description

Emerald AI in Boston is seeking a senior infrastructure engineer to architect and stand up our managed cloud services from end to end. You will own design decisions for multi-tenant GPU capacity, provisioning, and the control plane, and you will implement them.

You will lead Kubernetes and Slurm environments, integrate Lustre/GPFS storage, and ensure secure isolation, observability, and scalable billing. This role blends hands-on coding with architectural leadership.