Senior AI Cloud Infrastructure Architect

Emerald AI, Inc.

Washington (District of Columbia)

Hybrid

USD 180,000 - 230,000

Full time

8 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Emerald AI is hiring a Senior Infrastructure Engineer to architect and implement our managed cloud services from end to end, spanning platform, control plane, and customer experience. You will lead design decisions and also implement them, ensuring scalable, secure, and compliant cloud infrastructure for AI workloads.

The role requires 7+ years in infrastructure or platform engineering, with strong Kubernetes, Slurm, and parallel filesystem experience.

Qualifications

At least 7+ years of experience in infrastructure or platform engineering, including architecture and launch of a managed cloud or AI platform.
Strong experience with Kubernetes and Slurm and offering them as managed service.
Production experience deploying or operating Lustre or similar parallel filesystem architectures.
Familiarity with cloud service fundamentals, including control planes, tenancy, APIs, quota and metering, and service operation for paying customers.

Responsibilities

Architect our managed services from 0→1 and define productization of GPU capacity.
Engineer the platform core with robust control-plane services and self-service interfaces.
Onboard and vet infrastructure partners with deep technical assessments of vendors.
Design end-to-end multi-tenancy with strict isolation across compute, storage, and networking.
Drive workload orchestration across Kubernetes and Slurm for large-scale training.
Lead high-performance storage strategy using Lustre, VAST, or Weka.
Ensure operational excellence with SLOs, observability, and incident protocols.