Senior Infrastructure Architect for Managed AI Cloud

Emerald AI

Oakland (CA)

Hybrid

USD 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Make an impact
World-class team
Build from 0→1
Competitive pay
Stock options
Medical benefits
Dental benefits
Vision benefits
401(k) matching
Flexible location
2 WFH days/week
Investor backing: Radical Ventures
NVIDIA backing

Job summary

Emerald AI is building the world’s first power flexible managed cloud infrastructure and seeks a senior infrastructure engineer to architect and stand up our managed cloud services end to end. The role involves platform, control plane, and customer-facing experience with a strong emphasis on design decisions and hands-on implementation.

You will join a team that has built and scaled managed cloud or AI platforms in GPU clouds or HPC centers, shaping how compute resources are offered to

Qualifications

  • 7+ years in infrastructure or platform engineering with production cloud/AI experience.
  • Kubernetes and Slurm in managed services, with production readiness.
  • Experience with Lustre/GPFS or similar parallel file systems at scale.
  • Cloud control planes, tenancy models, APIs, quotas, and metering.
  • Strong Linux, IaC (Terraform/Ansible) and Python or Go programming.
  • GPU infra exposure, InfiniBand networking, and GPU software stacks.

Responsibilities

  • Architect 0→1 managed services for GPU capacity, isolation, and provisioning.
  • Build platform core with control-plane, self-service interfaces, and metering.
  • Onboard and assess bare-metal GPU vendors and automate tenant handoff.
  • Design multi-tenancy with secure boundaries, QoS, and encryption.
  • Oversee Kubernetes/Slurm workloads for large-scale training and inference.
  • Lead storage strategy with Lustre, VAST, or Weka integrations into provisioning.
  • Define SLOs, observability, and incident response aligned to provider SLAs.

Tools

Kubernetes
Slurm
Lustre
GPFS
Weka
VAST
BeeGFS
Terraform
Ansible
Python
Go
InfiniBand
RoCE
RDMA

Job description

Emerald AI is building the world’s first power flexible managed cloud infrastructure and seeks a senior infrastructure engineer to architect and stand up our managed cloud services end to end. The role involves platform, control plane, and customer-facing experience with a strong emphasis on design decisions and hands-on implementation.

You will join a team that has built and scaled managed cloud or AI platforms in GPU clouds or HPC centers, shaping how compute resources are offered to

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Cloud Infrastructure Architect | Managed GPU Cloud
Senior AI Cloud Infrastructure Architect | Managed GPU Cloud

Emerald AI • Washington

Hybrid
USD 140,000 - 210,000
Competitive pay + equity
Medical, dental, vision
401(k) matching
+1
Senior Product Manager - AI Compute & Infrastructure
Senior Product Manager - AI Compute & Infrastructure

Emerald AI • Washington

Hybrid
USD 170,000 - 240,000
Competitive pay
Equity
Medical benefits
+3
Senior Product Manager, AI Compute Platform
Senior Product Manager, AI Compute Platform

Emerald AI • Oakland (CA)

Hybrid
USD 170,000 - 250,000
Member of Technical Staff - AI Cloud Infrastructure
Member of Technical Staff - AI Cloud Infrastructure

Emerald AI • Washington

Hybrid
USD 140,000 - 210,000
Competitive pay + equity
Medical, dental, vision
401(k) matching
+1
Member of Technical Staff - AI Cloud Infrastructure
Member of Technical Staff - AI Cloud Infrastructure

Emerald AI • Oakland (CA)

Hybrid
USD 180,000 - 260,000
Make an impact
World-class team
Build from 0→1
+10
Staff AI Infrastructure Engineer (Power‑Aware)
Staff AI Infrastructure Engineer (Power‑Aware)

Emerald AI • San Francisco (CA)

Hybrid
USD 180,000 - 260,000
Stock options
Medical, dental, vision benefits
401(k) matching
+2
Technical Program Manager, Power-Flexible AI Data Centers
Technical Program Manager, Power-Flexible AI Data Centers

Emerald • San Francisco (CA)

Hybrid
USD 170,000 - 210,000
Make impact
World-class team
Build from 0→1
+4
Technical Program Manager — AI Infra & Power Scaling
Technical Program Manager — AI Infra & Power Scaling

Emerald AI, Inc. • Oakland (CA)

Hybrid
USD 150,000 - 230,000
Competitive pay + equity
Comprehensive benefits
Flexible location
+2
Staff AI Infrastructure Engineer
Staff AI Infrastructure Engineer

Emerald AI • United States

Hybrid
USD 180,000 - 240,000
Make an impact
World-class team
Build from scratch
+4
Staff Engineer, AI Infrastructure & Power-Aware Systems
Staff Engineer, AI Infrastructure & Power-Aware Systems

Emerald AI • Oakland (CA)

Hybrid
USD 190,000 - 240,000
Competitive pay + equity
Medical, dental, vision coverage
401(k) matching
+1