Member of Technical Staff - AI Cloud Infrastructure

Emerald AI, Inc.; Oakland (CA); Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Make an impact

World-class team

Build from 0→1

Competitive pay

Stock options

Medical benefits

Dental benefits

Vision benefits

401(k) matching

Flexible location

2 WFH days/week

Investor backing: Radical Ventures

NVIDIA backing

Job summary

Emerald AI is building the world’s first power flexible managed cloud infrastructure and seeks a senior infrastructure engineer to architect and stand up our managed cloud services end to end. The role involves platform, control plane, and customer-facing experience with a strong emphasis on design decisions and hands-on implementation.

You will join a team that has built and scaled managed cloud or AI platforms in GPU clouds or HPC centers, shaping how compute resources are offered to

Qualifications

• 7+ years in infrastructure or platform engineering with production cloud/AI experience.
• Kubernetes and Slurm in managed services, with production readiness.
• Experience with Lustre/GPFS or similar parallel file systems at scale.
• Cloud control planes, tenancy models, APIs, quotas, and metering.
• Strong Linux, IaC (Terraform/Ansible) and Python or Go programming.
• GPU infra exposure, InfiniBand networking, and GPU software stacks.

Responsibilities

• Architect 0→1 managed services for GPU capacity, isolation, and provisioning.
• Build platform core with control-plane, self-service interfaces, and metering.
• Onboard and assess bare-metal GPU vendors and automate tenant handoff.
• Design multi-tenancy with secure boundaries, QoS, and encryption.
• Oversee Kubernetes/Slurm workloads for large-scale training and inference.
• Lead storage strategy with Lustre, VAST, or Weka integrations into provisioning.
• Define SLOs, observability, and incident response aligned to provider SLAs.

Tools

Kubernetes

Slurm

Lustre

GPFS

Weka

VAST

BeeGFS

Terraform

Ansible

Python

Go

InfiniBand

RoCE

RDMA

Job description

About Emerald AI

We’re at a pivotal moment for AI and energy. Demand for compute is skyrocketing, but power constraints are becoming a critical bottleneck. Emerald AI sits at the intersection of these two worlds, enabling AI data centers to scale without overwhelming the grid.

Our Emerald Conductor software platform makes data centers flexible and responsive, allowing them to adjust power usage dynamically. This unlocks massive AI growth without major new infrastructure, while also strengthening the grid and supporting the expansion of renewable energy.

We’re a team of experts across AI, cloud, software, and energy—on a mission to scale AI sustainably. We’re backed by leading investors and partners including Radical Ventures and NVIDIA.

Learn more about our vision, team, and backers at https://www.emeraldai.co/.

About the Role

Emerald AI is building the world’s first power flexible managed cloud infrastructure. We are hiring a senior infrastructure engineer to architect and stand up our managed cloud services from end to end. The work covers the platform, the control plane, and the customer experience that together make up a managed AI cloud.

The right person has done this before. They have built or served as a core early engineer on a managed cloud or AI platform, whether at a GPU cloud, an internal machine learning platform run at scale, a hyperscaler AI service, or a HPC research computing center operated as a service. This is a role for an architect who still builds. You will make the major design decisions and then implement them yourself.

Key Responsibilities

• Architect our managed services from 0→1. Define the productization of GPU capacity, encompassing isolation boundaries, tenant models, provisioning flows, and service catalogs that scale across diverse providers.

• Engineer the platform core. Build robust control-plane services, self-service customer interfaces, and automated lifecycle systems, including usage metering integrated with billing infrastructure.

• Onboard and vet infrastructure partners. Conduct deep technical assessments of bare-metal GPU vendors, evaluating fabric quality, network isolation, and economics to automate the path from handoff to active tenant.

• Design end-to-end multi-tenancy. Implement rigorous isolation across compute, storage, and networking (InfiniBand/VLANs), ensuring secure boundaries, QoS, and encryption even when customers possess root access.

• Drive workload orchestration. Manage Kubernetes and Slurm environments for large-scale training and inference, overseeing node health, driver fleets, and kernel management across heterogeneous clouds.

• Lead high-performance storage strategy. Deploy and integrate parallel storage solutions like Lustre, VAST, or Weka, leveraging your deep experience with these systems to ensure they fold cleanly into our provisioning model.

• Ensure operational excellence. Define SLOs, observability standards, and incident response protocols that bridge our internal standards with underlying provider SLAs to deliver a reliable, sellable product.

Minimum requirements

• At least 7+ years of experience in infrastructure or platform engineering, including the architecture and launch of a managed cloud or AI platform that reached production users.

• Strong experience with Kubernetes and Slurm and offering them as managed service

• Production experience deploying or operating Lustre or a comparable parallel filesystem such as GPFS, Weka, VAST, or BeeGFS, with a solid understanding of parallel filesystem architecture, tuning, and failure modes.

• A strong grasp of cloud service fundamentals, including control planes, tenancy and isolation models, APIs, quota and metering systems, and the operational discipline of running a service that customers pay for.

• Deep Linux systems knowledge, mature infrastructure as code practice with tools such as Terraform and Ansible, and solid programming ability in Python or Go.

• Familiarity with GPU infrastructure, including high performance networking with InfiniBand, RoCE, and RDMA, and the GPU software stack.

Preferred requirements

• Prior time at a GPU cloud, a hyperscaler AI service, or an HPC center that delivers compute and storage as a service, especially one built on rented or colocated capacity.

• Familiarity with NVIDIA reference architectures such as SuperPOD, along with GPUDirect Storage, NCCL debugging, and DCGM.

• Experience with Lustre multitenancy features such as nodemap, fileset mounts, and Kerberos, or with service provider deployments of VAST or Weka.

• Experience negotiating with and integrating multiple infrastructure vendors, together with a practice of designing for portability between them.

• Experience running object storage at scale with systems such as S3, Ceph, or MinIO, including the design of data tiering.

• Experience building billing, metering, or FinOps pipelines for services that charge by usage.

What We Offer

• Make an impact. Solve the AI power bottleneck and shape how data centers scale sustainably.

• Join a world-class team of AI, cloud, software, and energy experts in a collaborative, low-ego environment.

• Build from 0→1. Influence strategy, GTM, org design, and customer/investor engagement from day one.

• Competitive pay + equity. Stock options let you share in the value you help create.

• Comprehensive benefits, including medical, dental, vision, and 401(k) matching.

• Flexible location. Work from D.C., Boston, or the Bay Area, with 2 WFH days/week.

• Backed by top investors, including Radical Ventures and NVIDIA.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation.

Emerald AI strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees.

Inclusiveness is core to our culture at Emerald AI, and we strive to ensure you get the most from your interview experience. Emerald AI makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.