Remote Principal Architect - AI Compute & GPU Infra

CloudData.Center

United States

Remote

USD 180,000 - 270,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

CloudData.Center is seeking a senior architect to set the technical direction for AI compute environments, spanning GPU clusters, private AI clouds, and MLOps platforms. The role blends architectural leadership with hands-on design and deployment for client infrastructure.

You will lead GPU cluster designs (H100, B200, GB200), plan high‑performance networking (InfiniBand, 400G/800G Ethernet), and shape architectures for inference serving and AI workloads.

Qualifications

  • Deep expertise in AI compute and GPU infrastructure architecture.
  • Experience designing GPU clusters and high-performance networking for AI workloads.
  • Familiarity with Kubernetes-based platforms and inference serving.

Responsibilities

  • Lead designs for GPU compute clusters using systems in the H100, B200, and GB200 classes.
  • Plan high-performance AI networking, including InfiniBand and 400G/800G Ethernet fabrics.
  • Shape private AI cloud and MLOps platform architectures.
  • Design infrastructure for inference serving and related AI workloads.
  • Guide deployment choices across compute, networking, and platform layers.

Skills

AI compute architecture
GPU cluster design
High-performance networking
Kubernetes platforms
Inference serving

Tools

InfiniBand networking
400G/800G Ethernet

Job description

CloudData.Center is seeking a senior architect to set the technical direction for AI compute environments, spanning GPU clusters, private AI clouds, and MLOps platforms. The role blends architectural leadership with hands-on design and deployment for client infrastructure.

You will lead GPU cluster designs (H100, B200, GB200), plan high‑performance networking (InfiniBand, 400G/800G Ethernet), and shape architectures for inference serving and AI workloads.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Architect — AI Cloud & GPU Infrastructure
Principal Architect — AI Cloud & GPU Infrastructure

CloudData.Center • United States

Remote
USD 180,000 - 270,000
AI Compute Domain Architect — NVIDIA GPU Infra Lead
AI Compute Domain Architect — NVIDIA GPU Infra Lead

World Wide Technology, Inc. • Maryland Heights (MO)

On-site
USD 110,000 - 150,000
Health and Wellness
401k with matching
Paid time off
+2
Remote Domain Architect: AI Compute & NVIDIA Ecosystem
Remote Domain Architect: AI Compute & NVIDIA Ecosystem

World Wide Technology, Inc. • United States

Remote
USD 110,000 - 150,000
Health and Wellbeing benefits
Profit sharing
401k plan with company matching
+2
Senior AI Fabric Network Architect — Remote
Senior AI Fabric Network Architect — Remote

NVIDIA Corporation • New York (NY)

Remote
USD 184,000 - 357,000
Equity
Benefits
Senior AI Fabric Network Architect – Remote
Senior AI Fabric Network Architect – Remote

NVIDIA Corporation • Washington

Remote
USD 184,000 - 357,000
Equity
Benefits
Principal AI Systems Engineer, GPU Compute Infra
Principal AI Systems Engineer, GPU Compute Infra

Highrise AI • United States

Hybrid
USD 180,000 - 280,000
AI Infrastructure Architect — Scalable GPU Compute
AI Infrastructure Architect — Scalable GPU Compute

EngineersOfAI • Sunnyvale (CA)

On-site
USD 150,000 - 200,000
Senior Remote GPU Cluster Architect
Senior Remote GPU Cluster Architect

Orion Placement • United States

Remote
USD 180,000 - 240,000
Bonus
Equity
Remote work (nationwide)
Senior AI Networking Architect (Remote • Equity)
Senior AI Networking Architect (Remote • Equity)

NVIDIA Corporation • Colorado

Remote
USD 184,000 - 357,000
Equity
Benefits
Remote Principal AI Infrastructure Networking Lead
Remote Principal AI Infrastructure Networking Lead

Bazeta • United States

Remote
USD 170,000 - 210,000