Senior GPU Cluster Architect for AI Infrastructure

Nebius

United States

Remote

USD 184,000 - 318,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
401(k) plan
Parental leave
Remote work reimbursement
Disability & life insurance

Job summary

Nebius is looking for a GPU Cluster Architect who will drive end-to-end architectural decisions for a scalable AI infrastructure in a USA remote-friendly role. You will design tens of thousands of GPUs interconnects, cooling, power, and optimization across data centers, ensuring latency and density meet modern AI workloads.

Join Nebius to influence HPC networks, storage integration, and reliability while collaborating with SDR, networking, and DC teams to operationalize a cutting‑edge AI

Qualifications

  • 5+ years of experience designing clusters.
  • Deep understanding of modern GPU architecture (NVIDIA, AMD).
  • Experience with HPC interconnects (InfiniBand & RoCE).
  • Solid background in systems architecture, networking, and hardware reliability.
  • Experience in scripting for automation and telemetry pipelines (Python, Go, etc.)

Responsibilities

  • Cluster Design: Architect scalable GPU cluster topologies including compute nodes, interconnects, storage, and control planes.
  • Performance Modeling: Analyze AI/ML workloads to inform design tradeoffs across latency, bandwidth, and GPU density.
  • Network Architecture: Validate low-latency, high-throughput interconnects at POD and DC scale.
  • Storage Integration: Optimize performance for training datasets and checkpointing.
  • Reliability & Monitoring: Analyze signals from monitoring to detect flows in design.
  • Collaboration: Partner with site reliability, networking, storage, and DC engineering teams.

Skills

Cluster design
GPU architecture
HPC interconnects
Systems architecture
Scripting

Job description

Nebius is looking for a GPU Cluster Architect who will drive end-to-end architectural decisions for a scalable AI infrastructure in a USA remote-friendly role. You will design tens of thousands of GPUs interconnects, cooling, power, and optimization across data centers, ensuring latency and density meet modern AI workloads.

Join Nebius to influence HPC networks, storage integration, and reliability while collaborating with SDR, networking, and DC teams to operationalize a cutting‑edge AI

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GPU Cluster Architect
GPU Cluster Architect

Nebius • United States

Remote
USD 184,000 - 318,000
Health insurance
401(k) plan
Parental leave
+2
Senior HPC Systems Engineer: GPU Clusters & AI Infra
Senior HPC Systems Engineer: GPU Clusters & AI Infra

Nebius Group • United States

Remote
USD 180,000 - 240,000
Competitive pay
Career growth
Flexibility and ownership
+3
Remote Data Center Design Lead for AI GPU Infra
Remote Data Center Design Lead for AI GPU Infra

Devconnectplatform • United States

Remote
USD 90,000 - 220,000
Health insurance
401(k) plan
Parental leave
+1
Senior Technical Program Manager - AI Infra & Data Centers
Senior Technical Program Manager - AI Infra & Data Centers

Nebius Group • United States

Remote
USD 115,000 - 275,000
Healthcare coverage
401(k) with company match
Parental leave (20 weeks primary, 12–?
+3
Senior Data Center Network Architect for AI Cloud
Senior Data Center Network Architect for AI Cloud

Nebius Group • United States

Remote
USD 125,000 - 180,000
Health insurance
401(k) plan with company contribution
Paid time off
Senior GPU Systems Engineer — AI Infrastructure & Reliability
Senior GPU Systems Engineer — AI Infrastructure & Reliability

Nebius Group • United States

Remote
USD 180,000 - 224,000
Medical coverage and dental/vision for
Retirement plan with employer match
Paid parental leave
+2
Senior AI Infrastructure Engineer — GPU & HPC R&D
Senior AI Infrastructure Engineer — GPU & HPC R&D

Fdetimes • United States

Hybrid
USD 180,000 - 224,000
Health insurance
401(k) plan
Parental leave
+2
Senior HPC Engineer, GPU Compute
Senior HPC Engineer, GPU Compute

Nebius Group • United States

Remote
USD 140,000 - 190,000
Senior Remote GPU Cluster Architect
Senior Remote GPU Cluster Architect

Orion Placement • United States

Remote
USD 180,000 - 240,000
Bonus
Equity
Remote work (nationwide)
Senior GPU Cluster Architect — Remote
Senior GPU Cluster Architect — Remote

Andromeda • United States

Remote
USD 180,000 - 240,000
Healthcare
Dental
Vision
+2