Senior GPU Cluster Architect — Remote

Nebius Group; Oregon; Hybrid; USD 184,000 - 318,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

Parental leave

Remote work reimbursement

Disability & life insurance

Job summary

Nebius Group is seeking a GPU Cluster Architect to drive the design of next-generation AI infrastructure. You will define scalable GPU cluster topologies, interconnects, storage, and control planes to meet the scale, performance, and reliability needs of modern AI workloads.

This is a hands-on role collaborating with site reliability, networking, storage, and data-center engineering teams. Remote work from the USA is supported, with focus on scalable architectures across data centers.

Qualifications

• 5+ years of experience designing clusters.
• Deep understanding of modern GPU architecture (NVIDIA, AMD, etc.).
• Experience with HPC interconnects (InfiniBand & RoCE).
• Solid background in systems architecture, networking, and hardware reliability.
• Experience in scripting for automation and telemetry pipelines (Python, Go, etc.)

Responsibilities

• Cluster Design: Architect scalable GPU cluster topologies including compute nodes, interconnect (InfiniBand, Ethernet), storage, and control planes.
• Performance Modeling: Analyze AI/ML workloads to inform design tradeoffs across latency, bandwidth, and GPU density.
• Network Architecture: Validate low-latency, high-throughput interconnects at POD and DC scale.
• Storage Integration: Optimize performance for training datasets and checkpoints.
• Reliability & Monitoring: Analyze signals from monitoring systems to detect design flaws.
• Collaboration: Partner with site reliability, networking, storage, and DC engineering teams to operationalize your architecture.

Skills

Cluster design

GPU architecture

HPC interconnects

Systems architecture

Automation scripting

Tools

InfiniBand

RoCEv2

Job description

Nebius Group is seeking a GPU Cluster Architect to drive the design of next-generation AI infrastructure. You will define scalable GPU cluster topologies, interconnects, storage, and control planes to meet the scale, performance, and reliability needs of modern AI workloads.

This is a hands-on role collaborating with site reliability, networking, storage, and data-center engineering teams. Remote work from the USA is supported, with focus on scalable architectures across data centers.