Remote GPU Cluster Architect for Scalable AI Infra

Nebius Group; United States; Remote; USD 184,000 - 318,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

Parental leave

Remote work stipend

Life & disability insurance

Job summary

Nebius is seeking a GPU Cluster Architect to design and optimize our next‑generation AI infrastructure. ThisHands‑on, end‑to‑end role requires you to define how tens of thousands of GPUs are interconnected, cooled, powered, and managed across data centers, with a focus on latency, throughput, and reliability.

You will collaborate with site reliability, networking, storage, and DC engineering teams to operationalize the architecture and scale deployments.

Qualifications

• 5+ years of experience designing clusters.
• Deep understanding of modern GPU architecture (NVIDIA, AMD).
• Experience with HPC interconnects (InfiniBand & RoCE).
• Solid background in systems architecture, networking, and hardware reliability.
• Experience in scripting for automation and telemetry pipelines (Python, Go, etc.)

Responsibilities

• Cluster Design: Architect scalable GPU cluster topologies including compute nodes and interconnects.
• Performance Modeling: Analyze AI/ML workloads to inform design tradeoffs across latency and bandwidth.
• Network Architecture: Validate low‑latency, high‑throughput interconnects at scale.
• Storage Integration: Optimize performance for training datasets and checkpoints.
• Reliability & Monitoring: Analyze signals from monitoring systems to improve design.
• Collaboration: Work with reliability, networking, storage, and DC teams to scale architecture.

Skills

GPU architecture

HPC interconnects

Systems architecture

Automation scripting

Team collaboration

Tools

InfiniBand HDR/NDR

RoCEv2

Job description

Nebius is seeking a GPU Cluster Architect to design and optimize our next‑generation AI infrastructure. ThisHands‑on, end‑to‑end role requires you to define how tens of thousands of GPUs are interconnected, cooled, powered, and managed across data centers, with a focus on latency, throughput, and reliability.

You will collaborate with site reliability, networking, storage, and DC engineering teams to operationalize the architecture and scale deployments.