Remote GPU Cluster Architect for Scalable AI Infrastructure

Nebius; United States; On-site; USD 184,000 - 318,000; Full time

Benefits offered by this job

Health insurance: 100% company-paid coverage

401(k) plan: Up to 4% company match

20 weeks paid parental leave for primary caregivers

Remote work reimbursement up to $85/month

Life insurance coverage

Competitive compensation

Career growth opportunities

Collaborative culture

Job summary

Nebius is seeking a GPU Cluster Architect to drive the design of next-generation AI infrastructure. This role involves making critical architectural decisions across compute, networking, and storage, ensuring the infrastructure meets the needs of modern AI workloads.

You will define how GPUs are interconnected and optimized across data center sites. This position supports remote work from the USA and offers competitive salaries ranging from $184K to $318K, including bonuses.

Qualifications

• 5+ years of experience designing clusters.
• Deep understanding of modern GPU architecture (NVIDIA, AMD, etc.).
• Experience with HPC interconnects (InfiniBand & RoCE).
• Solid background in systems architecture, networking, and hardware reliability.
• Experience in scripting for automation and telemetry pipelines (Python, Go, etc.).

Responsibilities

• Architect scalable GPU cluster topologies including compute nodes, interconnect, storage, and control planes.
• Analyze AI/ML workloads to inform design tradeoffs across latency, bandwidth, and GPU density.
• Align with network architect design and validate low-latency, high-throughput interconnects at scale.
• Work with storage teams to optimize performance for training datasets.
• Understand and analyze signals from monitoring systems to detect flaws in design.
• Partner with various teams to operationalize and scale architecture.

Skills

Cluster Design

Performance Modeling

Network Architecture

Storage Integration

Reliability & Monitoring

Collaboration

Deep understanding of modern GPU architecture

Experience with HPC interconnects

Scripting for automation

Job description

Nebius is seeking a GPU Cluster Architect to drive the design of next-generation AI infrastructure. This role involves making critical architectural decisions across compute, networking, and storage, ensuring the infrastructure meets the needs of modern AI workloads.

You will define how GPUs are interconnected and optimized across data center sites. This position supports remote work from the USA and offers competitive salaries ranging from $184K to $318K, including bonuses.