Lead AI Cluster Networking Architect

LinuxCareers

United States

On-site

USD 180,000 - 240,000

Full time

38 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

NVIDIA networking tools

Job summary

Highrise AI seeks a principal-level network leader to deploy and operate large-scale GPU clusters. You will bring physical infrastructure online, validate topology and cabling, and provide Tier 3 escalation for complex networking issues.

You will design automation, runbooks, and monitoring standards for NOC/SRE handoff while collaborating with compute engineers to optimize multi-node AI workloads.

Qualifications

  • Bachelor's degree in computer science, engineering, networking, or related discipline, or equivalent practical experience.
  • 10+ years of hands-on data center or high-performance networking experience with deep troubleshooting and technical leadership.
  • Experience deploying and operating large-scale, low-latency networks for AI, HPC, cloud, or similar distributed systems.
  • Strong expertise in Ethernet and/or InfiniBand fabrics, RDMA/RoCE, routing and switching.
  • Proficiency with Linux networking and network automation using Python, Ansible, or equivalent tooling.
  • Expert-level problem solving across physical, link, transport, and application-facing network performance layers.

Responsibilities

  • Lead network fabric bring-up and commissioning of AI clusters, including switch initialization and RDMA setup.
  • Execute fabric qualification testing for link health, latency, and resilience; tune RDMA and QoS.
  • Analyze NCCL/distributed workload results with compute engineers to improve multi-node performance.
  • Provide Tier 3 escalation for production incidents involving fabric instability and network performance.
  • Develop network automation, configuration management procedures, and runbooks for NOC/SRE handoff.

Skills

10+ years networking experience
Ethernet/InfiniBand fabrics
RDMA/RoCE
Linux networking
Python
Ansible
Troubleshooting

Education

Bachelor's degree in CS/engineering/networking

Tools

NVIDIA networking tools

Job description

Highrise AI seeks a principal-level network leader to deploy and operate large-scale GPU clusters. You will bring physical infrastructure online, validate topology and cabling, and provide Tier 3 escalation for complex networking issues.

You will design automation, runbooks, and monitoring standards for NOC/SRE handoff while collaborating with compute engineers to optimize multi-node AI workloads.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Networking Architect — Large-Scale GPU Clusters
Senior AI Networking Architect — Large-Scale GPU Clusters

Hut 8 Corp. • United States

On-site
USD 180,000 - 280,000
Principal AI Network Engineer - Highrise AI
Principal AI Network Engineer - Highrise AI

LinuxCareers • United States

Remote
USD 180,000 - 240,000
NVIDIA networking tools
Remote Principal AI Infrastructure Engineer
Remote Principal AI Infrastructure Engineer

Hut 8 Corp. • United States

On-site
USD 180,000 - 260,000
Principal AI Systems Engineer - Large-Scale GPU Infra
Principal AI Systems Engineer - Large-Scale GPU Infra

Hut 8 Corp. • United States

On-site
USD 180,000 - 240,000
Principal AI Systems Engineer - HPC & GPU Infra
Principal AI Systems Engineer - HPC & GPU Infra

LinuxCareers • United States

On-site
USD 180,000 - 230,000
Senior GPU Compute Infrastructure Engineer
Senior GPU Compute Infrastructure Engineer

LinuxCareers • United States

On-site
USD 170,000 - 250,000
Principal AI Networking Engineer for GPU Clusters
Principal AI Networking Engineer for GPU Clusters

The Consensus • United States

On-site
USD 248,000 - 269,000
Principal AI Infrastructure Engineer - Highrise AI
Principal AI Infrastructure Engineer - Highrise AI

LinuxCareers • United States

Remote
USD 170,000 - 250,000
Lead AI Networking & Infrastructure Engineer
Lead AI Networking & Infrastructure Engineer

Upscale AI • United States

On-site
USD 248,000 - 269,000
Principal AI Network Engineer - Highrise AI
Principal AI Network Engineer - Highrise AI

Hut 8 Corp. • United States

Remote
USD 180,000 - 280,000