GPU Cloud Network SRE: InfiniBand & RoCE Expert

Triwill Group

United States

Remote

USD 150,000 - 230,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Bitdeer is seeking a senior network engineer to own and operate the InfiniBand and RoCE fabrics that power our GPU clusters across multiple US data centers. You will convert telemetry into ground truth for congestion predictors and feed the AIOps platform with actionable insights.

You will collaborate with Nvidia/Mellanox support, manage firmware lifecycles, and implement advanced topology optimization to prevent failures and optimize NCCL traffic. A strong automation mindset is essential.

Qualifications

  • 5+ years in data center networking with at least 3 years focused on InfiniBand or RoCE fabrics.
  • Hands-on experience deploying and operating Nvidia/Mellanox InfiniBand switches at scale.
  • Strong understanding of IB subnet management, partitioning, and QoS.
  • Experience with RoCEv2 deployment including PFC, ECN, DCQCN configuration.
  • Proficiency with UFM or equivalent IB fabric management tools.
  • Knowledge of 400G/800G optics, cabling standards, and structured cabling best practices.
  • Experience diagnosing IB/RoCE network issues using ibdiagnet, perfquery, ibstat, and similar tools.
  • Understanding of NCCL and how GPU communication maps to network topology.
  • Instinct for telemetry-driven ops and automation mindset.

Responsibilities

  • Operate InfiniBand and RoCE fabrics for GPU clusters at scale.
  • Coordinate with Nvidia/Mellanox support for escalations and RMA.
  • Feed AIOps substrate with fabric telemetry for fault prediction.
  • Tune NCCL performance and topology mapping for efficient GPU communication.
  • Manage firmware lifecycle across IB switches and HBAs.
  • Diagnose link issues, congestion, and routing anomalies using standard tools.

Skills

Data center networking
InfiniBand/RoCE fabrics
Nvidia/Mellanox switches
IB subnet management
RoCEv2 deployment
UFM fabric management
NCCL/topology mapping
Telemetry-driven ops
Runbook automation

Tools

ibdiagnet
perfquery
ibstat

Job description

Bitdeer is seeking a senior network engineer to own and operate the InfiniBand and RoCE fabrics that power our GPU clusters across multiple US data centers. You will convert telemetry into ground truth for congestion predictors and feed the AIOps platform with actionable insights.

You will collaborate with Nvidia/Mellanox support, manage firmware lifecycles, and implement advanced topology optimization to prevent failures and optimize NCCL traffic. A strong automation mindset is essential.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

GPU DC East-West Network SRE: InfiniBand & RoCE Expert
GPU DC East-West Network SRE: InfiniBand & RoCE Expert

Bitdeer • San Jose (CA)

On-site
USD 140,000 - 210,000
GPU DC East-West Network SRE Expert (SME)
GPU DC East-West Network SRE Expert (SME)

Bitdeer • San Jose (CA)

On-site
USD 140,000 - 210,000
Senior GPU Cluster Networking Engineer (RDMA/InfiniBand)
Senior GPU Cluster Networking Engineer (RDMA/InfiniBand)

Sciforium • San Francisco (CA)

On-site
USD 170,000 - 230,000
Senior GPU Fabric Architect for AI Cloud Infra
Senior GPU Fabric Architect for AI Cloud Infra

Bitdeer (NASDAQ: BTDR) • Austin (TX)

On-site
USD 180,000 - 240,000
Senior GPU Fabric Architect for AI Cloud
Senior GPU Fabric Architect for AI Cloud

Bitdeer • San Jose (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
Senior Network Engineer — AI Infra & HPC Fabric Expert
Senior Network Engineer — AI Infra & HPC Fabric Expert

Nscale • Houston (TX)

On-site
USD 150,000 - 210,000
Competitive benefits package
Flexible paid time off
Parental leave
+1
Senior Slurm & HPC Cluster Engineer
Senior Slurm & HPC Cluster Engineer

Bitdeer Group • San Jose (CA), Austin (TX)

Hybrid
USD 180,000 - 280,000
Senior GPU Systems & Fabric Engineer
Senior GPU Systems & Fabric Engineer

Bitdeer Group • San Jose (CA), Austin (TX)

Hybrid
USD 180,000 - 240,000
Senior HPC Engineer - GPU Compute & InfiniBand
Senior HPC Engineer - GPU Compute & InfiniBand

Nebius • United States

Remote
USD 150,000 - 230,000
Senior GPU Systems & Fabric Engineer
Senior GPU Systems & Fabric Engineer

Bitdeer • San Jose (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000