Senior InfiniBand GPU Cloud Network Architect

Bitdeer; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Bitdeer is seeking an experienced data center networking engineer in Singapore to design and operate InfiniBand and RoCE fabrics for GPU clusters ranging from hundreds to ten thousands of GPUs. You will implement and tune IB/RoCE networks, work with Nvidia/Mellanox hardware, and drive automation for fault prediction and remediation.

You will collaborate across teams to define predictors, monitor fabric health, and convert incidents into learnable examples for the fault-prediction engine.

Qualifications

• 5+ years in data center networking, with at least 3 years focused on InfiniBand or RoCE fabrics
• Hands-on experience deploying and operating Nvidia/Mellanox InfiniBand switches at scale
• Strong understanding of IB subnet management, partitioning, and QoS
• Experience with RoCEv2 deployment including PFC, ECN, DCQCN configuration
• Proficiency with UFM or equivalent IB fabric management tools

Responsibilities

• Xxxxxx InfiniBand fabrics: fat-tree, rail-optimized, and dragonfly topologies for GPU clusters of 100-10,000 GPUs
• RoCEv2 networks across Nvidia, Arista, and Cisco platforms for RDMA workloads
• UFM (Unified Fabric Manager) for IB fabric monitoring, diagnostics, and subnet management
• IB and RoCE performance monitoring and tuning: adaptive routing, congestion control (DCQCN/ECN), traffic isolation
• NCCL communication tuning: topology detection, ring/tree algorithm selection, GDR configuration
• Firmware lifecycle across IB switches and HCAs
• Fault diagnosis: link flaps, symbol errors, packet drops, routing anomalies, credit stalls
• Coordination with Nvidia/Mellanox support for escalations, bugs, and RMA
• Feed the AIOps substrateWire IB/RoCE telemetry into the platform's collection pipeline
• Partner with the platform team to define the Link and Straggler predictors
• Convert every incident into a labeled example the fault-prediction engine can learn from

Skills

InfiniBand networking

RoCE fabrics

NCCL & GPU networking

IB subnet management

PFC/ECN/DCQCN config

Telemetry dashboards

Runbook automation

Tools

ibdiagnet

perfquery

ibstat

PortRcvErrors

Job description

Bitdeer is seeking an experienced data center networking engineer in Singapore to design and operate InfiniBand and RoCE fabrics for GPU clusters ranging from hundreds to ten thousands of GPUs. You will implement and tune IB/RoCE networks, work with Nvidia/Mellanox hardware, and drive automation for fault prediction and remediation.

You will collaborate across teams to define predictors, monitor fabric health, and convert incidents into learnable examples for the fault-prediction engine.