Sr. GPU Cloud East-West Network Expert (SRE SME)

Bitdeer; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Bitdeer is seeking an experienced data center networking engineer in Singapore to design and operate InfiniBand and RoCE fabrics for GPU clusters ranging from hundreds to ten thousands of GPUs. You will implement and tune IB/RoCE networks, work with Nvidia/Mellanox hardware, and drive automation for fault prediction and remediation.

You will collaborate across teams to define predictors, monitor fabric health, and convert incidents into learnable examples for the fault-prediction engine.

Qualifications

• 5+ years in data center networking, with at least 3 years focused on InfiniBand or RoCE fabrics
• Hands-on experience deploying and operating Nvidia/Mellanox InfiniBand switches at scale
• Strong understanding of IB subnet management, partitioning, and QoS
• Experience with RoCEv2 deployment including PFC, ECN, DCQCN configuration
• Proficiency with UFM or equivalent IB fabric management tools

Responsibilities

• Xxxxxx InfiniBand fabrics: fat-tree, rail-optimized, and dragonfly topologies for GPU clusters of 100-10,000 GPUs
• RoCEv2 networks across Nvidia, Arista, and Cisco platforms for RDMA workloads
• UFM (Unified Fabric Manager) for IB fabric monitoring, diagnostics, and subnet management
• IB and RoCE performance monitoring and tuning: adaptive routing, congestion control (DCQCN/ECN), traffic isolation
• NCCL communication tuning: topology detection, ring/tree algorithm selection, GDR configuration
• Firmware lifecycle across IB switches and HCAs
• Fault diagnosis: link flaps, symbol errors, packet drops, routing anomalies, credit stalls
• Coordination with Nvidia/Mellanox support for escalations, bugs, and RMA
• Feed the AIOps substrateWire IB/RoCE telemetry into the platform's collection pipeline
• Partner with the platform team to define the Link and Straggler predictors
• Convert every incident into a labeled example the fault-prediction engine can learn from

Skills

InfiniBand networking

RoCE fabrics

NCCL & GPU networking

IB subnet management

PFC/ECN/DCQCN config

Telemetry dashboards

Runbook automation

Tools

ibdiagnet

perfquery

ibstat

PortRcvErrors

Job description

About Bitdeer:

Bitdeer is a world-leading technology company for Bitcoin mining and AI cloud.Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers. Apart from designing industry-leading ASIC chips and manufacturing mining rigs, the Group handles complex processes involved in computing across the value chain. This includes equipment procurement, transport logistics, datacenter design and construction, equipment management, and network and facility operations. Bitdeer also offers advanced cloud capabilities to customers with a high demand for artificial intelligence.Headquartered in Singapore, Bitdeer operates globally with a diversified 3 GW energy portfolio, and deploys Bitcoin mining and HPC datacenters in the United States, Bhutan, Norway, Canada, Malaysia, and Ethiopia.

What you will be responsible for:

• XxxxxxxInfiniBand fabrics: fat-tree, rail-optimized, and dragonfly topologies for GPU clusters of 100-10,000 GPUs.
• RoCEv2 networks across Nvidia, Arista, and Cisco platforms for RDMA workloads.
• UFM (Unified Fabric Manager) for IB fabric monitoring, diagnostics, and subnet management.
• IB and RoCE performance monitoring and tuning: adaptive routing, congestion control (DCQCN/ECN), traffic isolation.
• NCCL communication tuning: topology detection, ring/tree algorithm selection, GDR configuration.
• Firmware lifecycle across IB switches and HCAs.
• Fault diagnosis: link flaps, symbol errors, packet drops, routing anomalies, credit stalls.
• Coordination with Nvidia/Mellanox support for escalations, bugs, and RMA.
• Feed the AIOps substrateWire IB/RoCE telemetry (ibdiagnet, perfquery, ibstat, PortRcvErrors, PortXmitDiscards, adaptive-routing state) into the platform's collection pipeline.
• Partner with the platform team to define the Link and Straggler predictors: what a "bad optic 30 minutes from failure" looks like in the counters.
• Convert every incident into a labeled example the fault-prediction engine can learn from — and every routine mitigation into a workflow the remediation actuator can run.

How you will stand out:

• 5+ years in data center networking, with at least 3 years focused on InfiniBand or RoCE fabrics
• Hands-on experience deploying and operating Nvidia/Mellanox InfiniBand switches at scale
• Strong understanding of IB subnet management, partitioning, and QoS
• Experience with RoCEv2 deployment including PFC, ECN, DCQCN configuration
• Proficiency with UFM or equivalent IB fabric management tools
• Knowledge of 400G/800G optics, cabling standards, and structured cabling best practices
• Experience diagnosing IB/RoCE network issues using ibdiagnet, perfquery, ibstat, and similar tools
• Understanding of NCCL and how GPU communication maps to network topology
• Instinct for telemetry-driven ops — you've either built dashboards/alerts on RDMA counters at scale, or you can articulate the feature set a fabric-health model would need
• Runbook-as-code mindset — the diagnostics you run today should become automation next quarter

What you will experience working with us:

• A culture that values authenticity and diversity of thoughts and backgrounds
• An inclusive and respectable environment with open workspaces and exciting start-up spirit
• Fast-growing company with the chance to network with industrial pioneers and enthusiasts
• Ability to contribute directly and make an impact on the future of the digital asset industry
• Involvement in new projects, developing processes/systems
• Personal accountability, autonomy, fast growth, and learning opportunities
• Attractive welfare benefits and developmental opportunities such as training and mentoring

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, colour, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.