AI Storage Solutions Expert

Bitdeer; San Jose (CA); Hybrid; USD 140,000 - 210,000; Full time

Job summary

Bitdeer Technologies Group seeks an experienced storage operations engineer to own and optimize AI training storage across our GPU-centric fabric. You will design parallel storage architectures, enforce multi-tenant QoS, and tune high-performance networks for low-latency data paths in a fast-moving AI environment.

You will instrument telemetry, drive predictors for storage faults, and convert incidents into automated remediation.

Qualifications

• 5+ years in enterprise or HPC storage operations, with at least 2 years supporting AI/ML workloads.
• Hands-on deployment and operations experience with WEKA, VAST Data, Ceph, or DDN/Lustre.
• Strong understanding of AI training I/O patterns: checkpoint frequency, dataset loading, and shuffle buffers.
• Experience with high-performance storage networking (NFS over RDMA, NVMe-oF).
• Knowledge of GPU Direct Storage and RDMA-based data transfer.
• Proficiency in storage performance benchmarking and tuning (fio, IOR, mdtest).
• Experience implementing multi-tenant storage with isolation and QoS.
• Strong Linux systems knowledge (kernel tuning, filesystem internals, block device management).
• Runbook-as-code mindset — executable SOPs within a quarter.

Responsibilities

• Deploy and operate parallel/distributed storage systems: WEKA, VAST Data, Ceph, DDN/Lustre; design AI-friendly storage architectures.
• Implement multi-tenant storage isolation with per-tenant QoS, quotas, and access controls; optimize GPU Direct Storage paths.
• Deploy and manage storage networking (NFS over RDMA, NVMe-oF) and Nvidia CMX for cluster-wide storage orchestration.
• Diagnose and tune storage performance: IOPS, throughput, latency profiling with fio, IOR, mdtest; maintain runbooks.
• Plan storage capacity aligned with GPU cluster growth and customer workloads; manage firmware, data migration, and DR procedures.
• Instrument storage telemetry — IO tail latency, checkpoint durations, NVMe SMART, filesystem health, RDMA counters.
• Partner with the platform team to define the storage-fault predictor and signal labeling.
• Convert incidents into automation: SOPs become runbook-as-code, runbook-as-code becomes agent remediation.

Skills

AI/ML storage patterns

Linux systems

Storage benchmarking

I/O performance tuning

Multi-tenant QoS

GPU Direct Storage

RDMA networking

Tools

WEKA

VAST Data

Ceph

DDN/Lustre

fio

mdtest

Job description

About Bitdeer Technologies Group

Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers and building AI computational infrastructure to support the AI revolution. Bitdeer handles complex processes involved in computing such as equipment procurement, transport logistics, data center design and construction, equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer has deployed data centers across multiple countries, including the United States, Norway, Bhutan, and Ethiopia. To learn more, visit https://ir.bitdeer.com/

Position Overview

You own the IO layer that trains the models — and the signals we need to predict storage faults before a checkpoint stalls a $50M training run.

Bitdeer is building an AI-operated GPU cloud. Storage is where AI workloads either fly or fall over: a slow parallel read can starve a 1,000-GPU job; a stalled checkpoint can waste a full training epoch. In this role you deploy and operate the high-performance storage layer for AI training and inference across NeoCloud's US DCs, and you feed the AIOps substrate with the signals it needs to catch storage regressions before they page a customer.

What you'll own

• Deploy and operate parallel/distributed storage systems: WEKA, VAST Data, Ceph, DDN/Lustre. Design storage architectures optimized for AI workload patterns — checkpoint I/O bursts, sequential dataset reads, KV cache for inference.
• Implement multi-tenant storage isolation with per-tenant QoS, quotas, and access controls; configure and optimize GPU Direct Storage for direct GPU-to-storage data paths.
• Deploy and manage storage networking (NFS over RDMA, NVMe-oF, high-speed storage fabrics) and Nvidia CMX for cluster-wide storage orchestration.
• Diagnose and tune storage performance: IOPS, throughput, latency profiling with fio, IOR, mdtest; own the runbook for common failure modes.
• Plan storage capacity aligned with GPU cluster growth and customer workload projections; manage firmware, data migration, and DR procedures.

Feed the AIOps substrate

• Instrument storage telemetry — IO tail latency, checkpoint durations, NVMe SMART, filesystem health, RDMA counters — into the metrics/logs/traces store the platform team runs.
• Partner with the platform team to define the storage-fault predictor: which signals, which labels (from your incidents), which false-positive tolerances.
• Convert every novel incident into an automation: SOPs become runbook-as-code, runbook-as-code becomes an agent-executable remediation.

What success looks like in year 1

• Observability and a baseline predictor for the top 3 storage-fault classes on our fabric.
• Storage-incident MTTR measurably lower than at hire.
• The Nvidia GB200-class clusters we build out ship on your storage design.

Job Requirement:

• 5+ years in enterprise or HPC storage operations, with at least 2 years supporting AI/ML workloads
• Hands-on deployment and operations experience with at least two of: WEKA, VAST Data, Ceph, DDN/Lustre
• Strong understanding of AI training I/O patterns: checkpoint frequency, dataset loading, shuffle buffers
• Experience with high-performance storage networking (NFS over RDMA, NVMe-oF)
• Knowledge of GPU Direct Storage and RDMA-based data transfer
• Proficiency in storage performance benchmarking and tuning (fio, IOR, mdtest)
• Experience implementing multi-tenant storage with isolation and QoS
• Strong Linux systems knowledge (kernel tuning, filesystem internals, block device management)
• Instinct for turning ops toil into ML signal — you've either shipped an anomaly detector for storage/IO telemetry or you can articulate the labels and features you'd need to.
• Runbook-as-code mindset — every SOP you write should be executable by a machine within a quarter.

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.