Senior AI Storage Infrastructure Engineer

Bitdeer; San Jose (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Bitdeer seeks a Senior AI Storage Infrastructure Engineer to build the data-delivery fabric for NeoCloud, ensuring GPUs are continuously fed with data during large-scale training and inference. You will work at the intersection of distributed storage, kernel I/O, and Kubernetes to create low-latency, scalable storage pipelines.

You will implement CSI drivers, GPUDirect Storage, and local NVMe caching, while optimizing IOPS and latency across the stack, and mentoring colleagues on reliable,

Qualifications

• 5+ years of experience in distributed storage systems and high-performance file systems.
• Deep expertise in Kubernetes CSI paradigm and storage operators.
• Strong Linux kernel I/O tuning and block/file I/O experience.
• Familiarity with RDMA/InfiniBand/RoCE networks and storage subsystems.
• Experience with Terraform, Ansible, and CI/CD pipelines.
• Excellent technical communication and cross-functional influence.

Responsibilities

• Design, deploy, and maintain CSI drivers for high-performance file systems.
• Integrate GPUDirect Storage to enable DMA between NVMe and GPU memory.
• Develop local NVMe caching strategies for model weights and datasets.
• Optimize IOPS, throughput, and latency across the containerized storage stack.
• Collaborate with GPU Systems & Fabric team to optimize for RDMA and high-speed interconnects.
• Implement monitoring and alerting for storage performance and prevent I/O contention.
• Define storage policies, quotas, and multi-tenancy within Kubernetes.

Skills

Distributed storage

Kubernetes CSI

Linux kernel I/O

High-performance I/O

Infra automation

CI/CD pipelines

Communication skills

Education

Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field

Tools

Terraform

Ansible

CI/CD tooling

Job description

• Full-Time
• AI Cloud
• San Jose, CA / Austin, TX - Remote (within locations)

Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers and building AI computational infrastructure to support the AI revolution. Bitdeer handles complex processes involved in computing such as equipment procurement, transport logistics, data center design and construction, equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer has deployed data centers across multiple countries, including the United States, Norway, Bhutan, and Ethiopia.
To learn more, visit https://ir.bitdeer.com/

We are seeking a Senior AI Storage Infrastructure Engineer to build the critical data-delivery fabric of our AI-native NeoCloud. AI model training and inference are profoundly I/O intensive; you will be responsible for architecting high-performance storage solutions that eliminate bottlenecks and ensure GPUs are constantly saturated with data. This role sits at the intersection of distributed storage, kernel-level I/O, and Kubernetes orchestration. You will design the pathways—from NVMe-backed local caching for massive LLM weights to parallel file system integration—that enable seamless, low-latency access for large-scale distributed training and inference workloads.

Key Responsibilities

• Design, deploy, and maintain robust Container Storage Interface (CSI) drivers for high-performance parallel file systems (e.g., Weka, Lustre, DAOS, VAST).
• Architect and implement GPUDirect Storage (GDS) integrations to enable direct memory access (DMA) between NVMe drives and GPU memory, bypassing CPU bottlenecks.
• Develop and manage local NVMe caching strategies for rapid, low-latency loading of massive model weights and datasets during distributed training.
• Optimize IOPS, throughput, and latency profiles across the entire containerized storage stack, from the storage array to the container runtime.
• Collaborate with the GPU Systems & Fabric team to ensure the storage layer is fully optimized for RDMA and high-speed interconnects (InfiniBand, RoCE).
• Implement automated monitoring and alerting for storage performance, detecting and mitigating I/O contention or hardware degradation before it impacts production jobs.
• Define storage policies, quota management, and multi-tenancy isolation strategies within Kubernetes to ensure fair resource sharing for customer workloads.
• Mentor junior engineers and drive architectural design reviews to maintain high standards of reliability and performance across the infrastructure team.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.
• 5+ years of experience in distributed storage systems and high-performance file systems, with a deep understanding of POSIX compliance and file I/O semantics.
• Deep expertise in the Kubernetes CSI paradigm, including building or extending volume plugins and storage operators.
• Strong hands-on experience with block/file I/O at the Linux OS level and kernel-level performance tuning.
• Familiarity with high-throughput networking protocols (RDMA, InfiniBand, RoCE) and how they interact with storage subsystems.
• Proven track record of operating, debugging, and scaling large-scale storage environments in production or HPC settings.
• Experience with infrastructure automation tools (e.g., Terraform, Ansible) and CI/CD pipelines.
• Excellent technical communication skills, with the ability to influence cross-functional architectural decisions.
• Experience working in high-velocity, high-growth engineering environments is strongly preferred.

--------------------------------------------------------------------

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.