HPC Engineer (Storage)

World Wide Technology, Inc.

India

Remote

INR 900,000 - 1,800,000

Full time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

World Wide Technology, Inc. is seeking an HPC Engineer - Storage to lead deployment of ultra-high-performance parallel file systems for AI infrastructure in India.

You will mount filesystems, tune I/O, and ensure data reaches GPUs at line rate on DGX/HGX nodes using Ansible and NVMe-oF, with CSI drivers and Kubernetes integration. The role emphasizes delivery, benchmarking, and operations, including capacity planning and troubleshooting, with KPIs around throughput, latency, and mount stability.

Qualifications

  • Hands-on operational experience with AI storage platforms (VAST Data, Weka.io, Lustre, or GPFS).
  • Deep Linux I/O knowledge and ability to debug I/O performance with common tools.
  • Experience configuring NVMe-oF or NFS-over-RDMA and networking basics.

Responsibilities

  • Deploy storage clients on bare-metal DGX/HGX nodes using Ansible.
  • Configure RDMA-based protocols to deliver data directly to GPU memory.
  • Install and troubleshoot CSI drivers for dynamic PV provisioning in Kubernetes.
  • Manage complex mount maps and automounter configurations across thousands of nodes.
  • Conduct throughput benchmarks and latency tuning to meet targets.
  • Produce as-built storage validation reports for sign-off.

Skills

Parallel filesystems
Linux I/O
RDMA storage
Ansible storage
Kubernetes storage
GPUDirect

Tools

VAST Data
Weka.io
Lustre
GPFS/Spectrum Scale
NVMe-oF
NFS over RDMA
CSI Drivers

Job description

About the Role

The HPC Engineer - Storage acts as the primary execution engine for the data persistence layer that feeds the AI Factory. While the Domain Architect designs the tiering strategy and namespace layout, you are the "Builder" responsible for mounting filesystems, tuning client-side I/O, and ensuring data reaches the GPUs at line rate. You are a "doer" who is as comfortable compiling a custom kernel module for a parallel filesystem as you are debugging a stale NFS handle.

As a System Integrator, we design and deliver bespoke, high-scale AI factories. In this role, you will move beyond standard enterprise NAS management to execute the deployment of ultra-high-performance parallel file systems for NVIDIA SuperPOD, NVIDIA BasePOD, and Cisco AI Factory environments.

In this role, you will operate with a 100% focus on Delivery , executing the Low-Level Designs (LLD) assigned by your Squad Lead. You will own the "Storage" leg of the critical "Compute-Network-Storage" triad, ensuring that "I/O Wait" never becomes the bottleneck for training jobs.

Key Responsibilities
  1. Storage Integration & Client Configuration
  • Client Provisioning: Execute the deployment of high-performance storage clients (VAST, Weka, GPFS/Spectrum Scale, Lustre) on bare-metal DGX/HGX nodes using Ansible.

  • Protocol Configuration: Configure and tune RDMA-based protocols (NVMe-oF, NFS over RDMA, GPUDirect Storage) to bypass the CPU and deliver data directly to GPU memory.

  • Kubernetes Integration: Install and troubleshoot CSI (Container Storage Interface) drivers to ensure dynamic provisioning of Persistent Volumes (PVs) for AI workloads running in K8s.

  • Mount Management: Manage complex mount maps and automounter configurations to ensure consistent namespace views across thousands of compute nodes.

  1. Validation & Performance Benchmarking
  • Throughput Testing: Execute standard I/O benchmarks to validate that the storage subsystem meets the "Gold Standard" read/write targets (e.g., 400GB/s read throughput).

  • Latency Tuning: Tune client-side kernel parameters (read-ahead buffers, queue depths, sysctl settings) to minimize latency for small-file random I/O patterns common in checkpointing.

  • Acceptance Reporting: Generate "As-Built" storage validation reports, documenting effective throughput and IOPS for client sign-off.

  1. Operations & Support
  • Capacity & Quotas: Implement project-level quotas and monitor usage trends to prevent "Disk Full" outages on critical scratch filesystems.

  • Ticket Resolution: Handle L2 support tickets for storage issues, such as "Stale file handles," "Slow dataset loading," or "CSI Driver crashes."

  • Lifecycle Management: Execute non-disruptive client-side driver upgrades and firmware patches during maintenance windows.

Essential Skills
High-Performance Storage:
  • Parallel Filesystems: Hands-on operational experience with at least one major AI storage platform: VAST Data, Weka.io, DDN Lustre (Exascaler), or IBM GPFS (Spectrum Scale) .

  • Linux I/O Stack: Deep understanding of the Linux VFS (Virtual File System), block devices, and how to debug I/O performance using tools like iostat, iotop, and strace.

  • RDMA Storage: Experience configuring NVMe-over-Fabrics (NVMe-oF) or NFS-over-RDMA, understanding the dependency on the underlying InfiniBand/RoCE network.

Automation & Containerisation:
  • Ansible Storage: Proficiency in writing Ansible playbooks to automate the installation of storage clients and configuration of mount points.

  • Kubernetes Storage: Understanding of StorageClasses , PVCs , and how to debug CSI Driver pods (checking logs for mount failures).

  • GPUDirect: Conceptual understanding of NVIDIA GPUDirect Storage (GDS) and the ability to verify if GDS is active.

Desirable Experience
  • Vendor Specifics: Deep certification or experience with Pure Storage (FlashBlade) or NetApp ONTAP AI configurations.

  • Object Storage: Experience interacting with S3-compatible object stores via CLI for model weight retrieval.

  • Data Migration: Experience using tools like fpsync or rclone to move petabyte-scale datasets between tiers.

Certifications
Highly Desirable:
  • NVIDIA-Certified Associate: AI Infrastructure and Operations (NCA-AIIO)

  • Vendor Certifications:

  • VAST Certified Administrator (VCP-AD1)

  • WEKA Technical Xpert Certification

  • Red Hat Certified Specialist in Storage Administration

Success Metrics (KPIs)
  • I/O Performance: Achieving >95% of the theoretical line-rate throughput on IOR/FIO benchmarks for provisioned clients.

  • Mount Stability: Zero "Stale File Handles" or disconnected mounts across the cluster during the 72-hour burn-in period.

  • Ticket Velocity: Consistently meeting SLAs for storage-related support tickets.

#LI-RB1

WWT will consider for employment, without regard to disability, a disabled applicant who satisfies the requisite skill, experience, education, and other job-related requirements of the job and is capable of performing the essential requirements of the job with or without reasonable accommodation. World Wide Technology is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, sex (including pregnancy), sexual orientation, gender identity, national origin, age, disability, veteran status, genetic information, or other characteristics protected by law. We are committed to working with and providing reasonable accommodations to individuals with disabilities. If you have a disability and you believe you need a reasonable accommodation in order to search for a job opening or to submit an online application, please call 1-800-432-7008 and ask for Human Resources.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

HPC Engineer (Compute)
HPC Engineer (Compute)

World Wide Technology, Inc. • India

Remote
INR 900,000 - 1,500,000
HPC Engineer (Storage)
HPC Engineer (Storage)

World Wide Technology, Inc. • Mumbai

On-site
INR 3,000,000 - 5,200,000
HPC Engineer (Network)
HPC Engineer (Network)

World Wide Technology, Inc. • India

Remote
INR 1,800,000 - 3,600,000
Senior High-Performance Storage Architect – NVIS
Senior High-Performance Storage Architect – NVIS

NVIDIA Corporation • Mumbai

On-site
INR 13,233,000 - 19,849,000
Senior High-Performance Storage Architect - NVIS
Senior High-Performance Storage Architect - NVIS

NVIDIA Corporation • India

On-site
INR 14,409,000 - 20,173,000
Senior High-Performance Storage Architect - NVIS
Senior High-Performance Storage Architect - NVIS

NVIDIA Corporation • Maharashtra

On-site
INR 14,409,000 - 20,173,000
Senior Site Reliability Engineering - Storage
Senior Site Reliability Engineering - Storage

NVIDIA Corporation • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Senior Software Engineer - IT Infrastructure
Senior Software Engineer - IT Infrastructure

NVIDIA Corporation • Bengaluru

On-site
INR 3,000,000 - 5,500,000
HPC Engineer (Compute)
HPC Engineer (Compute)

World Wide Technology, Inc. • Mumbai

On-site
INR 1,500,000 - 4,000,000
HPC Lead
HPC Lead

World Wide Technology, Inc. • India

On-site
INR 3,200,000 - 6,000,000