HPC Data Management Engineer

Aditi Consulting; Greenville (SC); On-site; USD 80,000 - 81,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

Health savings accounts with qualified

10 paid days off

401(k) with employer match

Commuter benefits

Job summary

Aditi Consulting is seeking an HPC Storage & Data Management Engineer to design, administer, and optimize storage for a high-performance, AWS-based HPC platform supporting 1,500 global users across engineering simulations.

The role collaborates with the Digital Technology team on storage operations and data lifecycle management, emphasizing secure, scalable data handling and AI-ready formats for science workloads.

Qualifications

• Experience administering HPC storage in production environments.
• Experience with quota management and capacity planning.
• Familiarity with multi-protocol (NFS/SMB) environments and ACLs.
• Experience with AWS or cloud-hybrid storage (S3, FSx, EFS).
• DevOps / Infrastructure as Code in storage operations.
• Familiarity with engineering simulation data storage patterns and Slurm usage.

Responsibilities

• Manage and optimize HPC storage topology including home directories, scratch/compute, project storage and archive tiers.
• Administer per-user and per-project quotas and forecast capacity.
• Manage file permissions and ACLs across NFS/SMB for Linux HPC and Windows VDI.
• Contribute to storage cost benchmarking and reporting in AWS environments.
• Define data lifecycle policies and automated tiering/expiration workflows.
• Lead archival standards for engineering simulation data; align with retention strategy.
• Collaborate with DT to define storage governance and shared folder structures.
• Support AI readiness for engineering simulation data standards.

Skills

HPC storage administration

Lustre/GPFS experience

NFS/SMB ACL management

Linux administration

AWS / cloud storage

DevOps / IaC

Slurm familiarity

Education

Bachelors or higher in a technical field

Tools

Lustre

GPFS/IBM Spectrum Scale

BeeGFS

WekaIO

S3FS

FSx for Lustre

EFS

Job description

Payrate

$58.00 - $58.10/hr

Summary

The HPC Storage & Data Management Engineer is a dedicated infrastructure specialist responsible for the design, administration, and ongoing optimization of storage environments within company's enterprise-scale, AWS-based HPC platform. This role exists within ADT but operates in close collaboration with the Digital Technology (DT) team in storage operations and data lifecycle management. The engineer serves approximately 1,500 global users supporting engineering simulation workloads across Gas Power and broader business units.

Responsibilities

• Storage Architecture & Optimization: Manage and optimize the full HPC storage topology including home directories, high-performance local scratch/compute, project storage, and archive tiers; ensure appropriate data placement aligned with workload performance requirements.
• Quota & Capacity Management: Administer and enforce per-user and per-project storage quotas; monitor utilization trends across the user base and provide capacity forecasting inputs to the HPC Principal Engineer and DT team.
• Dual-Protocol File Permission Management: Manage file permissions and access control lists (ACLs) across multi-protocol (NFS/SMB) environments, ensuring consistent access governance for both Linux HPC and Windows VDI users.
• Cost Visibility & Reporting: Contribute to storage cost benchmarking and reporting, providing data-driven insight into storage spend within the AWS environment.
• Data Lifecycle Management: Define and enforce data lifecycle policies governing the progression of data through active, scratch, cold, and archive states; implement and maintain automated tiering and expiration workflows.
• Archiving & Retention Strategy: Lead the definition and implementation of an engineering simulation data archival standard; ensure alignment with the broader engineering simulation data retention strategy.
• Collaborative Storage Governance: Partner with DT to define and maintain collaborative team and project folder structures; establish and communicate standard work for shared HPC storage use.
• AI Readiness Enablement: Support the organization's initiative to define engineering simulation data standards that ensure data is structured and accessible for AI/ML workloads.

Skills and Qualifications

• Demonstrated ability to develop and document standard operating procedures
• Experience in HPC storage administration in a prod
• Experience with quota management systems and storage capacity planning
• Expertise in high performance parallel/distributed file systems ("e.g., Lustre, GPFS/IBM Spectrum Scale, BeeGFS, WekaIO, or similar")
• Proficiency in storage tiering, data lifecycle management, and archival tooling
• Solid Linux systems administration skills
• Strong experience with NFS and SMB/CIFS dual permission/ACL management
• Experience in an AWS or cloud hybrid storage environment (S3, FSx for Lustre, EFS)
• Experience working within a DevOps or collaborative Infrastructure as Code model
• Familiarity with engineering simulation data (CFD, FEA, or similar) and associated file size/storage patterns
• Familiarity with Slurm job scheduler in the context of scratch and burst storage

Pay Transparency

• The typical base pay for this role across the U.S. is: $58.00 - $58.10/hr. Non-exempt positions are eligible for overtime at a rate of 1.5 times the base hourly rate for all hours worked in excess of 40 in a work week, or as required by state or local law. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education and experience. Full-time employees are eligible to select from different benefits packages. Packages may include medical, dental, and vision benefits, health savings accounts with qualified medical plan enrollment, 10 paid days off, 3 days paid bereavement leave, 401(k) plan participation with employer match, life and disability insurance, commuter benefits, dependent care flexible spending account, accident insurance, critical illness insurance, hospital indemnity insurance, accommodations and reimbursement for work travel, and discretionary performance or recognition bonus. Sick leave and mobile phone reimbursement provided based on state or local law.