HPC Storage Engineer | Experienced Hire

Susquehanna International Group; Philadelphia (Philadelphia County); On-site; USD 130,000 - 190,000; Full time

Job summary

A global quantitative trading firm is seeking an experienced HPC Storage Engineer to optimize storage and data movement within its high-performance computing environment. You will work on parallel filesystems and ensure reliable access to data for compute-intensive workloads. Ideal candidates will have hands-on experience with distributed filesystems, strong Linux skills, and a background in data-intensive applications. This is an opportunity to collaborate in a highly innovative environment focused on advanced quantitative research.

Qualifications

• Hands-on experience in production environments with parallel or distributed filesystems.
• Strong understanding of Linux systems administration.
• Proficiency in large-scale distributed systems (C++ preferred).
• Proficiency in large-scale distributed systems development, preferably in C++.
• Ability to troubleshoot performance and reliability issues across storage and compute stacks.
• Experience with data transfer and movement tools.
• Familiarity with object storage and hierarchical storage management (HSM).
• Experience integrating storage with HPC schedulers (e.g., Slurm).
• Background supporting scientific, ML/AI, or other data-intensive workloads.

Responsibilities

• Design, deploy, and operate HPC storage systems and parallel/distributed filesystems.
• Own data movement workflows, including data ingest and archiving.
• Optimize filesystem performance for large-scale workloads.
• Design and tune load-balancing strategies across storage targets, metadata services, and data movement pipelines.
• Troubleshoot storage, I/O, and data movement issues across HPC compute clusters.
• Develop and maintain automation for storage provisioning, monitoring, and lifecycle management.
• Partner with compute and networking teams to ensure end-to-end performance and reliability.
• Advise users and application teams on best practices for I/O patterns, data layout, and performance tuning.
• Evaluate and integrate new storage technologies and architectures as requirements evolve.

Skills

Hands-on experience with parallel or distributed filesystems

Strong understanding of Linux systems administration

Experience with high-performance I/O optimization

Proficiency in large-scale distributed systems development

Troubleshoot performance and reliability issues

Experience with data transfer tools

Familiarity with object storage

Experience integrating storage with HPC schedulers

Background supporting data-intensive workloads

Job description

Overview

We are looking for an experienced HPC Storage Engineer to design, implement, and optimize the storage and data movement infrastructure that underpins our high-performance computing (HPC) environment. This role focuses on distributed and parallel filesystems, storage systems, and large-scale data movement, ensuring reliable, high-throughput access to data for compute-intensive workloads. You will work closely with HPC platform engineers, compute and networking teams, and application users to deliver scalable, performant, and resilient storage solutions that tightly integrate the storage layer with compute nodes.

In This Role, You Will

• Design, deploy, and operate HPC storage systems and parallel/distributed filesystems (e.g., Lustre, GPFS/IBM Spectrum Scale, BeeGFS, Ceph).
• Own data movement workflows across environments, including data ingest, replication, tiering, and archiving.
• Optimize filesystem and storage performance for large-scale parallel workloads.
• Design and tune load-balancing strategies across storage targets, metadata services, and data movement pipelines to ensure even utilization, high throughput, and predictable performance at scale.
• Troubleshoot storage, I/O, and data movement issues across HPC compute clusters.
• Develop and maintain automation for storage provisioning, monitoring, and lifecycle management.
• Partner with compute and networking teams to ensure end-to-end performance and reliability.
• Advise users and application teams on best practices for I/O patterns, data layout, and performance tuning.
• Evaluate and integrate new storage technologies and architectures as requirements evolve.

What We're Looking For

• Hands-on experience with parallel or distributed filesystems in production environments.
• Strong understanding of Linux systems administration.
• Experience with high-performance I/O, data locality, and throughput optimization.
• Proficiency in large-scale distributed systems development, preferably in C++.
• Proven ability to troubleshoot complex performance and reliability issues across storage and compute stacks.
• Experience with data transfer and movement tools.
• Familiarity with object storage and hierarchical storage management (HSM).
• Experience integrating storage with HPC schedulers (e.g., Slurm) and compute workflows.
• Background supporting scientific, ML/AI, or other data-intensive workloads.

About Susquehanna

Susquehanna is a global quantitative trading firm powered by scientific rigor, curiosity, and innovation. Our culture is intellectually driven and highly collaborative, bringing together researchers, engineers, and traders to design and deploy impactful strategies in our systematic trading environment. To meet the unique challenges of global markets, Susquehanna applies machine learning and advanced quantitative research to vast datasets in order to uncover actionable insights and build effective strategies. By uniting deep market expertise with cutting-edge technology, we excel in solving complex problems and pushing boundaries together.

If you're a recruiting agency and want to partner with us, please reach out to [e-mail] . Any resume or referral submitted in the absence of a signed agreement will not be eligible for an agency fee.