HPC Storage Engineer

Hudson River Trading; City Of London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading trading technology firm in the City of London is seeking an experienced Storage Engineer to manage and improve its research environment's storage infrastructure. You will design innovative storage solutions, troubleshoot complex issues, and enhance storage cluster performance. Ideal candidates should have over 5 years of HPC experience, strong Linux skills, and a passion for technology improvement.

Qualifications

• 5+ years of experience in HPC-like environments with large-scale storage deployments greater than 1PB.
• 3+ years of experience with scale-out enterprise storage solutions such as Isilon, VAST, NetApp, and Pure.
• Strong knowledge of Linux software RAID, ZFS, and other Linux filesystems.

Responsibilities

• Design and manage a variety of storage solutions.
• Research and experiment with new storage solutions.
• Troubleshoot complex storage, OS, and networking issues.
• Build tools to improve the performance and monitoring of storage clusters.

Skills

Distributed file systems knowledge

NAS storage design

Experience in HPC environments

Experience with enterprise storage solutions

Linux troubleshooting

Knowledge of Linux software RAID and ZFS

Python proficiency

Strong communication skills

Problem-solving skills

Time management

Eager to learn

Job description

The R&D team at Hudson River Trading (HRT) builds and maintains the computers, networks, data storage, operating systems, and software that allow our trading strategies and research environment to operate worldwide 24/7. The team manages over 100 petabytes of storage to facilitate industry-leading AI/ML-based trading.

We are seeking an experienced Storage Engineer who enjoys being challenged, appreciates an open and collaborative organizational structure, and thrives in a fast-paced environment. In this role, you will manage our existing storage infrastructure and be responsible for the design, automation, and management of future storage solutions to support our large-scale research environment. This is an exciting opportunity to join a small team focused on HPC storage and help set the direction for storage solutions at HRT. You’ll have plenty of freedom to research, propose, and test new hardware and software to improve the performance and usability of our research environment.

Responsibilities

• Design and manage a variety of storage solutions
• Research and experiment with new storage solutions
• Troubleshoot complex storage, OS, and networking issues
• Build tools to improve the performance and monitoring of storage clusters

Qualifications

• Knowledge of distributed file systems used for large-scale cluster computing (Lustre, CephFS, GPFS, etc.)
• Ability to design a home grown NAS storage solution with redundancy and high availability
• 5+ years of experience in HPC-like environments with large scale storage deployments greater than 1PB
• 3+ years of experience with scale-out enterprise storage solutions such as Isilon, VAST, NetApp, and Pure
• Extensive experience with Linux troubleshooting and NFS
• Strong knowledge of Linux software RAID, ZFS, and other Linux filesystems
• Proficient in Python and shell scripting
• Strong cross-functional communication skills
• Ability to analyze and solve problems quickly in a fast-paced environment
• Exceptional time management skills and the ability to balance independent and collaborative workflows
• Eager to learn and apply new skills

Culture

Hudson River Trading (HRT) brings a scientific approach to trading financial products. We have built one of the world's most sophisticated computing environments for research and development. Our researchers are at the forefront of innovation in the world of algorithmic trading.

At HRT we welcome a variety of expertise: mathematics and computer science, physics and engineering, media and tech. We’re a community of self-starters who are motivated by the excitement of being at the cutting edge of automation in every part of our organization—from trading, to business operations, to recruiting and beyond. We value openness and transparency, and celebrate great ideas from HRT veterans and new hires alike. At HRT we’re friends and colleagues – whether we are sharing a meal, playing the latest board game, or writing elegant code. We embrace a culture of togetherness that extends far beyond the walls of our office.

Feel like you belong at HRT? Our goal is to find the best people and bring them together to do great work in a place where everyone is valued. HRT is proud of our diverse staff; we have offices all over the globe and benefit from our varied and unique perspectives. HRT is an equal opportunity employer; so whoever you are we’d love to get to know you.