Senior HPC Systems Engineer - Linux & Scale

P2P; Sydney; On-site; AUD 140,000 - 190,000; Full time

Job summary

Jump Trading Group in Sydney seeks an HPC Systems Engineer to design, deploy, and operate high performance compute and storage systems for research data pipelines and global projects.

You will work with researchers to optimize HPC usage, implement monitoring tooling, and maintain scalable production environments, drawing on Linux systems administration and scripting skills.

Qualifications

• 5+ years in HPC environments or equivalent experience.
• Experience with large-scale compute and storage systems.
• Strong Linux administration and scripting skills.

Responsibilities

• Design, implement, maintain, and support HPC compute/storage systems.
• Implement and support performance and fault monitoring.
• Monitor system and storage performance incl. networks.
• Build tooling to package and upgrade software at scale.
• Collaborate to write code and testing infrastructures in multiple languages.
• Develop and improve user and technical documentation.
• Participate in large maintenance operations, including evenings/weekends.
• Work on global projects across infrastructure.
• Collaborate with researchers to optimize HPC usage.
• Develop and monitor tools for production environment.
• Provide operational support on rotation.
• Manage relationships with vendors, travel domestically and internationally.
• Adhere to cybersecurity and IT policies using approved hardware/software.

Skills

HPC experience

Lustre/GPFS

Slurm/Grid Engine

Linux administration

Go/Python/C

Distributed systems

Debugging/profiling

CM Tools (Salt/Ansible)

Analytical mindset

Job description

Jump Trading Group is committed to world class research. We empower exceptional talents in Mathematics, Physics, and Computer Science to seek scientific boundaries, push through them, and apply cutting edge research to global financial markets. Our culture is unique. Constant innovation requires fearlessness, creativity, intellectual honesty, and a relentless competitive streak. We believe in winning together and unlocking unique individual talent by incenting collaboration and mutual respect. At Jump, research outcomes drive more than superior risk adjusted returns. We design, develop, and deploy technologies that change our world, fund start-ups across industries, and partner with leading global research organizations and universities to solve problems.

Our global High Performance Computing Team is looking to add an HPC Systems Engineer in our Sydney office. The scale of our computing environments provides unique challenges in providing good performance and reliability. Several systems including compute, scheduling, networks, and large-scale data storage must integrate seamlessly to support data pipelines and quantitative research. The ideal candidate would be a hands-on individual, highly skilled in the details and nuances of managing Linux environments with a strong software development background necessary to support uniquely customized systems at scale.

What You'll Do:

• Design, implement, maintain, and support high performance compute and storage systems
• Implement and support performance monitoring and fault monitoring systems
• Monitor systems and storage performance, up to and including network components
• Build tooling to compile, package, install, and upgrade software and operating system components at scale
• Collaborate with team members and across teams to write code and testing infrastructures spanning both new and existing codebases in multiple programming languages
• Develop and improve systems and user documentation
• Participate in large, coordinated maintenance operations, including during evenings and weekends.
• Work on global projects across a wide range of infrastructure
• Collaborate directly with researchers to optimize their use of HPC infrastructure
• Develop and monitor the tools used to maintain a production computing environment
• Provide operational support on a rotating basis and as needed
• Manage relationships with outside vendors, including traveling both domestically and internationally to meet with current and potential vendors
• Adhere to all company cybersecurity and IT policies, including performing all work using only approved hardware and software Other duties as assigned or needed

Skills You'll Need:

• 5+ years of professional experience in high performance computing (HPC), including parallel filesystems (e.g., Lustre, GPFS), batch systems (e.g., Slurm, Grid Engine), and high-performance network interconnects experience is a plus, but not required
• 5+ years of experience with Linux systems administration
• High proficiency with at least one programming/scripting language (e.g., Go, Python, C)
• Extensive experience designing, building, and maintaining complicated, interdependent, and distributed systems
• Extensive experience profiling and debugging application stacks (debuggers and profilers)
• Experience with system configuration management tools (SaltStack, Ansible, Puppet, etc.)
• A compulsion to perform root cause analysis
• Reliable and predictable availability

If you are currently a student or recent graduate, please see our Campus postings which offer both intern and full-time opportunities.