HPC Operations Engineer

Evergreen Statistical Trading; Bellevue (KY); On-site; USD 180,000 - 220,000; Full time

Job summary

Evergreen is a proprietary trading firm based in Bellevue, Washington. As an HPC Operations Engineer, you will own the day-to-day operation of our research clusters across multiple datacenters and the scheduled workloads our research and trading rely on.

You will work on a modern stack without legacy infrastructure and take on major projects across software and hardware as our HPC footprint expands, collaborating with a hands-on team.

Qualifications

• Linux systems administration on Red Hat-family distros (RHEL, Rocky, AlmaLinux)
• Python for automation and tooling
• Git and versioned configuration management experience
• Prometheus/Grafana monitoring and alerting experience
• Slurm batch scheduler experience including queue config and resource management
• Cluster provisioning tools such as Warewulf or xCAT
• ZFS and parallel filesystems like GPFS or Lustre
• InfiniBand networking experience
• Ability to own critical processes and resolve issues outside business hours
• Hands-on hardware coordination in datacenters
• Ability to diagnose complex production problems under time pressure
• Growth-oriented and collaborative mindset
• Passion for high-performance infrastructure with minimal drama

Responsibilities

• Own day-to-day operation of research clusters across multiple datacenters and scheduled workloads
• Work on a modern stack unencumbered by legacy infrastructure and tackle major projects across software and hardware as HPC footprint grows
• Collaborate with teams to scale and improve HPC performance and reliability

Skills

Linux systems administration

Python scripting

Ownership of critical processes

Team collaboration

Tools

Git

Configuration management

Prometheus

Grafana

Slurm

Warewulf

xCAT

ZFS

GPFS

Lustre

InfiniBand

Job description

Overview

Evergreen is a proprietary trading firm based in Bellevue, Washington. We combine statistical research and technological excellence to trade in global financial markets.

As an HPC Operations Engineer at Evergreen, you will own the day-to-day operation of our research clusters across multiple datacenters, along with the scheduled workloads that our research and trading operations depend on. You will also have the unique opportunity to work on a technology stack that is unencumbered by legacy infrastructure, and to take on substantial projects across both software and hardware as our HPC footprint continues to expand.

Qualifications

• Strong hands-on Linux systems administration experience, particularly with Red Hat-family distributions such as RHEL, Rocky Linux, AlmaLinux, etc.
• Strong proficiency with Python for automation and tooling
• Experience with most of the following:
  • Version control tools, ideally Git, as well as versioned configuration management
  • Monitoring and alerting systems, ideally Prometheus and Grafana
  • Batch schedulers, ideally Slurm, including queue configuration, resource management and troubleshooting
  • Cluster provisioning tools, such as Warewulf, xCAT, etc.
  • ZFS and parallel filesystems, such as GPFS, Lustre, etc.
  • InfiniBand networking
• Ability to own critical processes, design them not to break, and resolve critical issues outside of business hours when they do
• Ability to direct hardware work through datacenter remote hands, and be hands-on when the situation calls for it
• Ability to diagnose complex problems in production systems under time pressure
• Growth-oriented and collaborative mindset; enjoys working within a team
• Passion for high-performance infrastructure that runs correctly and with minimal drama

Annual base salary of $200,000.Additionalsigning and performance bonuses will be provided along withcompany-paidmedical and/or other benefits.

Equal Opportunity

As an equal opportunity employer, Evergreen employs and valuesan equitablework environment. We hope to bring people together from manydifferent backgroundsto create a workplace that is as diverse as the markets we trade.