HPC Cluster Engineer: Secure, High-Performance Compute

D2 Technical Services; Springfield (VA); On-site; USD 170,000 - 180,000; Full time

Benefits offered by this job

Health/Dental/Vision

401(k) match

PTO

Job summary

D2 Technical Services is seeking an Infrastructure & Cluster Engineer to manage the administration, health, and performance of a dedicated customer compute cluster. You will ensure a highly available, secure, and optimized hardware foundation for complex AI/ML workloads.

Responsibilities include Linux system administration, patching, and upgrades; configuring workload managers like Run:AI and SLURM; optimizing hardware, storage, and InfiniBand networks; and deploying OpenShift containers with

Qualifications

• 5+ years of experience in Linux systems administration and infrastructure management.

Responsibilities

• Cluster Administration: Manage the day-to-day operations of the customer compute cluster, including Linux operating system administration, hardware monitoring, patching, and system upgrades
• Resource and Job Management: Configure, maintain, and optimize workload management and orchestration platforms, utilizing Run:AI job scheduler to ensure efficient distribution of intensive AI/ML workloads across the cluster
• Infrastructure Optimization: Tune cluster performance at the hardware, operating system, and network levels to maximize compute efficiency and data throughput for customer workloads
• Storage and Network Management: Administer storage solutions and high-speed networking fabrics. Support the transition to and ongoing management of an InfiniBand GPU-to-GPU network infrastructure to minimize latency for distributed operations
• Environment Configuration: Partner with technology integration teams to provision specific environments, dependencies, and container platforms, specifically leveraging Red Hat OpenShift, required for seamless customer model deployment
• Security and Compliance: Ensure all infrastructure components remain compliant with federal security standards, implementing strict access controls and maintaining system accreditations

Skills

Linux administration

OpenShift

Kubernetes

Python

Bash

Run:AI

SLURM

HPC

Tools

InfiniBand

Run:AI

SLURM

OpenShift

Kubernetes

Job description

D2 Technical Services is seeking an Infrastructure & Cluster Engineer to manage the administration, health, and performance of a dedicated customer compute cluster. You will ensure a highly available, secure, and optimized hardware foundation for complex AI/ML workloads.

Responsibilities include Linux system administration, patching, and upgrades; configuring workload managers like Run:AI and SLURM; optimizing hardware, storage, and InfiniBand networks; and deploying OpenShift containers with