HPC AI Systems Architect – On-Prem, Secure & Scalable

Murray Resources - Best Staffing Agency; Houston (TX); On-site; USD 100,000 - 140,000; Full time

Benefits offered by this job

401K

Job summary

Murray Resources is seeking an HPC AI Systems Administrator to architect and maintain a robust on-premises compute platform that enables the development team to fine-tune and deploy production‑level ML models, while enforcing enterprise security and data governance policies.

You will lead infrastructure design, containerization (Docker, Apptainer/Singularity), cluster management, and performance tuning on a multi-GPU HPC system, with emphasis on data privacy and Zero Trust standards.

Qualifications

• 3+ years on Linux-based HPC or enterprise GPU infrastructure
• Hands-on with modern enterprise GPU hardware in data centers
• Deep Linux system engineering, containers, and cluster management
• Familiarity with high-throughput networks and enterprise storage systems

Responsibilities

• Infrastructure Architecture & Management: Lead deployment, bare-metal config, maintenance, and optimization of on-prem HPC cluster and multi-GPU architecture.
• Platform Enablement: Manage end-to-end AI software stack, including Linux environments, GPU drivers, runtime libraries (CUDA, NCCL), and containers.
• Developer Sandbox Orchestration: Implement workload scheduling/orchestration (Kubernetes, Slurm) for resource allocation and job prioritization.
• Monitoring & Performance Tuning: Create telemetry and dashboards to track hardware utilization, thermal limits, memory bandwidth; optimize compute.
• Security & Governance Compliance: Enforce data-at-rest and data-in-transit baselines; align with Zero Trust and compliance mandates.
• Vendor Relations & Support: Interface with hardware vendors and integrators for updates and maintenance.

Skills

HPC administration

Linux

GPU infrastructure

Container technologies

Cluster resource management

InfiniBand/RoCE networking

Security governance

CUDA/NCCL

Education

Bachelor's degree in Computer Science/Engineering

Tools

Docker

Apptainer/Singularity

Kubernetes

Slurm

CUDA

NVIDIA drivers

Job description

Murray Resources is seeking an HPC AI Systems Administrator to architect and maintain a robust on-premises compute platform that enables the development team to fine-tune and deploy production‑level ML models, while enforcing enterprise security and data governance policies.

You will lead infrastructure design, containerization (Docker, Apptainer/Singularity), cluster management, and performance tuning on a multi-GPU HPC system, with emphasis on data privacy and Zero Trust standards.