HPC AI Systems Architect (On-Prem GPU Cluster)

MRE Consulting; Houston (TX); On-site; USD 95,000 - 140,000; Full time

Job summary

MRE Consulting in Houston seeks a HPC AI Systems Administrator to architect a secure, scalable on-prem HPC compute platform, enabling your development teams to fine-tune and deploy production ML models. You will lead deployment, manage multi-GPU hardware, and oversee Linux, GPU drivers, CUDA, NCCL, containers, and orchestration tools, ensuring performance and security.

This role requires 3+ years in HPC or enterprise GPU infra, strong Linux, and experience with Slurm/Kubernetes, InfiniBand

Qualifications

• 3+ years of dedicated systems administration experience managing Linux-based HPC environments or enterprise-scale GPU infrastructure.
• Hands-on experience configuring and maintaining modern enterprise GPU hardware (NVIDIA Ampere or Hopper) in a data center context.
• Deep expertise in Linux system engineering, container technologies (Docker, Apptainer/Singularity), and cluster resource management.
• Solid baseline knowledge of high-throughput networking fabrics (InfiniBand/RoCE) and parallel or distributed enterprise storage systems.
• Bachelor’s degree in computer science, Computer Engineering, System Administration, or equivalent practical industry experience.

Responsibilities

• Infrastructure Architecture & Management: Lead deployment, bare-metal configuration, maintenance, and optimization of our on-premises HPC cluster and multi-GPU architecture.
• Platform Enablement: Manage the end-to-end AI software stack, including Linux OS environments, specialized GPU drivers, runtime libraries (CUDA, NCCL), and containerization platforms.
• Developer Sandbox Orchestration: Implement and maintain workload scheduling and orchestration systems (e.g., Kubernetes, Slurm, or equivalent enterprise platforms) to manage cluster resource allocation and job prioritization for engineering teams.
• Monitoring & Performance Tuning: Establish automated telemetry and monitoring dashboards to track hardware utilization, thermal limits, and memory bandwidth, ensuring maximum compute efficiency.
• Security & Governance Compliance: Operationalize strict data-at-rest and data-in-transit security baselines, ensuring the compute environment aligns with corporate Zero Trust network architecture and compliance mandates.
• Vendor Relations & Support: Act as the primary technical interface for high-end hardware vendors and system integrators to manage system updates and platform maintenance.

Skills

Linux HPC admin

GPU infrastructure

Container tech

Cluster management

Networking InfiniBand

Storage systems

Education

Bachelor’s degree in CS/CE/Systems Admin

Tools

Docker

Apptainer/Singularity

Kubernetes

Slurm

NVIDIA GPUs

Job description

MRE Consulting in Houston seeks a HPC AI Systems Administrator to architect a secure, scalable on-prem HPC compute platform, enabling your development teams to fine-tune and deploy production ML models. You will lead deployment, manage multi-GPU hardware, and oversee Linux, GPU drivers, CUDA, NCCL, containers, and orchestration tools, ensuring performance and security.

This role requires 3+ years in HPC or enterprise GPU infra, strong Linux, and experience with Slurm/Kubernetes, InfiniBand