Senior GPU Infrastructure Architect - Remote & Equity

Prime Intellect; United States; Hybrid; USD 150,000 - 300,000; Full time

Benefits offered by this job

Remote work option

Equity incentives

Professional development budget

Team off-sites & conferences

Visa sponsorship & relocation support

Job summary

Prime Intellect is looking for a Role overview expert to design and deploy GPU infrastructure for large-scale AI training, inference, and HPC workloads. This customer-facing role blends cluster architecture with hands-on implementation, performance tuning, and on-call support across hardware and software.

You will translate workload needs into GPU cluster architectures, optimize production clusters with SLURM and Kubernetes, and contribute to capacity planning for deployments spanning hundreds

Qualifications

• Hands-on experience with GPU clusters and HPC environments (3+ years).
• Production experience with SLURM and Kubernetes; InfiniBand configuration/troubleshooting.
• Strong knowledge of NVIDIA GPUs, CUDA, drivers, and GPU container runtimes.
• Experience with infrastructure automation (Ansible, Terraform) and scripting (Python, Bash).
• Knowledge of Linux performance tuning, AI network topologies, and power/cooling for dense GPUs.
• Proven customer-facing technical leadership and ability to resolve complex infra issues.

Responsibilities

• Translate workload needs into GPU cluster architectures and capacity plans for deployments ranging from hundreds to thousands of GPUs.
• Recommend and implement infrastructure for training, inference, and HPC workloads, including orchestration and high‑speed interconnects.
• Configure and optimize production clusters using SLURM, Kubernetes, GPU drivers, and container runtimes.
• Diagnose issues across hardware, Linux, networking, drivers, and software; improve utilization and inter‑node performance.
• Build monitoring, alerting, automation, runbooks, and documentation; support critical deployments on call.
• Explain technical recommendations to customer engineers and executives; coordinate incident resolution with internal teams.

Skills

GPU clusters

HPC environments

SLURM

Kubernetes

InfiniBand

NVIDIA GPUs

CUDA

GPU drivers

Container runtimes

Ansible

Terraform

Python

Bash

Linux performance tuning

AI topology knowledge

Customer-facing leadership

Tools

NVIDIA DGX

Megatron‑LM

Job description

Prime Intellect is looking for a Role overview expert to design and deploy GPU infrastructure for large-scale AI training, inference, and HPC workloads. This customer-facing role blends cluster architecture with hands-on implementation, performance tuning, and on-call support across hardware and software.

You will translate workload needs into GPU cluster architectures, optimize production clusters with SLURM and Kubernetes, and contribute to capacity planning for deployments spanning hundreds