Senior GPU Compute Cluster Engineer

Inferact; San Francisco (CA); On-site; USD 200,000 - 400,000; Full time

Benefits offered by this job

Health, dental, vision coverage

401(k) company match

Remote-friendly environment

Equity

Job summary

Inferact is seeking a hands-on cluster administration engineer to own and operate its high-performance GPU compute infrastructure. You will ensure health, availability, observability, and usability around the clock for HP compute clusters across providers.

You will collaborate with engineering leadership to standardize provisioning, operation, debugging, and scaling of compute resources. The role directly impacts speed of building and testing vLLM-powered systems.

Qualifications

• Bachelor's degree or equivalent experience in computer science, engineering, systems administration, or similar.
• Hands-on experience administering large compute clusters, HPC environments, university or research clusters, supercomputing systems, or production GPU clusters.
• Strong Linux systems administration fundamentals across networking, processes, storage, package management, shell scripting, logs, access control, and system debugging.
• Experience operating GPU servers, including driver management, GPU health monitoring, node failures, memory errors, scheduler issues, and hardware diagnostics.
• Experience with cluster scheduling and resource allocation using SLURM, Kubernetes, or equivalent tooling.
• Ability to own urgent infrastructure incidents end-to-end when compute issues are blocking engineering teams.
• Ability to automate operational workflows using Bash, Python, Ansible, Terraform, Helm, or similar tooling.

Responsibilities

• Own and operate high-performance GPU compute infrastructure used by Inferact engineers.
• Maintain cluster health, GPU availability, monitoring, alerting, and incident response across systems.
• Standardize provisioning and operation across providers with leadership and infra owners.
• Work with teams to enable faster build, test, and improvement cycles for vLLM-powered systems.

Skills

Linux systems administration

GPU server handling

Cluster health monitoring

Incident response

SLURM scheduling

Kubernetes

Bash

Python

Ansible

Terraform

Helm

Remote collaboration with leadership

Hardware diagnostics

Education

Bachelor's degree in CS/Engineering or equivalent experience

Tools

SLURM

Kubernetes

Terraform

Ansible

Helm

Job description

Inferact is seeking a hands-on cluster administration engineer to own and operate its high-performance GPU compute infrastructure. You will ensure health, availability, observability, and usability around the clock for HP compute clusters across providers.

You will collaborate with engineering leadership to standardize provisioning, operation, debugging, and scaling of compute resources. The role directly impacts speed of building and testing vLLM-powered systems.