Member of Technical Staff, Cluster Administration

Inferact; Singapore; On-site; SGD 200,000 - 400,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

Visa sponsorship on case-by-case basis

Job summary

Inferact is seeking a hands-on cluster administration engineer to own and operate its high-performance GPU compute infrastructure. You will ensure health, availability, observability, and 24/7 usability across neo-cloud and dedicated providers, driving fast development of vLLM-powered systems.

You will manage GPU health, scheduling, diagnostics, and incident response, collaborating with engineering leadership to standardize provisioning, operation, and scaling.

Qualifications

• Bachelor’s degree or equivalent in CS, engineering, or related field.
• Hands-on experience administering large compute clusters or HPC environments.
• Strong Linux sysadmin fundamentals across networking, storage, packages, and debugging.
• Experience operating GPU servers, driver management, GPU health monitoring, and hardware diagnostics.
• Experience with cluster scheduling and resource allocation using SLURM, Kubernetes, or equivalent tooling.
• Ability to own urgent infra incidents end-to-end when compute issues block engineering teams.
• Ability to automate operational workflows using Bash, Python, Ansible, Terraform, Helm, or similar tooling.

Responsibilities

• Own and operate the high-performance GPU compute infrastructure used by Inferact engineering.
• Maintain cluster health, GPU availability, monitoring, alerting, and incident response.
• Collaborate with engineering leadership to standardize provisioning, operation, and scaling across providers.
• Scale compute resources across neo-cloud and dedicated providers to accelerate build, test, and improvement cycles.
• Diagnose issues and implement automation to reduce operational toil and incident resolution time.

Skills

GPU clusters

Linux admin

Networking

Scripting Bash

Python

Cluster scheduling

Incident response

Automation tooling

Education

Bachelor’s degree or equivalent in CS/Engineering/related

Tools

SLURM

Kubernetes

Terraform

Ansible

Helm

Job description

Inferact’s mission is to grow vLLM as the world’s AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.

About the Role

We’re looking for a hands‑on cluster administration engineer to own and operate the high-performance GPU compute infrastructure that keeps Inferact engineering productive. Inferact runs on expensive, high-performance GPU and HPC clusters across neo-cloud and dedicated compute providers. Your job is to make sure that infrastructure is healthy, available, observable, and usable around the clock.

You’ll take ownership of cluster health, GPU availability, monitoring, alerting, scheduling, access, diagnostics, and incident response across the systems our engineers rely on every day. You’ll work closely with engineering leadership and infrastructure owners to standardize how we provision, operate, debug, and scale compute across providers. Your work will directly impact how fast Inferact can build, test, and improve the systems powering vLLM.

Skills and Qualifications

Minimum qualifications:

• Bachelor’s degree or equivalent experience in computer science, engineering, systems administration, or similar.
• Hands‑on experience administering large compute clusters, HPC environments, university or research clusters, supercomputing systems, or production GPU clusters.
• Strong Linux systems administration fundamentals across networking, processes, storage, package management, shell scripting, logs, access control, and system debugging.
• Experience operating GPU servers, including driver management, GPU health monitoring, node failures, memory errors, scheduler issues, and hardware diagnostics.
• Experience with cluster scheduling and resource allocation using SLURM, Kubernetes, or equivalent tooling.
• Ability to own urgent infrastructure incidents end‑to‑end when compute issues are blocking engineering teams.
• Ability to automate operational workflows using Bash, Python, Ansible, Terraform, Helm, or similar tooling.

Preferred qualifications:

• Experience operating GPU compute across providers such as Lambda, CoreWeave, Crusoe, Nebius, Together, Fireworks, RunPod, or similar environments.
• Experience improving cluster utilization, reducing idle or unavailable GPU capacity, and debugging scheduling or resource contention issues.
• Familiarity with high-performance GPU networking such as InfiniBand, RoCE, NVLink / NVSwitch, RDMA, NCCL, or equivalent systems.
• Experience with storage for HPC or ML workloads, including NFS, Lustre, Ceph, distributed filesystems, or other high‑throughput storage systems.
• Experience managing secure access, identity, permissions, SSH, VPNs, bastion hosts, secrets, and basic infrastructure security hygiene.
• Background in research computing, scientific computing, ML infrastructure, SRE, platform engineering, or infrastructure operations for engineering‑heavy teams.

Bonus points if you have:

• Managed GPU or HPC infrastructure in a university lab, national lab, research institution, AI infrastructure company, hedge fund, HFT firm, or large‑scale ML platform team.
• Built monitoring, alerting, runbooks, health checks, or remediation workflows that materially reduced operational toil or incident resolution time.
• Operated Kubernetes clusters for ML or GPU workloads at meaningful scale.
• Standardized provisioning, diagnostics, monitoring, and operating patterns across multiple compute providers.
• Carried real operational responsibility for infrastructure used by many engineers or researchers.

Logistics

• Location: This role is based in Singapore.
• Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is S$200,000 to S$400,000 annually + equity.
• Visa sponsorship: We sponsor visas on a case‑by‑case basis.
• Benefits : Inferact offers a generous benefits package, including medical, dental, and vision coverage.