Member of Technical Staff, Cloud Orchestration

INFERACT SINGAPORE PTE. LTD.; Penarth; On-site; GBP 119,000 - 198,000; Full time

Benefits offered by this job

Equity

Medical coverage

Dental coverage

Vision coverage

Job summary

Inferact SINGAPORE PTE. LTD. is seeking a cloud orchestration engineer to design and operate the systems that keep vLLM running reliably at scale.

You will build cluster management, deployment automation, and production monitoring to enable teams worldwide to serve AI models with minimal friction. The role requires Kubernetes expertise, experience with custom operators, and proficiency in Python/Rust/Go, plus Terraform and Helm for infrastructure automation.

Qualifications

• Bachelor’s degree or equivalent in CS/Engineering.
• Experience with Kubernetes at scale.
• Proficiency in Python, Rust or Go.
• Experience with GPU clusters and cloud/on-prem infra.

Responsibilities

• Design cluster management systems and deployment automation.
• Build production monitoring and observability tooling.
• Ensure recoverability and debuggability of vLLM deployments at scale.
• Collaborate across teams to simplify operational complexity.

Skills

Kubernetes at scale

Kubernetes Operators

Python/Rust/Go

Cloud platforms AWS/GCP/Azure

GPU Clusters management

Multi-cloud / On-prem infra

Education

Bachelor's degree or equivalent

Tools

Terraform

Helm

Job description

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.

About the Role

We're looking for an cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You'll design the systems for cluster management, deployment automation, and production monitoring that enable teams worldwide to serve AI models without friction. You'll ensure that vLLM deployments are observable, debuggable, and recoverable, turning operational complexity into infrastructure that just works.

Skills and Qualifications

Minimum qualifications:

Bachelor's degree or equivalent experience in computer science, engineering, or similar.

Strong experience with Kubernetes and container orchestration at scale.

Experience designing and implementing custom Kubernetes operators.

Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).

Experience managing GPU clusters and debugging hardware issues.

Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure.

Preferred qualifications:

Experience with ML-specific orchestration tools (Ray, Slurm).

Knowledge of GPU scheduling, multi-tenancy, and resource optimization.

Familiarity with vLLM deployment patterns and configuration.

Track record of improving operational reliability for ML systems.

Bonus points if you have:

Experience deploying inference systems on large-scale GPU (1,000+) clusters.

Logistics

Fresh graduates are welcome to apply. Minimum years of work experience: 0.

Compensation:

Monthly salary of S$15,000 to S$30,000, depending on background, skills, and experience, plus equity.

Benefits:

Inferact offers a generous benefits package, including medical, dental, and vision coverage.