Member of Technical Staff, Cloud Orchestration

Inferact; San Francisco (CA); On-site; USD 200,000 - 400,000; Full time

Benefits offered by this job

Generous health, dental, and vision benefits

401(k) company match

Equity offerings

Job summary

A cutting-edge AI tech company in San Francisco is seeking a Cloud Orchestration Engineer to design systems that manage AI model deployments at scale. The role requires expertise in Kubernetes, Python, and infrastructure-as-code tools, ensuring reliable operations and observability of deployments. Offering a competitive salary range of $200,000 – $400,000 plus equity, this position may also consider remote candidates in the US. Exceptional benefits and visa sponsorship are available.

Qualifications

• Strong experience with Kubernetes and container orchestration at scale.
• Proficiency in Python, Rust, or Go and infrastructure-as-code tools.
• Experience managing GPU clusters and debugging hardware issues.
• Ability to work across cloud platforms and on-premise infrastructure.

Responsibilities

• Design the systems for cluster management, deployment automation, and production monitoring.
• Ensure that vLLM deployments are observable, debuggable, and recoverable.

Skills

Kubernetes

Container orchestration

Python

Rust

Go

Infrastructure-as-code tools

CI/CD pipelines

AWS

GCP

Azure

Education

Bachelor’s degree or equivalent in computer science, engineering, or similar

Tools

Terraform

Helm

Ray

Slurm

Job description

Inferact’s mission is to grow vLLM as the world’s AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.

About The Role

We’re looking for an cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You’ll design the systems for cluster management, deployment automation, and production monitoring that enable teams worldwide to serve AI models without friction. You’ll ensure that vLLM deployments are observable, debuggable, and recoverable, turning operational complexity into infrastructure that just works.

Skills And Qualifications

Minimum qualifications:

• Bachelor’s degree or equivalent experience in computer science, engineering, or similar.
• Strong experience with Kubernetes and container orchestration at scale.
• Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
• Experience managing GPU clusters and debugging hardware issues.Understanding of CI/CD pipelines and automation frameworks.
• Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure.

Preferred qualifications

• Experience with ML-specific orchestration tools (Ray, Slurm).
• Knowledge of GPU scheduling, multi-tenancy, and resource optimization.
• Familiarity with vLLM deployment patterns and configuration.
• Track record of improving operational reliability for ML systems.

Bonus points if you have

• Experience deploying inference systems on large-scale GPU clusters.

Logistics

• Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates.
• Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 – $400,000 USD + equity.
• Visa sponsorship: We sponsor visas on a case‑by‑case basis.
• Benefits: Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.

Compensation Range: $200K – $400K