Member of Technical Staff, Cloud Orchestration (Remote)

Inferact; Brasil; Remote; BRL 180,000 - 350,000; Full time

Benefits offered by this job

Visa sponsorship

Remote work

Health coverage

Job summary

Inferact is seeking a cloud orchestration engineer to design and operate scalable infrastructure for vLLM. You will build cluster management, deployment automation, and production monitoring to enable teams worldwide to serve AI models with minimal friction.

You will work across cloud platforms (AWS, GCP, Azure) and on-premise setups, ensuring observability, reliability, and rapid recovery from issues. Fully remote worldwide with time overlap for critical syncs.

Qualifications

• Bachelor's degree or equivalent experience in computer science, engineering, or similar.
• Strong experience with Kubernetes and container orchestration at scale.
• Experience designing and implementing custom Kubernetes operators.
• Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
• Experience managing GPU clusters and debugging hardware issues.

Responsibilities

• Build the operational backbone to keep vLLM running reliably at scale.
• Design systems for cluster management, deployment automation, and production monitoring.
• Make deployments observable, debuggable, and recoverable.
• Turn operational complexity into infrastructure that just works.

Skills

Kubernetes

Container orchestration

Kubernetes operators

Python/Rust/Go

Terraform

Helm

GPU clusters

Multi-cloud

Ray

Slurm

vLLM familiarity

Education

Bachelor's degree

Tools

Terraform

Helm

Job description

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.

About the Role

We're looking for an cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You'll design the systems for cluster management, deployment automation, and production monitoring that enable teams worldwide to serve AI models without friction. You'll ensure that vLLM deployments are observable, debuggable, and recoverable, turning operational complexity into infrastructure that just works.

Skills and Qualifications

• Minimum qualifications: Bachelor's degree or equivalent experience in computer science, engineering, or similar.
• Strong experience with Kubernetes and container orchestration at scale.
• Experience designing and implementing custom Kubernetes operators.
• Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
• Experience managing GPU clusters and debugging hardware issues.Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure.
• Preferred qualifications: Experience with ML-specific orchestration tools (Ray, Slurm).
• Knowledge of GPU scheduling, multi-tenancy, and resource optimization.
• Familiarity with vLLM deployment patterns and configuration.
• Track record of improving operational reliability for ML systems.
• Bonus points if you have: Experience deploying inference systems on large-scale GPU (1,000+) clusters.

Location

Fully remote, worldwide. We're timezone-flexible but expect regular overlap with Pacific Time for critical syncs.

Compensation

We offer competitive compensations (salary + equity) compared to the local market conditions.

Visa sponsorship

We sponsor visas on a case-by-case basis.

Benefits

• Inferact offers competitive benefits appropriate to your location, including health coverage where applicable.