Senior Infra Engineer: Scale Global Kubernetes & LLM Infra

Icehouseventures

San Francisco (CA)

On-site

USD 249,000 - 405,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Competitive Compensation
Equity
Relocation and Visa Support
Health & Wellness
Flexible Spending & Insurance
401(k) Program
Commuter Benefits
Unlimited PTO
Office Perks

Job summary

Ivo is hiring an Infrastructure Engineer to own the foundation of our contract intelligence platform. You will operate Kubernetes at scale, build internal tooling for cluster provisioning, and design workload isolation between ML and API traffic.

You’ll work across multi-region deployments, emphasizing reliability, security, and incident resilience. We value hands-on DevOps/infra expertise and a strong drive to solve hard end-to-end problems, with a bias toward practical, scalable solutions in a

Qualifications

  • Infrastructure Engineers build the foundation for Ivo's platform with containerized environments, multi-region deployments, and reliable incident handling.
  • You should have hands-on experience with Kubernetes architectures, scheduling, networking, and storage, plus a knack for diagnosing complex failures.
  • Proficiency in IaC and CI/CD, ideally Pulumi or Terraform, Docker, and GitHub Actions across multi-cluster setups.

Responsibilities

  • Run multi-cluster, multi-region deployments across AWS/GCP/Azure with failover and DR that works in production.
  • Build internal tools to spin up and manage clusters, ensuring consistency from dev to prod.
  • Design workload isolation strategies for ML vs API traffic balancing cost, performance, and reliability.

Skills

Kubernetes
IaC (Pulumi/Terraform)
CI/CD (GitHub Actions)
Docker
Distributed systems
Observability
Security best practices
Problem solving

Tools

Pulumi
Terraform
Docker
GitHub Actions
Kubernetes

Job description

Ivo is hiring an Infrastructure Engineer to own the foundation of our contract intelligence platform. You will operate Kubernetes at scale, build internal tooling for cluster provisioning, and design workload isolation between ML and API traffic.

You’ll work across multi-region deployments, emphasizing reliability, security, and incident resilience. We value hands-on DevOps/infra expertise and a strong drive to solve hard end-to-end problems, with a bias toward practical, scalable solutions in a

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Staff Infra Engineer — Scale Global Kubernetes & AI Infra
Staff Infra Engineer — Scale Global Kubernetes & AI Infra

Icehouseventures • San Francisco (CA)

On-site
USD 287,000 - 485,000
Competitive pay
Equity
Relocation assistance
+7
Senior Infra Engineer - Multi-Region Kubernetes & SRE
Senior Infra Engineer - Multi-Region Kubernetes & SRE

Ivo Inc. • San Francisco (CA)

On-site
USD 180,000 - 260,000
Relocation & Visa support
Health, dental, vision plans
HSA/FSA accounts
+3
Senior Infra Engineer - Multi-Cloud Kubernetes & SRE
Senior Infra Engineer - Multi-Cloud Kubernetes & SRE

Ivo Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Relocation and Visa Support
Health & Wellness
Equity
+3
Staff Infra Engineer: Build Ultra-Reliable Cloud Platforms
Staff Infra Engineer: Build Ultra-Reliable Cloud Platforms

Ivo • San Francisco (CA)

On-site
USD 287,000 - 485,000
Relocation & Visa Support
Health & Wellness
401(k) Program
+3
Infra Platform Engineer — Scale Cloud & Kubernetes
Infra Platform Engineer — Scale Cloud & Kubernetes

LlamaIndex • San Francisco (CA)

Hybrid
USD 120,000 - 160,000
Competitive base salary and equity compensation
Comprehensive benefits coverage
Unlimited paid time off
+1
Staff Infrastructure Engineer: Cloud, Kubernetes & Scale
Staff Infrastructure Engineer: Cloud, Kubernetes & Scale

LlamaIndex • San Francisco (CA)

Hybrid
USD 180,000 - 260,000
Competitive salary & equity
Medical/dental/vision coverage
Unlimited PTO
+1
Cloud Infrastructure Engineer - Multi-Region & Kubernetes
Cloud Infrastructure Engineer - Multi-Region & Kubernetes

Ivo Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Competitive compensation
Equity
Relocation and visa support
+5
Senior Infrastructure Engineer — Multi-Cloud, Failover & LLMs
Senior Infrastructure Engineer — Multi-Cloud, Failover & LLMs

Ivo • San Francisco (CA)

On-site
USD 249,000 - 405,000
Relocation and Visa Support
Health & Wellness
Flexible Spending & Insurance
+5
Cloud Infra Engineer: Multi-Region, Resilient Deployments
Cloud Infra Engineer: Multi-Region, Resilient Deployments

Ivo • San Francisco (CA)

On-site
USD 140,000 - 200,000
AI Infra Engineer: Kubernetes & LLM Ops
AI Infra Engineer: Kubernetes & LLM Ops

Alignity Solutions • New York (NY)

On-site
USD 120,000 - 180,000