Senior Infra Engineer: Scale Global Kubernetes & LLM Infra

Ivo

San Francisco (CA)

On-site

USD 249,000 - 405,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive Compensation
Equity
Relocation and Visa Support
Health & Wellness
Flexible Spending & Insurance
401(k) Program
Commuter Benefits
Unlimited PTO
Office Perks

Job summary

Ivo is hiring an Infrastructure Engineer to own the foundation of our contract intelligence platform. You will operate Kubernetes at scale, build internal tooling for cluster provisioning, and design workload isolation between ML and API traffic.

You’ll work across multi-region deployments, emphasizing reliability, security, and incident resilience. We value hands-on DevOps/infra expertise and a strong drive to solve hard end-to-end problems, with a bias toward practical, scalable solutions in a

Qualifications

  • Infrastructure Engineers build the foundation for Ivo's platform with containerized environments, multi-region deployments, and reliable incident handling.
  • You should have hands-on experience with Kubernetes architectures, scheduling, networking, and storage, plus a knack for diagnosing complex failures.
  • Proficiency in IaC and CI/CD, ideally Pulumi or Terraform, Docker, and GitHub Actions across multi-cluster setups.

Responsibilities

  • Run multi-cluster, multi-region deployments across AWS/GCP/Azure with failover and DR that works in production.
  • Build internal tools to spin up and manage clusters, ensuring consistency from dev to prod.
  • Design workload isolation strategies for ML vs API traffic balancing cost, performance, and reliability.

Skills

Kubernetes
IaC (Pulumi/Terraform)
CI/CD (GitHub Actions)
Docker
Distributed systems
Observability
Security best practices
Problem solving

Tools

Pulumi
Terraform
Docker
GitHub Actions
Kubernetes

Job description

Ivo is hiring an Infrastructure Engineer to own the foundation of our contract intelligence platform. You will operate Kubernetes at scale, build internal tooling for cluster provisioning, and design workload isolation between ML and API traffic.

You’ll work across multi-region deployments, emphasizing reliability, security, and incident resilience. We value hands-on DevOps/infra expertise and a strong drive to solve hard end-to-end problems, with a bias toward practical, scalable solutions in a

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Infra Engineer — Scale Global Kubernetes & AI Infra
Staff Infra Engineer — Scale Global Kubernetes & AI Infra

Ivo • San Francisco (CA)

On-site
USD 287,000 - 485,000
Competitive pay
Equity
Relocation assistance
+7
Senior Infrastructure Engineer for Kubernetes & Reliability
Senior Infrastructure Engineer for Kubernetes & Reliability

Ivo • San Francisco (CA)

On-site
USD 180,000 - 260,000
Equity
Relocation & visa support
Health plan
+5
Senior Infra Engineer - Multi-Cloud Kubernetes & SRE
Senior Infra Engineer - Multi-Cloud Kubernetes & SRE

Ivo Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Relocation and Visa Support
Health & Wellness
Equity
+3
Staff Infrastructure Engineer - SRE & Kubernetes
Staff Infrastructure Engineer - SRE & Kubernetes

Ivo • San Francisco (CA)

Hybrid
USD 180,000 - 260,000
Health & Wellness benefits
Equity
Relocation and Visa Support
+4
Remote Infrastructure Engineer: Kubernetes & ML Infra
Remote Infrastructure Engineer: Kubernetes & ML Infra

ElevenLabs • New York (NY)

Remote
USD 150,000 - 210,000
ML Infra Engineer — Scale AI Platform with Kubernetes
ML Infra Engineer — Scale AI Platform with Kubernetes

Physical Intelligence • San Francisco (CA)

On-site
USD 180,000 - 210,000
ML Infra Engineer | Scalable Inference & Kubernetes
ML Infra Engineer | Scalable Inference & Kubernetes

Fdetimes • San Francisco (CA)

On-site
USD 180,000 - 250,000
14 paid holidays
Health insurance
HSA contributions
+5
Sr. Infra Engineer - Scale APIs, ML Storage (Remote)
Sr. Infra Engineer - Scale APIs, ML Storage (Remote)

Ladders • United States

Remote
USD 190,000 - 267,000
Healthcare benefits
401k match
Flexible vacation policy
AI Infra Engineer: Kubernetes & LLM Ops
AI Infra Engineer: Kubernetes & LLM Ops

Alignity Solutions • New York (NY)

On-site
USD 120,000 - 180,000
Senior ML Infra Engineer - Kubernetes & Cloud
Senior ML Infra Engineer - Kubernetes & Cloud

Philo • Cambridge (MA)

Remote
USD 185,000 - 240,000
Full health coverage
401(k) plan with company match
Flexible working hours
+2