Staff Infrastructure Engineer: Cloud, Kubernetes & Scale

LlamaIndex; San Francisco (CA); Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Competitive salary & equity

Medical/dental/vision coverage

Unlimited PTO

Catered lunch daily

Job summary

LlamaIndex’s Infra team builds and scales the core systems that power our data platform for AI applications. We design and operate cloud infrastructure, Kubernetes, and deployment tooling to support rapid growth and reliability.

We seek engineers with 8+ years of experience who can own platform infrastructure, optimize costs, and enable production AI workloads with robust observability and security across SaaS and multi-cloud deployments.

Qualifications

• 8+ years of engineering experience.
• Experience on Platform or Infrastructure teams with significant projects.
• Proficient in tuning Kubernetes clusters and cloud resources for cost and performance.

Responsibilities

• Collaborate with other engineering teams to build and maintain foundational systems that empower developers and support the company's rapid growth.
• Design and implement scalable infrastructure solutions for various deployment models, including SaaS, single-tenant, and private deployments.
• Manage and optimize cloud resources and Kubernetes clusters for cost-effectiveness and performance.
• Enable external customer deployment success through maintaining clear infrastructure boundaries and principles.
• Optimize and improve the release and deployment processes to enhance efficiency and reliability.
• Ensure compliance with relevant regulations and implement robust security measures across different deployment environments.
• Build and operate infrastructure for production LLM applications, including model integrations, inference workloads, evaluation pipelines, observability, and the reliable execution of agentic workflows.

Skills

Terraform/CDKTF

Kubernetes

Observability

Release management

Test infrastructure

LLM tooling

Cloud resource optimization

Team culture building

Tools

Prometheus

Grafana

New Relic

ArgoCD

Flux

Job description

LlamaIndex’s Infra team builds and scales the core systems that power our data platform for AI applications. We design and operate cloud infrastructure, Kubernetes, and deployment tooling to support rapid growth and reliability.

We seek engineers with 8+ years of experience who can own platform infrastructure, optimize costs, and enable production AI workloads with robust observability and security across SaaS and multi-cloud deployments.