Platform Engineer: AI Infra & Kubernetes

Vectara; Palo Alto (CA); Hybrid; USD 135,000 - 185,000; Full time

Benefits offered by this job

100% paid medical, dental, vision for

HSA or FSA option

Generous PTO & holidays

Professional development

Team events & happy hours

Job summary

Vectara is building an Enterprise Agent Platform that enables governed AI across SaaS, VPC, and on-prem deployments. We are hiring a Platform Engineer to own the infrastructure that runs our deploy-anywhere system, spanning cloud, on-prem, and air-gapped environments.

This hands-on role will see you crafting Helm charts, Terraform configurations, and CI/CD pipelines, while improving observability and scalability.

Qualifications

• 2+ years in platform engineering, DevOps, SRE, or backend infra roles.
• Strong Kubernetes experience (deployment, debugging, scaling).
• Hands-on with infrastructure-as-code: Terraform, Helm, or Pulumi.
• Experience with at least one major cloud provider (AWS preferred).
• Proficiency in Go, Python, or Java; able to read backend codebases.
• Working knowledge of CI/CD systems (GitHub Actions, Bazel, ArgoCD).
• Solid fundamentals in Linux, networking, and distributed systems.

Responsibilities

• Build and maintain infrastructure-as-code for AWS EKS, GCP GKE, and on-prem deployments (including air-gapped envs).
• Own CI/CD pipelines and drive GitOps adoption.
• Deploy, scale, and optimize ML/NLP inference workloads (vLLM, PyTorch) on Kubernetes.
• Build and improve observability: Prometheus, Grafana, Datadog, and OpenTelemetry.
• Collaborate with Field Engineering to support PoCs and platform deployments in customer cloud VPCs and on-prem.
• Contribute to backend services (Java 21, Python, gRPC) and platform features.
• Improve system reliability, scalability, and developer experience.

Skills

Kubernetes

Terraform

Helm

Go

Python

Java

Distributed systems

Linux

CI/CD

GitOps

Tools

GitHub Actions

Bazel

ArgoCD

Prometheus

Grafana

Datadog

OpenTelemetry

Job description

Vectara is building an Enterprise Agent Platform that enables governed AI across SaaS, VPC, and on-prem deployments. We are hiring a Platform Engineer to own the infrastructure that runs our deploy-anywhere system, spanning cloud, on-prem, and air-gapped environments.

This hands-on role will see you crafting Helm charts, Terraform configurations, and CI/CD pipelines, while improving observability and scalability.