Platform Engineer - AI Infra & Kubernetes (Remote)

Vectara; Palo Alto (CA); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

100% paid Medical, Dental, Vision for

HSA or FSA option

Generous PTO + holidays

Professional development

Team building activities

Job summary

Vectara is seeking an experienced Platform Engineer to own and scale the infrastructure that powers our deploy-anywhere platform. You will work across AWS EKS, GCP GKE, and on‑prem environments, writing Helm charts and Terraform, debugging issues, and contributing to backend services.

You'll join a hands‑on team responsible for CI/CD pipelines, observability, and reliable ML inference workloads, with a focus on security and resilience for enterprise customers.

Qualifications

• 2+ years in platform engineering, DevOps, SRE, or backend infrastructure roles.
• Strong Kubernetes experience (deployment, debugging, scaling).
• Hands‑on with infrastructure‑as‑code: Terraform, Helm, or Pulumi.
• Experience with at least one major cloud provider (AWS preferred; GCP/Azure valued).
• Proficiency in Go, Python, or Java; comfortable with backend codebases.
• Working knowledge of CI/CD systems (GitHub Actions, Bazel, ArgoCD).
• Fundamentals in Linux, networking, and distributed systems.

Responsibilities

• Build and maintain infrastructure‑as‑code (Terraform, Helm) for AWS EKS, GCP GKE, and on‑prem deployments.
• Own CI/CD pipelines and drive GitOps adoption.
• Deploy, scale, and optimize ML/NLP inference workloads on Kubernetes clusters.
• Build and improve observability (Prometheus, Grafana, OpenTelemetry, Datadog).
• Collaborate with Field Engineering to support PoCs and platform deployments in customer cloud VPCs and on‑prem environments.
• Contribute to backend services (Java 21, Python, gRPC) and platform features.
• Improve system reliability, scalability, and developer experience across the engineering org.

Skills

Kubernetes

Go/Python/Java

Linux fundamentals

Distributed systems

CI/CD workflows

Tools

Terraform

Helm

Pulumi

GitHub Actions

Bazel

ArgoCD

Job description

Vectara is seeking an experienced Platform Engineer to own and scale the infrastructure that powers our deploy-anywhere platform. You will work across AWS EKS, GCP GKE, and on‑prem environments, writing Helm charts and Terraform, debugging issues, and contributing to backend services.

You'll join a hands‑on team responsible for CI/CD pipelines, observability, and reliable ML inference workloads, with a focus on security and resilience for enterprise customers.