Senior AI Infrastructure Engineer - Multi-Cloud & Kubernetes

Procore Technologies, Inc.

Austin (TX)

Hybrid

USD 141,000 - 194,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity compensation
Bonus incentive
Hybrid work (2 days/week)

Job summary

Procore Technologies is seeking a Senior AI Infrastructure Engineer to lead multi-cloud platform operations powering our AI agents. You will optimize GKE/EKS, Vertex AI, and Terraform pipelines, scale vector databases, and run LLM serving on Kubernetes to meet growing demand.

This is a two-days-per-week hybrid role in Austin, TX. You will collaborate with application engineers, data scientists, and platform teams to boost scalability, reliability, and cost efficiency across Google Cloud and AWS,

Qualifications

  • 5+ years of experience building and operating production infrastructure at scale across Google Cloud (GKE, Vertex AI, IAM, VPC, BigQuery, Cloud Monitoring).
  • Proven AWS production experience (EKS, Lambda, IAM, RDS/Aurora, SQS/SNS) with Terraform in multi-cloud.
  • Production Kubernetes expertise including autoscaling, resource tuning, Helm, and GitOps workflows (Argo CD or equivalent).
  • Experience running LLMs in production via provider APIs (Vertex AI, Bedrock, Anthropic).
  • Experience deploying distributed vector databases, search engines, and stateful stores on Kubernetes.

Responsibilities

  • Operate, scale, and maintain production workloads across Google Cloud and AWS for a resilient multi-cloud AI foundation.
  • Manage AI model workloads across Vertex AI, Bedrock, and Anthropic with provider fallback and GPU-backed serving on Kubernetes.
  • Optimize Kubernetes clusters with precise resource management and dynamic autoscaling.
  • Plan capacity and right-size backends, queues, and storage to meet growing demand.
  • Lead lifecycle management, upgrades, and rollback strategies for databases and search infra.
  • Establish SLOs, automated alerting, tracing, and Datadog monitoring to reflect user experience.
  • Build secure CI/CD pipelines and developer tooling to accelerate delivery.

Skills

GKE Kubernetes
Vertex AI
AWS EKS
Terraform
GitOps
Observability
BigQuery
Multi-cloud
LLMs in production
Capacity planning

Education

Bachelor's degree in Computer Science

Tools

Argo CD
Helm
Datadog
Terraform
Kubernetes
Docker

Job description

Procore Technologies is seeking a Senior AI Infrastructure Engineer to lead multi-cloud platform operations powering our AI agents. You will optimize GKE/EKS, Vertex AI, and Terraform pipelines, scale vector databases, and run LLM serving on Kubernetes to meet growing demand.

This is a two-days-per-week hybrid role in Austin, TX. You will collaborate with application engineers, data scientists, and platform teams to boost scalability, reliability, and cost efficiency across Google Cloud and AWS,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer – Multi-Cloud & Kubernetes
Senior AI Infrastructure Engineer – Multi-Cloud & Kubernetes

DroneDeploy • Austin (TX)

Hybrid
USD 141,000 - 194,000
Equity compensation
Bonus incentive compensation
Senior AI Infra Engineer — Multi-Cloud & LLM Ops (Hybrid)
Senior AI Infra Engineer — Multi-Cloud & LLM Ops (Hybrid)

Procore Technologies, Inc. • Austin (TX)

Hybrid
USD 141,000 - 194,000
Staff AI Engineer: GenAI & Scalable Production Systems
Staff AI Engineer: GenAI & Scalable Production Systems

Procore Technologies, Inc. • United States

Hybrid
USD 169,000 - 232,000
Equity Compensation
Bonus Incentive Compensation
Staff AI Engineer: Scalable, Secure Production Systems
Staff AI Engineer: Scalable, Secure Production Systems

Procore Technologies, Inc. • Austin (TX)

Hybrid
USD 169,000 - 232,000
Staff AI Engineer - Lead GenAI & Scalable Systems (Hybrid)
Staff AI Engineer - Lead GenAI & Scalable Systems (Hybrid)

Procore • Jackson (TN)

Hybrid
USD 169,000 - 232,000
Senior AI Platform Architect
Senior AI Platform Architect

Procore Technologies, Inc. • Austin (TX)

On-site
USD 233,000 - 321,000
Equity Compensation
Bonus Incentive Compensation
Core AI Infrastructure Engineer for GenAI
Core AI Infrastructure Engineer for GenAI

Google LLC • Ionia (NY)

On-site
USD 174,000 - 252,000
Senior AI Experience Engineer (Austin)
Senior AI Experience Engineer (Austin)

Procore Technologies, Inc. • Austin (TX)

On-site
USD 141,000 - 194,000
Senior AI Software Engineer - Construction Platform
Senior AI Software Engineer - Construction Platform

DroneDeploy, Inc. • Austin (TX)

On-site
USD 141,000 - 194,000
Equity compensation
Bonus incentive compensation
Competitive compensation
Senior Software Engineer, AI Platform
Senior Software Engineer, AI Platform

Procore Technologies, Inc. • Austin (TX)

Hybrid
USD 141,000 - 194,000
Equity compensation
Bonus incentive
Hybrid work (2 days/week)