Senior AI Infra Engineer — Multi-Cloud & LLM Ops (Hybrid)

Procore Technologies, Inc.

Austin (TX)

Hybrid

USD 141,000 - 194,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Procore Technologies is seeking a Senior AI Infrastructure Engineer to scale and optimize our multi-cloud AI platform. You’ll oversee production workloads across Google Cloud and AWS, manage LLM deployments, and enhance Kubernetes readiness with cost efficiency in mind.

You will report to the VP of Engineering in a 2 days/week hybrid role based in Austin, TX, contributing to capacity planning, SLOs, and robust CI/CD workflows for the AI infrastructure stack.

Qualifications

  • 5+ years of experience building and operating production infrastructure at scale.
  • Deep hands-on expertise across Google Cloud (GKE, Vertex AI, IAM, VPC, BigQuery).
  • Proven AWS production experience (EKS, Lambda, IAM, RDS/Aurora, SQS/SNS) with Terraform.
  • Production Kubernetes expertise including autoscaling and resource tuning.
  • Experience running LLMs in production via provider APIs (Vertex AI, Bedrock, Anthropic).
  • Experience deploying distributed vector databases and stateful stores on Kubernetes.

Responsibilities

  • Operate, scale, and maintain production workloads across Google Cloud and AWS for an AI agent portfolio.
  • Manage AI model workloads with Vertex AI, Bedrock, and Anthropic; implement provider fallback and routing.
  • Optimize Kubernetes clusters with autoscaling and resource tuning.
  • Plan capacity for stateful backends, queues, and vector databases based on workloads.
  • Lead lifecycle management and rollouts for production databases and search infra.
  • Establish SLOs, automated alerting, and Datadog monitoring to reflect user experience.
  • Build CI/CD pipelines and developer tooling for AI platform delivery.

Skills

GCP (GKE)
AWS (EKS, Lambda)
Kubernetes
LLM production operations
Multi-cloud infrastructure
Observability design
Resource optimization

Education

Bachelor's degree in Computer Science or related field

Tools

Terraform
Helm
Argo CD
GitOps workflows

Job description

Procore Technologies is seeking a Senior AI Infrastructure Engineer to scale and optimize our multi-cloud AI platform. You’ll oversee production workloads across Google Cloud and AWS, manage LLM deployments, and enhance Kubernetes readiness with cost efficiency in mind.

You will report to the VP of Engineering in a 2 days/week hybrid role based in Austin, TX, contributing to capacity planning, SLOs, and robust CI/CD workflows for the AI infrastructure stack.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer – Multi-Cloud & Kubernetes
Senior AI Infrastructure Engineer – Multi-Cloud & Kubernetes

DroneDeploy • Austin (TX)

Hybrid
USD 141,000 - 194,000
Equity compensation
Bonus incentive compensation
Senior AI Infrastructure Engineer - Multi-Cloud & Kubernetes
Senior AI Infrastructure Engineer - Multi-Cloud & Kubernetes

Procore Technologies, Inc. • Austin (TX)

Hybrid
USD 141,000 - 194,000
Equity compensation
Bonus incentive
Hybrid work (2 days/week)
Staff AI Engineer - Lead GenAI & Scalable Systems (Hybrid)
Staff AI Engineer - Lead GenAI & Scalable Systems (Hybrid)

Procore • Jackson (TN)

Hybrid
USD 169,000 - 232,000
Staff AI Engineer: GenAI & Scalable Production Systems
Staff AI Engineer: GenAI & Scalable Production Systems

Procore Technologies, Inc. • United States

Hybrid
USD 169,000 - 232,000
Equity Compensation
Bonus Incentive Compensation
Senior AI Engineer - LLMs & AI Workflows (Equity)
Senior AI Engineer - LLMs & AI Workflows (Equity)

Procore Technologies, Inc. • United States

On-site
USD 141,000 - 194,000
Equity Compensation
Bonus Incentive Compensation
AI Platform Architect — LLM Infrastructure & Scale
AI Platform Architect — LLM Infrastructure & Scale

DroneDeploy, Inc. • Austin (TX)

On-site
USD 233,000 - 321,000
Equity compensation
Bonus incentives
Staff AI Engineer: Scalable, Secure Production Systems
Staff AI Engineer: Scalable, Secure Production Systems

Procore Technologies, Inc. • Austin (TX)

Hybrid
USD 169,000 - 232,000
AI Platform Architect: Scale & LLM Ops
AI Platform Architect: Scale & LLM Ops

Procore • Austin (TX)

On-site
USD 233,000 - 321,000
Senior AI Experience Engineer (Austin)
Senior AI Experience Engineer (Austin)

Procore Technologies, Inc. • Austin (TX)

On-site
USD 141,000 - 194,000
Senior AI Platform Architect
Senior AI Platform Architect

Procore Technologies, Inc. • Austin (TX)

On-site
USD 233,000 - 321,000
Equity Compensation
Bonus Incentive Compensation