Senior Software Engineer, AI Platform

Procore Technologies

Austin (TX)

Hybrid

USD 141.000 - 194.000

Vollzeit

vor 33 Stunden
Sei unter den ersten Bewerbenden

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Equity compensation
Bonus incentive
Hybrid work (2 days/week)

Zusammenfassung

Procore Technologies is seeking a Senior AI Infrastructure Engineer to lead multi-cloud platform operations powering our AI agents. You will optimize GKE/EKS, Vertex AI, and Terraform pipelines, scale vector databases, and run LLM serving on Kubernetes to meet growing demand.

This is a two-days-per-week hybrid role in Austin, TX. You will collaborate with application engineers, data scientists, and platform teams to boost scalability, reliability, and cost efficiency across Google Cloud and AWS,

Qualifikationen

  • 5+ years of experience building and operating production infrastructure at scale across Google Cloud (GKE, Vertex AI, IAM, VPC, BigQuery, Cloud Monitoring).
  • Proven AWS production experience (EKS, Lambda, IAM, RDS/Aurora, SQS/SNS) with Terraform in multi-cloud.
  • Production Kubernetes expertise including autoscaling, resource tuning, Helm, and GitOps workflows (Argo CD or equivalent).
  • Experience running LLMs in production via provider APIs (Vertex AI, Bedrock, Anthropic).
  • Experience deploying distributed vector databases, search engines, and stateful stores on Kubernetes.

Aufgaben

  • Operate, scale, and maintain production workloads across Google Cloud and AWS for a resilient multi-cloud AI foundation.
  • Manage AI model workloads across Vertex AI, Bedrock, and Anthropic with provider fallback and GPU-backed serving on Kubernetes.
  • Optimize Kubernetes clusters with precise resource management and dynamic autoscaling.
  • Plan capacity and right-size backends, queues, and storage to meet growing demand.
  • Lead lifecycle management, upgrades, and rollback strategies for databases and search infra.
  • Establish SLOs, automated alerting, tracing, and Datadog monitoring to reflect user experience.
  • Build secure CI/CD pipelines and developer tooling to accelerate delivery.

Kenntnisse

GKE Kubernetes
Vertex AI
AWS EKS
Terraform
GitOps
Observability
BigQuery
Multi-cloud
LLMs in production
Capacity planning

Ausbildung

Bachelor's degree in Computer Science

Tools

Argo CD
Helm
Datadog
Terraform
Kubernetes
Docker

Jobbeschreibung

Procore Technologies is the leading technology partner for every stage of construction. We empower construction teams to drive efficiency and mitigate risk through actionable AI & data-driven insights. For over 20 years, we have been transforming the industry with purpose-built solutions for construction professionals and we’re looking for talented people to help us build together.

We are looking for a Senior AI Infrastructure Engineer to ensure the platform infrastructure powering our AI agents remains high-performing, resilient, and cost-efficient as customer adoption scales. As the Senior AI Infrastructure Engineer on our AI Infrastructure team, you will work closely with application engineers, data scientists, and platform teams to build multi-cloud deployment pipelines, scale vector databases, and optimize our multi-provider LLM gateway. Your strengths in multi-cloud infrastructure (GCP/AWS), Kubernetes orchestration, and AI/LLM production operations will drive your success.

You will report to the VP of Engineering and will be a 2 days per week hybrid role based in our Austin, TX office.

What You’ll Do
  • Operate, scale, and maintain production workloads across Google Cloud and AWS to provide a resilient, unified multi-cloud foundation for Procore's AI agent portfolio.
  • Manage production AI model workloads across Vertex AI, Amazon Bedrock, and Anthropic, implementing explicit provider fallback, regional availability routing, and GPU-backed self-hosted model serving on Kubernetes.
  • Optimize Kubernetes (GKE and EKS) clusters through precision resource requests, limits, and dynamic autoscaling to ensure compute fleets scale efficiently with real-time customer demand.
  • Proactively plan capacity and right-size stateful backends, queues, BigQuery storage, and vector databases using empirical workload patterns and growth forecasts to keep production ahead of customer usage.
  • Lead the lifecycle management, staging rollouts, upgrades, and automated rollback strategies for production databases and search infrastructure to eliminate downtime and mitigate operational risk.
  • Establish comprehensive service-level objectives (SLOs), automated alerting, distributed agent tracing, and Datadog monitoring that reflect true user experience and eliminate operational noise.
  • Build secure, modern CI/CD pipelines, reproducible staging environments, and developer tooling to accelerate software delivery and empower application engineers building on the AI platform.
What You Bring
  • 5+ years of experience building and operating production infrastructure at scale, with deep hands‑on expertise across Google Cloud (GKE, Vertex AI, IAM, VPC networking, BigQuery, Cloud Monitoring).
  • Proven AWS production experience (EKS, Lambda, IAM, RDS/Aurora, SQS/SNS) and infrastructure management using Terraform across multi-cloud environments.
  • Production Kubernetes expertise, including autoscaling, resource tuning, cluster lifecycle management, Helm, and GitOps workflows (Argo CD or equivalent).
  • Practical experience running LLMs in production via provider APIs, including quota management, load balancing, and multi-provider routing (Vertex AI, Bedrock, Anthropic).
  • Demonstrated experience deploying and operating distributed vector databases, search engines, and stateful data stores on Kubernetes.
  • Strong background in observability design, including defining meaningful alert policies, SLOs, Datadog dashboards, and incident response runbooks.
  • Track record of executing measurable performance and cost optimizations across cloud architectures, with the ability to clearly articulate engineering trade-offs.
  • Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.
Strong-fit Background Might Include
  • Senior MLOps Engineer / AI Platform Engineer
  • Senior Cloud Infrastructure Engineer (GCP / AWS)
  • Senior Site Reliability Engineer (Kubernetes & Stateful Distributed Systems)
  • Platform / Developer Experience Engineer (AI/ML Enablement)

Discover our recruiting process and interview tips from our talent acquisition team on our blog.

Additional Information
Base Pay Range

140,960.00 - 193,820.00 USD Annual

This role may also be eligible for Equity Compensation and/or Bonus Incentive Compensation. Procore is committed to offering competitive, fair, and commensurate compensation. Actual compensation will be based on a candidate’s job‑related skills, experience, education or training, and location.

For Los Angeles County (unincorporated) Candidates

Procore will consider for employment all qualified applicants, including those with arrest or conviction records, in accordance with the requirements of applicable federal, state, and local laws, including the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.

A criminal history may have a direct, adverse, and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment: 1. appropriately managing, accessing, and handling confidential information including proprietary and trade secret information, as well as accessing Procore's information technology systems and platforms; 2. interacting with and occasionally having unsupervised contact with internal/external customers, stakeholders, and/or colleagues; and 3. exercising sound judgment.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Senior Software Engineer, AI Platform
Senior Software Engineer, AI Platform

Procore • Austin (TX)

Hybrid
USD 141.000 - 194.000
Senior Software Engineer - Procore AI Experience
Senior Software Engineer - Procore AI Experience

Procore Technologies • Austin (TX)

Vor Ort
USD 141.000 - 194.000
Senior Software Engineer - Procore AI Experience
Senior Software Engineer - Procore AI Experience

DroneDeploy, Inc. • Austin (TX)

Vor Ort
USD 141.000 - 194.000
Equity compensation
Bonus incentive compensation
Competitive compensation
Senior Software Engineer - Procore AI Experience
Senior Software Engineer - Procore AI Experience

Procore • Austin (TX)

Vor Ort
USD 141.000 - 194.000
Staff Software Engineer - AI
Staff Software Engineer - AI

DroneDeploy • Austin (TX)

Hybrid
USD 169.000 - 232.000
AI Application Architect
AI Application Architect

Procore • Austin (TX)

Vor Ort
USD 233.000 - 321.000
Senior Manager, Analytics Engineering & Data Science
Senior Manager, Analytics Engineering & Data Science

Procore Technologies • Austin (TX)

Vor Ort
USD 198.000 - 273.000
Equity compensation
Bonus incentive compensation
AI Application Architect
AI Application Architect

Procore Technologies • Austin (TX)

Vor Ort
USD 233.000 - 321.000
Equity Compensation
Bonus Incentive Compensation
Staff Technical Program Manager, Enterprise AI
Staff Technical Program Manager, Enterprise AI

Procore Technologies, Inc. • USA

Remote
USD 169.000 - 232.000
Equity compensation
Bonus incentive
AI Application Architect
AI Application Architect

DroneDeploy, Inc. • Austin (TX)

Vor Ort
USD 233.000 - 321.000
Equity compensation
Bonus incentives