AI Platform Architect: Scale & LLM Ops

Procore

Austin (TX)

On-site

USD 233,000 - 321,000

Full time

14 days+

Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

Procore seeks an experienced AI Application Architect to lead the design and evolution of its AI-powered product suite. You will shape AI-native applications across agent orchestration, LLM infra, data pipelines, and developer tooling.

You will define scalable architectures, drive secure implementations, and mentor engineers while partnering with product and ML practitioners to translate ambitious AI capabilities into production-grade systems.

Qualifications

10+ years of software engineering with 5+ years in architect-level roles.
Hands-on experience shipping production LLM-powered apps.
Experience building SaaS/enterprise platforms.
Strong frontend (React, TS/Node) with Python API design.
Knowledge of RBAC/ABAC, audit logging, multi-tenant governance.
Security-minded with cost governance for AI systems.
Cloud-native infra (Kubernetes, Helm) experience.

Responsibilities

Define architecture for AI-native apps with agentic systems and LLM integration.
Lead infrastructure decisions for scalable AI workloads and data pipelines.
Govern the integration layer between LLMs and backend services.
Lead LLMOps and observability strategies with tracing and evaluation.
Establish security posture and compliance for AI systems.
Collaborate with product/research on new AI capabilities adoption.
Champion engineering standards, API design, and ADRs.
Mentor senior engineers and foster AI platform communities.