Senior AI Platform Architect

Procore Technologies; Austin (TX); On-site; USD 233,000 - 321,000; Full time

Benefits offered by this job

Equity Compensation

Bonus Incentive Compensation

Job summary

Procore Technologies is seeking an experienced AI Application Architect to lead the design and evolution of our AI-powered product suite. You will serve as the technical authority for scalable, secure AI-native applications, spanning agent orchestration, LLM infrastructure, data pipelines, and developer tooling.

You will mentor senior engineers, define ADRs, and collaborate with product and ML teams to translate ambitious AI capabilities into production-grade systems.

Qualifications

• 10+ years of software engineering with 5+ years in principal/staff or architect roles.
• Hands-on experience designing and shipping production LLM-powered apps.
• Experience shipping complex SaaS platforms with rich web UX and strong backend/API design.
• Strong React/TypeScript/Node.js frontend and Python backend proficiency.
• Deep understanding of enterprise requirements: RBAC/ABAC, audit logging, multi-tenant governance, admin tooling.
• Experience with cloud-native architectures (Kubernetes, CI/CD) on AWS/GCP/Azure.
• Knowledge of API security (OAuth2, CSRF, rate limiting, secrets management, zero-trust).

Responsibilities

• Define architecture for AI-native applications including agentic systems and RAG pipelines.
• Drive infrastructure decisions for scalable AI workloads and vector databases.
• Design and govern integration between LLMs and backend services, including prompt management.
• Lead LLMOps and observability strategy with tracing and evaluation pipelines.
• Establish security posture for AI systems and data residency.

Skills

AI architecture

LLM infra

Cloud-native

Security/compliance

Leadership/mentoring

API design

Frontend/backend balance

RBAC/ABAC

Tools

Kubernetes

Helm

Temporal

Airflow

Langfuse/Arize

Job description

Procore Technologies is seeking an experienced AI Application Architect to lead the design and evolution of our AI-powered product suite. You will serve as the technical authority for scalable, secure AI-native applications, spanning agent orchestration, LLM infrastructure, data pipelines, and developer tooling.

You will mentor senior engineers, define ADRs, and collaborate with product and ML teams to translate ambitious AI capabilities into production-grade systems.