AI Platform Architect — LLM Pipelines & Governance

Procore Technologies, Inc.; Austin (TX); On-site; USD 233,000 - 321,000; Full time

Job summary

Procore Technologies, Inc. seeks a senior architect to define the architecture for AI-native applications, including agentic systems, RAG pipelines, and multi-model inference layers. You will drive infrastructure decisions for scalable AI workloads and lead LLMOps and observability strategies.

You will partner with product and research to evaluate new AI capabilities, govern API design, and mentor senior engineers, fostering architectural governance across teams.

Qualifications

• 10+ years of software engineering with 5+ years in architect-level leadership.
• Hands-on experience shipping production LLM-powered applications.
• Experience building SaaS/enterprise software with full-stack teams.

Responsibilities

• Define architecture for AI-native apps including agentic systems and RAG pipelines.
• Drive infra decisions for scalable AI workloads and vector databases.
• Lead LLMOps, tracing, evaluation pipelines, and guardrails.
• Establish security, compliance, and supply chain security for models.
• Mentor engineers and promote ADRs and architectural governance.

Skills

Software architecture

LLM-powered apps

Full-stack development

React/TypeScript/Node.js

Python backend

API design

Cloud-native (Kubernetes)

Tools

Temporal

Prefect

Langfuse

Arize

Job description

Procore Technologies, Inc. seeks a senior architect to define the architecture for AI-native applications, including agentic systems, RAG pipelines, and multi-model inference layers. You will drive infrastructure decisions for scalable AI workloads and lead LLMOps and observability strategies.

You will partner with product and research to evaluate new AI capabilities, govern API design, and mentor senior engineers, fostering architectural governance across teams.