Senior Cloud AI Architect & LLMOps Leader

BMO; San Francisco (CA); On-site; USD 120,000 - 250,000; Full time

Benefits offered by this job

Health insurance

Tuition reimbursement

Accident and life insurance

Retirement savings plans

Job summary

BMO is seeking a Principal AI & Cloud Engineer to design, build, and scale cloud-native AI solutions across the bank. You will set engineering standards, mentor engineers, and partner with teams to deliver secure, cost-efficient AI at enterprise scale.

You’ll shape reference architectures, multi-cloud patterns, and observability, while advancing AI cloud strategy from model serving to security and governance.

Qualifications

• 7+ years building large-scale distributed cloud infrastructure.
• 5+ years hands-on with Azure/AWS.
• Experience with AI/ML infra: GPU clusters, Kubernetes, CI/CD.
• Familiarity with MLOps/LLMOps infra: model serving, feature stores, vector DBs.
• Proficiency in Python and one of Go/TypeScript.

Responsibilities

• Design, build, and operate cloud-native AI infrastructure for ML/GenAI workloads.
• Implement observability and reliability for AI infra.
• Build CI/CD and GitOps pipelines for infrastructure-as-code.
• Drive FinOps for AI infra: GPU rightsizing and cost governance.
• Lead infrastructure discovery and solution design with stakeholders.

Skills

Distributed infra

Azure/AWS

AI/LLMOps infra

Kubernetes

Terraform/Bicep

Python

Go/TypeScript

Security & Observability

SRE

Cost governance

Education

Bachelor’s/Master’s/PhD in CS or Engineering

Tools

Kubernetes

Terraform

Bicep

OpenTelemetry

Prometheus

Job description

BMO is seeking a Principal AI & Cloud Engineer to design, build, and scale cloud-native AI solutions across the bank. You will set engineering standards, mentor engineers, and partner with teams to deliver secure, cost-efficient AI at enterprise scale.

You’ll shape reference architectures, multi-cloud patterns, and observability, while advancing AI cloud strategy from model serving to security and governance.