Principal AI Cloud Platform Engineer

BMO; San Francisco (CA); On-site; USD 120,000 - 250,000; Full time

Benefits offered by this job

Health insurance

Tuition reimbursement

Accident insurance

Life insurance

Retirement savings plans

Job summary

BMO Financial Group seeks a Principal AI & Cloud Engineer to design, build, and scale cloud-native AI solutions at enterprise scale in SF. You will set standards, mentor engineers, and partner across teams to deliver governed AI platforms with robust observability and cost controls.

The role spans model serving, LLMOps, security, and compliance, with emphasis on scalable infrastructure, multi-region resilience, and sustainable FinOps. Competitive salary and benefits included.

Qualifications

• Bachelor’s/Master’s/PhD in CS, Engineering, or related field required.
• 7+ years building large-scale distributed cloud infrastructure.
• 5+ years hands-on with Azure/AWS.
• Proven experience with AI/ML infra: GPU clusters, Kubernetes, CI/CD, observability.
• Strong in IaC (Terraform/Bicep), Kubernetes, networking, security.
• Familiarity with MLOps/LLMOps infra: model serving, feature stores, vector DBs.
• Programming in Python (infra automation) and one of Go/TypeScript for tooling.

Responsibilities

• Design, build, and operate cloud-native AI infrastructure for ML/GenAI workloads.
• Compute: GPU/CPU clusters, autoscaling, spot instance strategies.
• Networking: Azure VNet, Private Link, peering, multi-region HA/DR.
• Storage & Databases: high-performance data lakes, relational DBs, vector DBs.
• Security: IAM, Key Vault-backed secrets management, encryption, policy-as-code.
• Implement observability and reliability for AI infra: metrics, logging/tracing, SLOs/SLIs.
• Build CI/CD and GitOps pipelines for infrastructure-as-code and AI platform components.
• Drive FinOps for AI infra: GPU rightsizing, caching, cost governance.

Skills

Azure/AWS

Kubernetes

Terraform/Bicep

Python automation

Go/TypeScript

CI/CD

Observability

Security

MLOps/LLMOps

Frontend-Backend integration

Education

Bachelor’s/Master’s/PhD in CS, Engineering, or related field

Tools

FAISS

Milvus

Pinecone

pgvector

TensorRT-LLM

KServe

Hugging Face

OpenTelemetry

Prometheus

Terraform

Bicep

Job description

BMO Financial Group seeks a Principal AI & Cloud Engineer to design, build, and scale cloud-native AI solutions at enterprise scale in SF. You will set standards, mentor engineers, and partner across teams to deliver governed AI platforms with robust observability and cost controls.

The role spans model serving, LLMOps, security, and compliance, with emphasis on scalable infrastructure, multi-region resilience, and sustainable FinOps. Competitive salary and benefits included.