Senior AI Cloud Engineer — Platform & LLMOps

BMO; Chicago (IL); On-site; USD 120,000 - 250,000; Full time

Benefits offered by this job

Health insurance

Tuition reimbursement

Retirement plans

Job summary

BMO Financial Group is seeking a Principal AI & Cloud Engineer in Chicago to design, build, and scale cloud-native AI infrastructure for enterprise-scale GenAI workloads. You will set engineering standards, mentor engineers, and partner with teams across the bank to deliver governed, cost-efficient AI at scale.

You will lead reference architectures, implement secure APIs and CI/CD pipelines, and drive platform roadmaps for faster delivery with lower risk.

Qualifications

• 7+ years in building large-scale distributed cloud infrastructure.
• 5+ years hands-on with Azure/AWS.
• Experience with AI/ML infra: GPU clusters and model serving.
• Proficient in IaC (Terraform/Bicep) and Kubernetes.
• Python for infra automation; Go or TypeScript for tooling.

Responsibilities

• Design, build, and operate cloud-native AI infrastructure for ML/GenAI workloads.
• Compute: GPU/CPU clusters, autoscaling, spot instance strategies.
• Networking: Azure VNet, Private Link, peering, multi-region HA/DR.
• Storage & Databases: data lakes, relational DBs, vector DBs.
• Security: IAM, Key Vault-backed secrets management, encryption, policy-as-code.
• Implement observability and reliability for AI infra: metrics, logging, SLOs/SLIs.
• Build CI/CD and GitOps pipelines for IaC and AI platform components.
• Drive FinOps for AI infra: GPU rightsizing, caching, cost governance.

Skills

Cloud infrastructure

Azure/AWS

Kubernetes

AI/ML infra

IaC (Terraform/Bicep)

Python scripting

Go/TypeScript tooling

Security/compliance

Education

Bachelor’s/Master’s/PhD in CS/Engineering

Tools

Terraform

Bicep

OpenTelemetry

Job description

BMO Financial Group is seeking a Principal AI & Cloud Engineer in Chicago to design, build, and scale cloud-native AI infrastructure for enterprise-scale GenAI workloads. You will set engineering standards, mentor engineers, and partner with teams across the bank to deliver governed, cost-efficient AI at scale.

You will lead reference architectures, implement secure APIs and CI/CD pipelines, and drive platform roadmaps for faster delivery with lower risk.