Cloud-Native AI Infra Lead

BMO Harris Bank; Chicago (IL); On-site; USD 120,000 - 250,000; Full time

Job summary

BMO Harris Bank is seeking a Principal AI & Cloud Engineer to design, build, and scale cloud-native AI solutions across the enterprise. You will define standards, mentor engineers, and partner with teams to deliver secure, observable AI at scale.

You will drive platform roadmaps, enable LLM/RAG workloads, and oversee GPU clusters, CI/CD, and FinOps. A strong cloud & AI background is required, with leadership responsibilities across multiple lines of business.

Qualifications

• Bachelor's/Master's/PhD in CS, Engineering, or related field.
• 7+ years building large-scale distributed cloud infrastructure.
• 5+ years hands-on with Azure/AWS.
• Proven experience with AI/ML infra: GPU clusters, Kubernetes, CI/CD, observability.
• Strong in IaC (Terraform/Bicep), Kubernetes, networking, security.
• Familiarity with MLOps/LLMOps infra: model serving, feature stores, vector DBs.
• Programming in Python (infra automation) and one of Go/TypeScript for tooling.

Responsibilities

• Design, build, and operate cloud-native AI infrastructure for ML/GenAI workloads.
• Compute: GPU/CPU clusters, autoscaling, spot instance strategies
• Networking: Azure VNet, Private Link, peering, multi-region HA/DR
• Storage & Databases: data lakes, relational DBs, vector DBs
• Security: IAM, Key Vault-backed secrets management, encryption
• Implement observability and reliability for AI infra
• Build CI/CD and GitOps pipelines for IaC and AI platform components
• Drive FinOps for AI infra: cost governance

Skills

Cloud infrastructure

Azure/AWS

Kubernetes

Python

IaC

Security

Education

Bachelor's/Master's/PhD in CS or related field

Tools

Terraform

Bicep

Kubernetes

Prometheus

OpenTelemetry

Job description

BMO Harris Bank is seeking a Principal AI & Cloud Engineer to design, build, and scale cloud-native AI solutions across the enterprise. You will define standards, mentor engineers, and partner with teams to deliver secure, observable AI at scale.

You will drive platform roadmaps, enable LLM/RAG workloads, and oversee GPU clusters, CI/CD, and FinOps. A strong cloud & AI background is required, with leadership responsibilities across multiple lines of business.