Senior Principal AI Engineer

rbc; Toronto; On-site; CAD 180,000 - 240,000; Full time

Job summary

RBC in Toronto is seeking a Senior Principal AI Engineer to lead enterprise-scale ML infrastructure and automation across on-prem and cloud. You will shape tools, standards, and deployment pipelines for data and ML applications.

You will mentor engineers, collaborate with researchers, and guide infrastructure decisions leveraging GCP Vertex AI, LangChain, and modern MLOps stacks to scale AI across the bank.

Qualifications

• Extensive experience designing and implementing distributed ML systems at scale.
• Hands-on experience with GCP services, particularly Vertex AI for model training, deployment, and monitoring
• Experience building and integrating Generative AI solutions, including LLMs, RAG architectures, and AI harnesses/orchestration frameworks (e.g., LangChain, LlamaIndex)
• Proficiency with MLOps orchestration tools such as AirFlow, KubeFlow, Dagster, or Flyte
• Experience with DevOps pipelines (Jenkins, GitHub Actions)
• Strong programming skills in Python; familiarity with Bash or JavaScript a plus
• Hands-on experience deploying hybrid environments across GCP, AWS, and/or Azure
• Familiarity with ML frameworks such as PyTorch or TensorFlow
• Knowledge of software engineering best practices including testing, code reviews, and source control

Responsibilities

• Leading the design, architecture, and optimization of machine learning deployment tools and automation systems that operate the business's data and ML applications
• Defining and implementing best practices and standards for data and machine learning pipelines across the organization
• Collaborating with engineers and machine learning researchers to automate code analysis, build, integration, and deployment of ML applications
• Providing technical guidance on infrastructure design decisions and monitoring solutions
• Building highly scalable, resilient cloud and on-premise systems for hosting machine learning systems using state-of-the-art technologies, including Google Cloud Platform (GCP) and Vertex AI
• Mentoring junior engineers and contributing to team growth and technical excellence

Skills

Distributed ML

GCP Vertex AI

Generative AI / LLMs

MLOps / DevOps

Python

Hybrid cloud

Cloud reliability

Tools

AirFlow

KubeFlow

Dagster

Flyte

Jenkins

GitHub Actions

PyTorch

TensorFlow

LangChain

LlamaIndex

Job description

Job Description

What is the opportunity? We’re looking for an experienced Senior Principal AI Engineer who will bring strategic leadership and deep subject-matter expertise in designing and implementing enterprise-scale AI/ML infrastructure, automation tools (MLOps and DevOps), and cloud-native AI solutions. This is a unique opportunity to lead and shape the future of machine learning infrastructure and work with a team of passionate individuals committed to bringing ML to the enterprise.

What will you do?

• Leading the design, architecture, and optimization of machine learning deployment tools and automation systems that operate the business's data and ML applications
• Defining and implementing best practices and standards for data and machine learning pipelines across the organization
• Collaborating with engineers and machine learning researchers to automate code analysis, build, integration, and deployment of ML applications
• Providing technical guidance on infrastructure design decisions and monitoring solutions
• Building highly scalable, resilient cloud and on-premise systems for hosting machine learning systems using state-of-the-art technologies, including Google Cloud Platform (GCP) and Vertex AI
• Mentoring junior engineers and contributing to team growth and technical excellence

What do you need to succeed?

• Extensive experience designing and implementing distributed ML systems at scale
• Hands-on experience with GCP services, particularly Vertex AI for model training, deployment, and monitoring
• Experience building and integrating Generative AI solutions, including LLMs, RAG architectures, and AI harnesses/orchestration frameworks (e.g., LangChain, LlamaIndex)
• Proficiency with MLOps orchestration tools such as AirFlow, KubeFlow, Dagster, or Flyte
• Experience with DevOps pipelines (Jenkins, GitHub Actions)
• Strong programming skills in Python; familiarity with Bash or JavaScript a plus
• Hands-on experience deploying hybrid environments across GCP, AWS, and/or Azure
• Familiarity with ML frameworks such as PyTorch or TensorFlow
• Knowledge of software engineering best practices including testing, code reviews, and source control

About the AI Group:

RBC's AI Group is the AI accelerator for RBC, with a focus on driving the shift from early-stage AI projects to scaled, client outcomes that amplify the impact of RBC’s people. In addition to helping scale the biggest AI opportunities at RBC, the AI Group is responsible for advancing research into emerging use cases across generative and agentic AI, while maintaining expertise in security, responsible AI and regulatory expectations. The Business Enablement function within the AI Group partners with LOBs and Functions to set AI ambition, originate transformation opportunities, and frame programs for delivery - ensuring RBC remains at the frontier of AI-enabled value creation.

Inclusion and Equal Opportunity Employment

RBC is an equal opportunity employer committed to diversity and inclusion. We are pleased to consider all qualified applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veterans status, Aboriginal/Native American status or any other legally-protected factors. Disability-related accommodations during the application process are available upon request.

Job Skills

Big Data Management, Data Modeling, Data Science, Decision Making, Deep Learning, Machine Learning (ML), Predictive Analytics, Programming Languages, Relationship Building

Additional Job Details

• Address: RBC WATERPARK PLACE, 88 QUEENS QUAY W
• City: Toronto
• Country: Canada
• Work hours/week: 37.5
• Employment Type: Full time
• Platform: TECHNOLOGY AND OPERATIONS
• Job Type: Regular
• Pay Type: Salaried
• Posted Date: 2026-07-08
• Application Deadline: 2026-10-31 Note : Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Our Employment Opportunities

At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.

Join our Talent Community

Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.

Expand your limits and create a new future together at RBC. Find out how we use our passion and dr