Applied Machine Learning Scientist II, Generative AI (4043)

TD; Canada; On-site; CAD 114,000 - 154,000; Full time

Job summary

A financial institution in Toronto seeks an AI/ML Model Validation Specialist. The role involves validating Generative AI and Deep Learning models, developing validation methodologies, and communicating insights to various stakeholders. Candidates should have strong quantitative skills, an advanced degree in a relevant field, and experience with AI/ML technologies. Competitive salary range of $114,000 - $154,000 CAD offered, ensuring a rewarding career path with ongoing growth opportunities.

Qualifications

• Advanced degree in fields such as computer science or statistics.
• Proven experience in Generative AI or Machine Learning roles.
• Strong knowledge of AI/ML methodologies.

Responsibilities

• Validate AI/ML models and stay updated on Generative AI advancements.
• Develop and implement model validation methodologies.
• Communicate findings to stakeholders.

Skills

Strong quantitative skills

Experience with Generative AI

Proficiency in Python

Deep Learning knowledge

Education

Advanced degree in relevant fields (Computer Science, Mathematics, etc.)

Tools

PyTorch

TensorFlow/Keras

SQL

Job description

Work Location: Toronto, Ontario, Canada

Hours: 37.5

Line of Business: Analytics, Insights, & Artificial Intelligence

Pay Details: $114,000 - $154,000 CAD

The pay details posted reflect a temporary market premium specific to this role that is reassessed annually. TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defining features of the colleague experience at TD. Our compensation policies and practices have been designed to allow colleagues to progress through the salary range over time as they progress in their role. The base pay actually offered may vary based upon the candidate's skills and experience, job-related knowledge, geographic location, and other specific business and organizational needs.

As a candidate, you are encouraged to ask compensation related questions and have an open dialogue with your recruiter who can provide you more specific details for this role.

Department Overview

TD Model Validation (MV) group is responsible for the independent validation and approval of models used for Generative AI, Natural Language Processing (NLP), credit, fraud, and marketing models. The Artificial Intelligence/Machine Learning (AI/ML) MV team is responsible for the validation of all AI/ML models used across the Bank for various use cases.

Job Description

The position reports to Senior Manager in the AI/ML Model Validation team and is primarily focused on the validation and review of Generative AI and Deep Learning models.

Responsibilities

• Validate (review, test, and provide effective challenge) AI/ML models, particularly Generative AI and Deep Learning models.
• Stay up to date with advancements in the field of Generative AI including major publications, important Large Language Models (LLMs), evaluation metrics, technology stacks, and datasets.
• Maintain full professional knowledge of techniques and developments in the field of AI/ML and share knowledge with business partners and senior management.
• Develop/implement AI/ML model validation methodologies and standards. Ensure that the validation methodologies and standards are in line with industry best practices and address regulatory and audit requirements.
• Develop and apply a variety of statistical tests and modeling techniques to identify/recommend improvements to models and undertake related initiatives. Implement benchmark models as applicable.
• Conduct R&D in the area of GenAI / Agentic AI / LLM evaluation, testing, explainability.
• Communicate findings and recommendations to both technical and non-technical stakeholders.

The position involves working effectively with different internal partners such as AI2, Layer6, P&T, and FCRM.

Job Requirements

• Strong quantitative skills with an advanced degree in one or more of the following areas: computer science, machine learning, engineering, statistics, mathematics, or physics.
• Proven experience as Generative AI Scientist, Machine Leaning Scientist, or a similar role.
• Experience with and strong knowledge of AI/ML methodologies including Generative AI, Agentic AI, Deep Learning, modern Natural Language Processing (NLP), Retrieval-Augmented Generation (RAG), Transformers, Diffusion models, and Bagging/Boosting methods.
• Experience with Deep Learning and Generative AI technology stacks and libraries such as PyTorch, Tensorflow/Keras, LangChain, HuggingFace, PromptFlow, etc.
• Motivated to stay up to date with the latest advancements in Generative AI, Prompt Engineering, Machine Learning, and Cloud technologies.
• Proficient in one or more scripting/programming languages such as Python, Java, Scala.
• Familiarity with cloud platforms (e.g., Azure, AWS).
• Familiarity with Data Structures, Algorithm design, and principles of Object-Oriented Programming (OOP).
• Knowledge of machine learning explain-ability/interpretability algorithms.
• Excellent verbal and written communication skills. The position requires writing clean technical reports.
• Ability to work independently and collaboratively in a fast-paced, dynamic environment. Great time management and multitasking skills with minimal supervision.

Preferred Qualifications

• Publications in the relevant conference and journals is a plus.
• Ability to implement AI/ML algorithms from academic research papers is a plus.
• Knowledge of SQL and database systems.

Language Requirement (Quebec only)

Sans Objet