Data Scientist, Model Performance Monitoring and Reporting

CIBC; Toronto; Hybrid; CAD 85,000 - 125,000; Full time

Benefits offered by this job

Competitive salary

Incentive pay

Banking benefits

Benefits program

Pension plan

Employee share purchase plan

Vacation offering

Wellbeing support

MomentMakers

Job summary

CIBC is seeking a Data Scientist, Model Performance Monitoring and Reporting, to monitor fraud-detection models and report findings to US Fraud partners. You will apply SQL and Python to prepare data, assess performance, and communicate insights.

The role involves developing monitoring pipelines and supporting the transition from SAS to Databricks in a hybrid Toronto-based setting. You will collaborate with data scientists and business partners, applying statistical knowledge to interpret

Qualifications

• Strong SQL and Python programming skills with ability to query, prep and analyze data.
• Solid foundation in statistics and model evaluation concepts.
• Understanding of the model lifecycle: development, evaluation, deployment and monitoring.

Responsibilities

• Monitor model performance and report outcomes to business partners.
• Develop reliable monitoring pipelines using SQL, Python; transition SAS to Databricks.
• Interpret monitoring results and connect findings to model development and usage.
• Collaborate with US Fraud partners to understand monitoring needs and communicate findings clearly.
• Contribute to ongoing improvement of monitoring practices with the team.

Skills

SQL

Python

Statistics

Model Monitoring

Data Analysis

Databricks

Machine Learning

Model Development

Education

Statistics/Math/CS degree

Tools

Databricks

Job description

We're building a relationship-oriented bank for the modern world. We need talented, passionate professionals who are dedicated to doing what's right for our clients.

At CIBC, we embrace your strengths and your ambitions, so you are empowered at work. Our team members have what they need to make a meaningful impact and are truly valued for who they are and what they contribute.

To learn more about CIBC, please visit CIBC.com

What you'll be doing

The Advanced Analytics and AI team is the central hub of data science and AI expertise within CIBC and is leading the way to apply the best practices in predictive science, machine learning, artificial intelligence and leverage the latest in big data technology platforms. We also engage with the leading academic & research institutes in the space of AI and machine learning to promote the exchange of latest technology developments and enrich our talents. Reporting to the Senior Director, Advanced Analytics & AI, you'll support CIBC US Fraud by monitoring and reporting on the performance of existing fraud detection models, including models developed internally and by external vendors. As a Data Scientist, Model Performance Monitoring and Reporting, you'll apply your SQL, Python and statistical knowledge to assess model performance, identify changes and communicate findings to business partners, supporting ongoing oversight and compliance requirements.

At CIBC we enable the work environment most optimal for you to thrive in your role you'll have the flexibility to manage your work activities within a hybrid work arrangement where you'll spend 1-3 days per week on-site, while other days will be remote.

How you'll succeed

• Monitor model performance. Apply statistical methods to measure and track the performance of existing fraud detection models. Investigate changes in results, identify potential performance concerns and prepare accurate, timely reporting to support business oversight.
• Develop reliable monitoring processes. Use SQL and Python to access, prepare and analyze data, calculate performance measures and develop reusable code. Contribute to automated monitoring pipelines and the transition from existing SAS processes to Databricks.
• Understand the model lifecycle. Apply your understanding of model development, evaluation and deployment to interpret monitoring results and connect findings to how models were developed and are used.
• Partner with the business. Work directly with US Fraud partners to understand monitoring needs, explain statistical findings clearly and communicate issues that require further investigation or action.
• Collaborate and continuously improve. Work with fellow data scientists and technical leads to strengthen monitoring practices, document processes and support continuity across the team. Bring curiosity, initiative and a willingness to learn and test new approaches.

Who you are

• You can demonstrate experience in SQL and Python. You can write code to query, combine, prepare and analyze data, with an emphasis on accuracy, readability and repeatability. You have a strong foundation in statistics, and you understand statistical concepts and can apply them to evaluate model performance, interpret results and investigate changes over time. You understand the model development lifecycle and are familiar with how machine learning models are developed, evaluated, deployed and monitored, and how these stages connect.

• You have a degree/diploma in statistics, mathematics, computer science, engineering or related quantitative discipline, or equivalent practical experience.

• You give meaning to data. You enjoy investigating complex problems and making sense of information. You communicate detailed information in a meaningful way.

• You love to learn. You're passionate about growing your knowledge. You have a strong sense of curiosity.

• You know that details matter. You communicate clearly and can explain technical concepts to different audiences, ask thoughtful questions and build effective relationships with business and technical partners.

• You live your values. You bring high standards, genuine care to your relationships, and want to grow with an employer that shares your values and brings out your best.

#LI-TA

What CIBC Offers

At CIBC, your goals are a priority. We start with your strengths and ambitions as an employee and strive to create opportunities to tap into your potential. We aspire to give you a career, rather than just a paycheck.

• We work to recognize you in meaningful, personalized ways including a competitive salary, incentive pay, banking benefits, a benefits program*, defined benefit pension plan*, an employee share purchase plan, a vacation offering, wellbeing support, and MomentMakers, our social, points-based recognition program.
• Our spaces and technological toolkit will make it simple to bring together great minds to create innovative solutions that make a difference for our clients.
• We cultivate a culture where you can express your ambition through initiatives like Purpose Day; a paid day off dedicated for you to use to invest in your growth and development.

*Subject to plan and program terms and conditions

What you need to know

• CIBC is committed to creating an inclusive environment where all team members and clients feel like they belong. We seek applicants with a wide range of abilities and we provide an accessible candidate experience. If you need accommodation, please contact [e-mail]
• CIBC is committed to clarity in our hiring process. All roles posted are opportunities we're actively recruiting for, unless stated otherwise.
• You need to be legally eligible to work at the location(s) specified above and, where applicable, must have a valid work or study permit.
• We may ask you to complete an attribute-based assessment and other skills test (such as simulation, coding, French proficiency).
• We use artificial intelligence tools during the recruitment process. Our goal for the application process is to get to know more about you, all that you have to offer, and give you the opportunity to learn more about us.

Job Location

Toronto-81 Bay, 21st Floor

Employment Type

Regular

Weekly Hours

37.5

Skills

Advanced Analytics, Data Analysis, Databricks Platform, Data Science, Machine Learning (ML), Model Development, Model Monitoring, Performance Modeling, Predictive Modeling, Python (Programming Language), Python Automation, Statistics