AML Model Testing Lead - AI-Driven QA & Compliance

RBC; Toronto; On-site; CAD 120,000 - 170,000; Full time

Benefits offered by this job

Total rewards program

Flexible benefits

Career coaching and development

Job summary

RBC is seeking an AML Model Testing Manager to support its enterprise AML program, ensuring accuracy and reliability of model code through testing and validation. You will design unit/integration tests, review model design context, and document recommendations to improve model logic and performance.

The role involves exploring AI technologies for AML model testing, developing AI agent workflows, and establishing QA mechanisms in an AI-involved work environment.

Qualifications

• Hands-on experience with SQL, SAS, Python and Dataiku for data processing, querying and automation.
• Post-secondary education or equivalent.
• Strong analytical, logical, and critical thinking skills with the ability to design complex testcases that covers all scenarios.
• Effective communication and collaboration skills to work effectively with cross-functional teams.

Responsibilities

• Gather relevant test information and model white paper to understand the model’s design background and update context.
• Work with Testing Lead to determine the testing priorities based on business requirements, define the testing scope and methodology and develop a testing plan.
• Set up the testing environment and develop testing programs to use during testing.
• Use the model white paper as a guideline to conduct code logic validation, implementing coding standard checks, compare difference between code and documentation, ensuring the code adheres to best practices and passes an initial logic review.
• Design unit tests, covering normal cases, abnormal cases, and corner cases to verify that the code consistently produces correct results that meet business requirements under all circumstances.
• Develop integration tests as needed to ensure that different modules, components, or systems function correctly together.
• Provide reasons for test failures along with suggestions for improvement based on the testing results.
• Collaborate closely with stakeholders to facilitate issue resolution and ensure the model passes all test cases.
• Prepare a detailed and well-structured test report documenting the testing methodologies, designed test cases, identified code issues, and corresponding resolutions.
• Ensure compliance with regulatory and internal documentation standards.
• Evaluate the applicability of existing AI tools in AML model testing
• Explore AI Agent workflow implementations to automate routine testing operations, including code logic validation, compliance auditing, and intelligent unit test generation, thereby enhancing testing efficiency and reducing manual workload.
• Explore how to define decision boundaries for AI Agents and establish triggers for human review checkpoints.
• Collaborate closely with Senior Manager and other stakeholders to align AML testing strategies with business needs.
• Stay informed of industry best practices in AML model development testing.
• Support process improvements to enhance efficiency and robustness in AML model code testing.

Skills

SQL

SAS

Python

Dataiku

Education

Post-secondary education or equivalent

Bachelor's degree in Statistics, Mathematics, Engineering and Computer Science, or a related field

Tools

Dataiku

Job description

RBC is seeking an AML Model Testing Manager to support its enterprise AML program, ensuring accuracy and reliability of model code through testing and validation. You will design unit/integration tests, review model design context, and document recommendations to improve model logic and performance.

The role involves exploring AI technologies for AML model testing, developing AI agent workflows, and establishing QA mechanisms in an AI-involved work environment.