Senior AI Model Validation & Governance Lead

John Hancock; Boston (MA); Híbrido; USD 92.000 - 127.000; Tempo integral

Resumo da vaga

Manulife/John Hancock is seeking an experienced data scientist to validate AI/ML models, including GenAI, ensuring reliability, fairness, safety, and alignment with Responsible AI principles. You will collaborate with developers, stakeholders, and governance teams to assess risk and provide evidence-based validation reports.

The role involves mentoring junior scientists, participating in AI governance processes, and contributing to continuous improvement of model risk practices within a hybrid

Qualificações

• Master's degree or higher in a quantitative field.
• 3–5 years of hands-on data science and AI/ML experience.
• Experience developing, testing, validating AI/ML models in production with Generative AI.
• Strong critical thinking and ability to challenge assumptions and assess risk.
• Experience interpreting model performance metrics and performing quantitative analyses.
• Strong communication, documentation, and stakeholder management skills.

Responsabilidades

• Independently validate AI/ML and GenAI models, assessing design, performance, limitations, and risks.
• Conduct model testing, benchmarking, sensitivity analysis, and other validation activities.
• Evaluate whether AI models are reliable, fair, safe, explainable, and fit for purpose.
• Provide independent challenge and feedback to model developers with remediation recommendations.
• Review model documentation and communicate validation findings clearly.
• Support model inventory management, model risk operations, and AI governance processes.
• Communicate complex concepts to technical and non-technical stakeholders.
• Contribute to continuous improvement of AI governance and model risk practices.
• Mentor and coach junior data scientists.

Conhecimentos

Master's degree or higher in a related

Production AI/ML experience

Model risk management

Critical thinking and risk assessment

Quantitative analysis

Communication and stakeholder mgmt

Formação

Master's degree or higher in Computer Science, Data Science, Statistics, Engineering, Mathematics

Descrição da vaga

Manulife/John Hancock is seeking an experienced data scientist to validate AI/ML models, including GenAI, ensuring reliability, fairness, safety, and alignment with Responsible AI principles. You will collaborate with developers, stakeholders, and governance teams to assess risk and provide evidence-based validation reports.

The role involves mentoring junior scientists, participating in AI governance processes, and contributing to continuous improvement of model risk practices within a hybrid