Senior Manager AI Model Validation

This is a high-visibility, high-impact role suitable for experienced data scientists who also have strong communications ability and business awareness, as well as the ability to make judgment calls in ambiguous situations. You will support Global AI Model Validation and Governance’s mandate of identifying, assessing, and communicating AI/ML model risks across all AI/ML models deployed across Manulife globally. You will provide thoughtful independent challenge ot models, weighing the risks and benefits and explaining your conclusions to technical and non-technical audiences alike.

You will interact heavily with model developers, business stakeholders, and other risk management teams, each potentially offering contrasting perspectives that you will have to navigate and align simultaneously. You will also be expected to use your data science experience to mentor and guide junior members of the team.

Position Responsibilities:  

• Provide independent challenge and constructive feedback for AI/ML, GenAI, and agentic models by identifying model weaknesses, limitations, assumptions, and risks, and recommending appropriate remediation actions.

• Manage competing deadlines, competing expectations, and coordinate procedural alignment to ensure the balance of risk management activities is commensurate with the business risk exposure.

• Communicate complex technical concepts and validation findings to technical and non-technical stakeholders, while ensuring that the risk management process is followed.

• Review model documentation, assess model design and performance, and communicate validation findings through clear, evidence-based reports and recommendations.

• Conduct model testing, benchmarking, sensitivity analysis, and other validation activities.

• When appropriate, evaluate whether AI models are reliable, fair, safe, explainable, and fit for their intended purpose.

• Support model inventory management, model risk operations and other AI governance processes.

• Mentor and support junior data scientists through technical coaching, knowledge sharing, and review of validation approaches and methodologies.

Required Qualifications: 

• Master's degree or higher in Statistics, Biostatistics, Data Science, Engineering, Mathematics, or a related quantitative field.

• At least 3-5 years of a mix of hands-on data science experience (data science, statistics, AI/ML model development, AI/ML research, model validation, model risk management, or a related quantitative discipline) and a stakeholder-exposed role (functions that interact with varying teams and business units across the organization.)

• Strong critical thinking skills and the ability to independently challenge assumptions and assess model risk in the context of the business problem it solves.

• Hands-on keyboard report writing and code implementation; being able to implement your ideas yourself.

• Experience interpreting model performance metrics and conducting quantitative analyses in a variety of standard and non-standard contexts. 

• Strong communication, written documentation, and stakeholder management skills.

• The ability to collaborate with parties from all walks of a large corporation.

Preferred Qualifications: 

• Prior model validation experience for AI/ML models or development of AI/ML models for production environments with tangible risk exposures. Comparable experience includes model development in stringently risk-controlled contexts such as pharmaceuticals, aerospace, etc.

• Knowledge of AI governance and model risk regulatory expectations, with emphasis on OSFI E-23.

• Familiarity with Responsible AI concepts, including fairness, explainability, robustness, transparency, safety, and monitoring. Being passionate about Responsible AI is a plus.

• Experience evaluating Generative AI, LLMs, RAG systems, or agentic AI solutions built or customized to solve a very broad range of business problems.

• Experience developing validation frameworks, testing libraries, or automated assurance tooling.

• Experience working in a global, cross-functional environment.

• Experience performing research on AI/ML models in academic or industry settings.

When you join our team: 

• We’ll empower you to learn and grow the career you want.
• We’ll recognize and support you in a flexible environment where well-being and inclusion are more than just words.
• As part of our global team, we’ll support you in shaping the future you want to see.

#LI-Hybrid

The role being advertised is an existing vacancy.

About Manulife and John Hancock

Manulife Financial Corporation is a leading international financial services provider, helping people make their decisions easier and lives better. To learn more about us, visit https://www.manulife.com/en/about/our-story.html.

Manulife is an Equal Opportunity Employer

At Manulife/John Hancock, we embrace our diversity. We strive to attract, develop and retain a workforce that is as diverse as the customers we serve and to foster an inclusive work environment that embraces the strength of cultures and individuals. We are committed to fair recruitment, retention, advancement and compensation, and we administer all of our practices and programs without discrimination on the basis of race, ancestry, place of origin, colour, ethnic origin, citizenship, religion or religious beliefs, creed, sex (including pregnancy and pregnancy-related conditions), sexual orientation, genetic characteristics, veteran status, gender identity, gender expression, age, marital status, family status, disability, or any other ground protected by applicable law.

It is our priority to remove barriers to provide equal access to employment. A Human Resources representative will work with applicants who request a reasonable accommodation during the application process. All information shared during the accommodation request process will be stored and used in a manner that is consistent with applicable laws and Manulife/John Hancock policies. To request a reasonable accommodation in the application process, contact [email protected].

Referenced Salary Location

Toronto, OntarioHybrid

Salary range is expected to be between

$129,400.00 CAD - $179,400.00 CAD

Employees also have the opportunity to participate in incentive programs and earn incentive compensation tied to business and individual performance. The actual salary will vary depending on local market conditions, geography and relevant job-related factors such as knowledge, skills, qualifications, experience, and education/training. If you are applying for this role outside of the primary location, please contact [email protected] for the salary range for your location.

Manulife offers eligible employees a wide array of customizable benefits, including health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage, adoption/surrogacy and wellness benefits, and employee/family assistance plans. We also offer eligible employees various retirement savings plans (including pension and a global share ownership plan with employer matching contributions) and financial education and counseling resources. Our generous paid time off program in Canada includes holidays, vacation, personal, and sick days, and we offer the full range of statutory leaves of absence. If you are applying for this role in the U.S., please contact [email protected] for more information about U.S.-specific paid time off provisions.

We use data and analytics technologies, such as artificial intelligence (AI), and automated processing tools, to analyze and process the information you provide to us or third parties in the application process. For more information, please refer to our personal information collection statement.