VP - AI Governance

Nomura Holdings, Inc.; Mumbai; On-site; INR 1,000,000 - 1,500,000; Full time

Benefits offered by this job

Comprehensive wellbeing services

Inclusive benefits for diverse identities

Support for work-life balance

Job summary

A global financial services group is seeking an AI operations professional to design and implement AI testing frameworks and metrics to ensure reliable and high-performing AI systems. This role blends data science with AI governance, focusing on establishing standards for performance and compliance. Candidates should possess a background in quality assurance, programming skills in Python or R, and familiarity with AI governance frameworks. Offering a chance to influence the future of AI system safety while working in a supportive environment.

Qualifications

• Experience with AI governance frameworks or regulatory compliance.
• Background in quality assurance or testing methodologies.
• Programming proficiency in Python or R.
• Strong foundation in statistical methods and hypothesis testing.
• Experience with visualization tools like Tableau, Power BI.

Responsibilities

• Design AI testing frameworks for model validation and safety assessment.
• Develop automated testing pipelines for AI model deployment.
• Implement key performance indicators for AI systems.
• Collaborate with compliance teams for regulatory adherence.
• Analyze large-scale AI system performance data.

Skills

AI governance frameworks

Quality assurance

Multi-agent systems

Real-time monitoring

Programming (Python/R)

Statistical analysis

Data visualization tools

Database management (SQL)

Cloud platforms (AWS/Azure/GCP)

Version control (Git)

Education

Certification in data science or machine learning

Tools

Tableau

Power BI

AWS Bedrock

Snowflake

Redshift

Job description

Nomura is a financial services group with an integrated global network. By connecting markets East & West, Nomura services the needs of individuals, institutions, corporates and governments through its four business divisions: Wealth Management, Investment Management, Wholesale (Global Markets and Investment Banking), and Banking. Founded in 1925, the firm is built on a tradition of disciplined entrepreneurship, serving clients with creative solutions and considered thought leadership. For further information about Nomura, visit www.nomura.com

Nomura Services, India supports the group’s global businesses. With world-class capabilities in trading support, research, information technology, financial control, operations, risk management and legal support, the firm plays a key role in facilitating the group’s global operations across four international regions.

At Nomura, creating an inclusive workplace is a priority. Our approach to inclusion encompasses a variety of initiatives, including sensitization campaigns, implementing conducive policies & programs, providing infrastructure support and engaging in community events. Over time, we have made meaningful progress in these areas, and this commitment has been well-recognized across the industry. We are proud recipients of the prestigious Top 10 Employers award by the India Workplace Equality Index (IWEI), IWEI Gold Employer of Choice awards, India CSR Leadership Award 2024 for Holistic Village Development Program and the YUVA Unstoppable Changemaker Awards.

Divisional Overview:

The Chief Data Office (CDO) plays a key role in defining and implementing the firm's data strategy and is responsible for defining and overseeing effective data, Cloud and AI governance for Nomura to enable data-driven regulatory compliance, data risk mitigation and improved data usability for analytics and AI. It is the central authority overseeing the Business and Corporate functions in complying with data, Cloud and AI governance requirements.

What We Offer:

• We support employee wellbeing by ensuring a sense of purpose and belonging.
• We offer a comprehensive range of wellbeing services which allows employees to get access to the assistance they need at any point in their wellbeing journey.
• Our bespoke benefits support employees and their family’s holistic wellbeing and are inclusive of diverse identities and family structures.

Position Specifications:

We are seeking an AI operations professional to design and implement comprehensive AI testing frameworks and operational effectiveness metrics that ensure reliable, safe, and high-performing AI systems. This role combines data science expertise with AI governance to establish measurable standards for AI system performance and safety.

This role offers the opportunity to shape the future of AI system reliability and safety while working at the intersection of data science, AI governance, and operational excellence.

Role & Responsibilities:

Framework Development

• Design and build comprehensive AI testing frameworks covering model validation, performance monitoring, and safety assessment
• Develop automated testing pipelines for AI model deployment and continuous monitoring
• Create standardized methodologies for evaluating AI system reliability across different use cases
• Establish benchmarking protocols for comparing AI system performance over time

Metrics Design & Implementation

• Define and implement key performance indicators including
• Model failure rates and error classification systems
• Human intervention frequency and trigger analysis
• Reasoning quality assessment metrics
• Tool utilization success rates and efficiency measures
• Output validation accuracy and consistency scores
• Cross-agent conflict detection and resolution metrics
• Guardrail violation rates and severity classification
• Build real-time monitoring dashboards and alerting systems
• Develop statistical models to analyze AI outputs

AI Governance & Compliance

• Collaborate with compliance teams to ensure testing frameworks meet regulatory requirements
• Document testing methodologies and maintain audit trails for governance purposesEstablish risk assessment protocols for AI system deployment
• Create reporting mechanisms for stakeholders and regulatory bodies

Data Analysis & Insights

• Analyze large-scale AI system performance data to identify patterns and improvement opportunities
• Conduct root cause analysis on system failures and performance anomalies
• Generate actionable insights from operational metrics to guide system optimization
• Present findings and recommendations to technical and business stakeholders

Mandatory Skill Set :

• Experience with AI governance frameworks or regulatory compliance
• Background in quality assurance or testing methodologies
• Knowledge of multi-agent systems and AI orchestration platforms
• Experience with real-time monitoring and alerting systems
• Certification in data science or machine learning (e.g., AWS ML, Google Cloud ML)
• Programming: Proficiency in Python or R, with experience in data manipulation libraries (pandas, numpy, scikit-learn)
• Statistical Analysis: Strong foundation in statistical methods, hypothesis testing, and experimental design
• Data Visualization: Experience with visualization tools (Tableau, Power BI, matplotlib, plotly)
• Database Management: SQL proficiency and experience with large-scale data processing
• Cloud Platforms: Familiarity with AWS, Azure, or GCP for data processing and model deployment
• Version Control: Git/GitHub experience for collaborative development

Desired Skill Set :

• Preferably from financial services background with experience in Investment Banking or Global Markets
• Experience with tools such as Snowflake, Redshift, AWS Bedrock
• Experience with Data-Ops, ML-Ops processes, platforms, and methodologies

We are committed to providing equal opportunities throughout employment including in the recruitment, training and development of employees. We prohibit discrimination in the workplace whether on grounds of gender, marital or domestic partnership status, pregnancy, carer’s responsibilities, sexual orientation, gender identity, gender expression, race, color, national or ethnic origins, religious belief, disability or age.

*Applying for this role does not amount to a job offer or create an obligation on Nomura to provide a job offer. The expression "Nomura" refers to Nomura Services India Private Limited together with its affiliates.

*The benefits are subject to change and will be in accordance with Company’s policies as may be applicable from time to time).