A complete application in a minute
Tailored resume and cover letter, ready to send.
Macquarie Group in Indonesia is seeking an AI Engineering and Validation Senior Manager to lead independent, risk-based validation of advanced AI systems and their control environments across cyber security and other high-impact AI initiatives.
You will shape testing strategies, oversee scoping, testing and reporting, and develop reusable methodologies while coaching validators and communicating findings to technical and senior stakeholders.
Other, Risk Management, Technology - Data Scientist, Technology - Engineering, Technology - Security
In this role, you will lead independent, risk-based validation of advanced AI systems and their supporting control environments, with an initial focus on security and risk assessments of agentic tools and frontier AI models used within cyber security, while also supporting other high-impact AI and agentic systems across the Group. You will drive end-to-end validation engagements from scoping, testing and analysis through to reporting and closure, combining hands-on technical assessment with sound judgement to evaluate reliability, robustness, harmful or erroneous outputs, susceptibility to manipulation, model limitations and control failures. You will assess key AI safety risks, including unsafe or unintended agent behaviour, excessive autonomy, unsafe tool usage and containment failures, while evaluating the effectiveness of guardrails, agent harnesses, containment mechanisms, access and egress controls, monitoring and logging capabilities, and human oversight frameworks.
You will also help develop validation methodologies for emerging AI risks where established testing approaches do not yet exist, form clear and evidence-based validation conclusions, and communicate findings, limitations and residual risks to both technical and senior stakeholders. As a senior leader within the team, you will provide technical direction across validation engagements, establish testing strategies and quality standards, coach and develop validators, challenge technical assessments, and build reusable methodologies and tooling that enhance the broader Model and AI Risk capability.
In this role, you will lead independent, risk-based validation of advanced AI systems and their supporting control environments, with an initial focus on security and risk assessments of agentic tools and frontier AI models used within cyber security, while also supporting other high-impact AI and agentic systems across the Group. You will drive end-to-end validation engagements from scoping, testing and analysis through to reporting and closure, combining hands-on technical assessment with sound judgement to evaluate reliability, robustness, harmful or erroneous outputs, susceptibility to manipulation, model limitations and control failures. You will assess key AI safety risks, including unsafe or unintended agent behaviour, excessive autonomy, unsafe tool usage and containment failures, while evaluating the effectiveness of guardrails, agent harnesses, containment mechanisms, access and egress controls, monitoring and logging capabilities, and human oversight frameworks.
You will also help develop validation methodologies for emerging AI risks where established testing approaches do not yet exist, form clear and evidence-based validation conclusions, and communicate findings, limitations and residual risks to both technical and senior stakeholders. As a senior leader within the team, you will provide technical direction across validation engagements, establish testing strategies and quality standards, coach and develop validators, challenge technical assessments, and build reusable methodologies and tooling that enhance the broader Model and AI Risk capability.