Research Scientist, FSF Risk Modeling and Governance, DeepMind

Google; New York (NY); On-site; USD 207,000 - 300,000; Full time

Job summary

Google DeepMind is hiring a Research Scientist to lead governance research and risk modeling for the Frontier Safety Framework (FSF). You will drive research, model AI severe risks, and represent the program in governance discussions and model launch processes.

The role emphasizes collaboration with policy teams, publication of safety reports, and advancing FSF across safety and governance domains in a fast-evolving AI landscape.

Qualifications

• PhD or equivalent practical experience.
• 3 years of research experience in frontier AI safety or governance.

Responsibilities

• Develop FSF research and write updates of the FSF to adapt to changing safety, governance, and policy opportunities and needs.
• Research and model pre-mitigation risks to ground our empirical risk assessment work (e.g. by defining FSF thresholds) and inform safeguard development.
• Work across evaluation and mitigation teams to assess the extent to which safeguards have reduced risk, and whether they are adequate for further development and deployment of frontier models.
• Manage a team of researchers and cross-functional collaborators working on projects, and represent the risk assessment program in internal and external governance.
• Write our external safety reports, and work with appropriate policy/governance teams to strengthen the frontier AI governance ecosystem.

Skills

Communicate complex topics

Lead research projects

Quantitative risk modeling

Education

PhD in Economics, Philosophy, or STEM

Job description

Research Scientist, FSF Risk Modeling and Governance, DeepMind

London, UK; New York, NY, USA; +2 more; +1 more

Applicants in San Francisco: Qualified applications with arrest or conviction records will be considered for employment in accordance with the San Francisco Fair Chance Ordinance for Employers and the California Fair Chance Act. Note: By applying to this position you will have an opportunity to share your preferred working location from the following: London, UK; New York, NY, USA; San Francisco, CA, USA.

Minimum qualifications:

• PhD in Economics, Philosophy, or a STEM subject, or equivalent practical experience.
• 3 years of research experience in frontier AI safety or governance (e.g., in threat modeling, safety frameworks, or dangerous capability/alignment evaluations).

Preferred qualifications:

• Ability to communicate complex technical topics to leads, governance bodies and policy experts.
• Track record of driving complex projects, including in research settings.
• Track record of applying conceptual and quantitative reasoning methods to uncertain and under-constrained research or forecasting problems.

About the job

We are hiring a research scientist to lead governance research and risk modeling work for the Frontier Safety Framework (FSF).

The FSF is Google’s framework for addressing possible severe risks from its frontier AI models. Both risk modeling and governance innovation are key to its continued success. Risk modeling helps Google understand the extent of the severe threats our models may pose, what mitigations are appropriate for addressing them, and whether, after the mitigations are applied, risk has been brought to a low enough level for different kinds of deployment. Frontier AI risk assessment is still nascent, and we are strengthening our efforts here in preparation for AGI.

Governance innovation is critical given the arrival of new risks on the AI frontier, as well as the shifting technical and geopolitical environment. Safety frameworks like the FSF have changed substantially since their conception, and must continue to evolve to confront the challenges ahead. Working with our policy and governance teams to broaden their reach and strengthen their application will also be crucial to their long-term success.

You will lead a team of researchers to advance both of these priorities. Practically, you will drive research and development of the FSF, lead qualitative and quantitative modeling of possible AI severe risks, and represent the FSF risk assessment program in internal and external governance (e.g. in model launch processes and the writing and publication of model safety reports).

Artificial intelligence will be one of humanity’s most transformative inventions. At Google DeepMind, we are a pioneering AI lab with exceptional interdisciplinary teams focused on advancing AI development to solve complex global challenges and accelerate high-quality product innovation for billions of users. We use our technologies for widespread public benefit and scientific discovery, ensuring safety and ethics are always our highest priority.

We are pushing the boundaries across multiple domains. Our global teams offer diverse learning opportunities and varied career pathways for those driven to achieve exceptional results through collective effort.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

Learn more about benefits at Google.

Responsibilities

• Develop FSF research and write updates of the FSF to adapt to changing safety, governance, and policy opportunities and needs.
• Research and model pre-mitigation risks to ground our empirical risk assessment work (e.g. by defining FSF thresholds) and inform safeguard development.
• Work across evaluation and mitigation teams to assess the extent to which safeguards have reduced risk, and whether they are adequate for further development and deployment of frontier models.
• Manage a team of researchers and cross-functional collaborators working on projects, and represent the risk assessment program in internal and external governance.
• Write our external safety reports, and work with appropriate policy/governance teams to strengthen the frontier AI governance ecosystem.

Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.

If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.

Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right.