External Safety Testing Manager, Responsible Development and Innovation, DeepMind

DeepMind Technologies Limited; New York (NY); On-site; USD 156,000 - 227,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

DeepMind Technologies Limited, part of Google, seeks an External Safety Testing Manager in the Responsible Development and Innovation team to lead external safety evaluations of cutting-edge AI systems. You will partner with Google and DeepMind teams to deliver testing programs, drive safety practices, and scale partner engagements globally.

The role emphasizes collaboration across PM, Research, Legal, Engineering, Public Policy, Trust & Safety, and Frontier Safety teams to ensure responsible AI

Qualifications

• 8 years of experience in startups, tech, or consulting.
• Experience working with AI or in an AI lab/startup environment.
• Preferred: testing and evaluation of cutting edge AI systems.
• Strong communication and cross-functional collaboration capabilities.
• Project management skills to optimize and create processes.
• Expertise in generative AI safety considerations including frontier risks.

Responsibilities

• Lead frontier safety post deployment testing strategy and execution.
• Scale the post deployment program to support new risk and capability areas and partners.
• Coordinate with external testing partners and internal teams to run end-to-end testing.
• Communicate findings to leadership, domain experts, governance, and modeling teams for risk assessment.
• Collaborate with legal and partnerships on contracting for new external testing partners.

Skills

8 years experience

AI experience

AI testing design

Cross-functional collaboration

Project management

Generative AI safety

Job description

Minimum qualifications

• 8 years of experience working in either in a start-up, tech company, or consulting organization.
• Experience working with AI or in an AI lab/startup environment.

Preferred qualifications

• Experience designing and implementing testing and evaluations of cutting edge AI systems.
• Demonstrated excellent communication skills and ability to work in cross-functional teams, foster collaboration, and influence outcomes.
• Demonstrated project management skills to optimize existing processes and create new processes.
• Subject matter expertise in generative AI safety considerations, including (but not limited to) frontier safety, such as chemical, biological, radiological, nuclear, cyber, harmful manipulation and alignment risks.

About The Job

As an External Safety Testing Manager in the Responsible Development and Innovation (ReDI) team, you’ll be integral to the delivery and scaling of our external safety partnerships and evaluations on DeepMind’s most groundbreaking models.

You will work with teams across Google and DeepMind, including Product Management, Research, Legal, Engineering, Public Policy, Trust and Safety (T&S), and Frontier Safety and Governance, to deliver external safety evaluations which are a key part of our responsibility and safety best practices, helping DeepMind to progress towards its mission.

Artificial intelligence will be one of humanity’s most transformative inventions. At Google DeepMind, we are a pioneering AI lab with exceptional interdisciplinary teams focused on advancing AI development to solve complex global challenges and accelerate high-quality product innovation for billions of users. We use our technologies for widespread public benefit and scientific discovery, ensuring safety and ethics are always our highest priority.

We are pushing the boundaries across multiple domains. Our global teams offer diverse learning opportunities and varied career pathways for those driven to achieve exceptional results through collective effort.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $156000 - $227000 (USD) + 15% bonus target + equity + benefits

Learn more about benefits at Google.

Responsibilities

• Lead frontier safety post deployment testing strategy and execution.
• Lead efforts to optimize and scale the post deployment program to support novel risk and capability areas and changing external requirements, including identifying new partners with relevant skillsets.
• Lead engagement with various external testing partners and internal teams to execute the end-to-end testing process.
• Lead engagement with internal SMEs to assess the severity of findings and clearly communicate it to leadership, domain experts, governance, and modeling teams to inform internal risk assessments and mitigations.
• Work with legal and partnerships on contracting for new external testing partners.

Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.