External Safety Testing Manager, Responsible Development and Innovation, DeepMind

Google LLC; New York (NY); Sur place; USD 156 000 - 227 000; Plein temps

Résumé du poste

Google DeepMind is seeking an External Safety Testing Manager within the Responsible Development and Innovation team to oversee external safety partnerships and evaluations for our most advanced models. You will collaborate with Product Management, Research, Legal, Engineering, Public Policy, Trust and Safety, and Frontier Safety and Governance to deliver rigorous, scalable testing across external partners.

The role requires 8+ years in startup/tech/consulting with AI experience.

Qualifications

• 8 years of experience in either a start-up, tech company, or consulting organization.
• Experience working with AI or in an AI lab/startup environment.

Responsabilités

• Lead frontier safety post deployment testing strategy and execution.
• Lead efforts to optimize and scale the post deployment program to support novel risk and capability areas and changing external requirements, including identifying new partners with relevant skillsets.
• Lead engagement with various external testing partners and internal teams to execute the end-to-end testing process.
• Lead engagement with internal SMEs to assess the severity of findings and clearly communicate it to leadership, domain experts, governance, and modeling teams to inform internal risk assessments and mitigations.
• Work with legal and partnerships on contracting for new external testing partners.

Connaissances

AI experience

Cross-functional collaboration

Outils

Testing frameworks

Description du poste

As an External Safety Testing Manager in the Responsible Development and Innovation (ReDI) team, you’ll be integral to the delivery and scaling of our external safety partnerships and evaluations on DeepMind’s most groundbreaking models.

You will work with teams across Google and DeepMind, including Product Management, Research, Legal, Engineering, Public Policy, Trust and Safety (T&S), and Frontier Safety and Governance, to deliver external safety evaluations which are a key part of our responsibility and safety best practices, helping DeepMind to progress towards its mission.

Artificial intelligence will be one of humanity’s most transformative inventions. At Google DeepMind, we are a pioneering AI lab with exceptional interdisciplinary teams focused on advancing AI development to solve complex global challenges and accelerate high-quality product innovation for billions of users. We use our technologies for widespread public benefit and scientific discovery, ensuring safety and ethics are always our highest priority.

We are pushing the boundaries across multiple domains. Our global teams offer diverse learning opportunities and varied career pathways for those driven to achieve exceptional results through collective effort.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $156000 - $227000 (USD) + 15% bonus target + equity + benefits

Learn more about benefits at Google.

• Lead frontier safety post deployment testing strategy and execution.
• Lead efforts to optimize and scale the post deployment program to support novel risk and capability areas and changing external requirements, including identifying new partners with relevant skillsets.
• Lead engagement with various external testing partners and internal teams to execute the end-to-end testing process.
• Lead engagement with internal SMEs to assess the severity of findings and clearly communicate it to leadership, domain experts, governance, and modeling teams to inform internal risk assessments and mitigations.
• Work with legal and partnerships on contracting for new external testing partners.

Minimum qualifications:

• 8 years of experience working in either in a start-up, tech company, or consulting organization.
• Experience working with AI or in an AI lab/startup environment.

Preferred qualifications:

• Experience designing and implementing testing and evaluations of cutting edge AI systems.
• Demonstrated excellent communication skills and ability to work in cross-functional teams, foster collaboration, and influence outcomes.
• Demonstrated project management skills to optimize existing processes and create new processes.
• Subject matter expertise in generative AI safety considerations, including (but not limited to) frontier safety, such as chemical, biological, radiological, nuclear, cyber, harmful manipulation and alignment risks.