Product Risk & Safeguards Lead

Anthropic; San Francisco (CA); Hybrid; USD 245,000 - 285,000; Full time

Benefits offered by this job

Equity donation matching

Generous vacation

Parental leave

Flexible working hours

Office in San Francisco

Job summary

Anthropic is seeking a Product Policy Manager for Product Risk to lead safety assessments for new features, collaborating with product, legal, policy, and engineering teams. The role involves evaluating potential misuses and crafting policies that balance innovation with responsibility.

Applicants should have a strong technical background, understand AI ethics, and excel in program management to drive policy development from ideation to implementation.

Qualifications

• Have a strong technical background and can explain technical concepts to non‑technical stakeholders.
• Understand safety policies and safety considerations across product surfaces.
• Adept at prioritizing safety mitigations in a high‑volume launch process.
• Have conducted risk evaluations of novel products in fast moving organizations.
• Collaborate with product and engineering teams to integrate safety into development.
• Thorough understanding of AI ethics and responsible AI principles.
• Creative thinker for potential misuses of technology and mitigation strategies.
• Strong program management skills to drive policy development from ideation to implementation.

Responsibilities

• Develop and maintain risk assessment frameworks for new product features and functionality.
• Conduct and drive comprehensive product safety reviews to inform launches and mitigations.
• Collaborate with product, engineering, and Safeguards teams to apply policy and enforcement expertise.
• Analyze potential misuse and unintended consequences of new models and translate into mitigations.
• Leverage risk assessments to inform product safety recommendations.
• Design and run bespoke evaluations for products requiring tailored assessments.
• Craft policy recommendations balancing innovation with responsible deployment.
• Stay current on industry trends and emerging AI risks.
• Contribute to regular safety risk and mitigation reports for leadership.

Skills

Technical background

Explain complex concepts

Safety policies

Resource prioritization

Risk evaluations

Cross‑functional collaboration

AI ethics

Creative risk mitigation

Program management

Education

Bachelor’s degree or equivalent

Tools

Risk assessment frameworks

Job description

Anthropic is seeking a Product Policy Manager for Product Risk to lead safety assessments for new features, collaborating with product, legal, policy, and engineering teams. The role involves evaluating potential misuses and crafting policies that balance innovation with responsibility.

Applicants should have a strong technical background, understand AI ethics, and excel in program management to drive policy development from ideation to implementation.