Product Manager, AI Safety & Safeguards

Anthropic Limited; New York (NY); Hybrid; USD 385,000 - 460,000; Full time

Benefits offered by this job

Equity donation matching

Generous vacation and parental leave

Flexible working hours

Lovely office space

Job summary

Anthropic is seeking a Product Manager for the Safeguards team to own the ideation, design, development and deployment of safeguards systems and relevant product UX to ensure we are advancing frontier models safely to users across Claude.ai, 1P API, and external Cloud providers.

You will work closely with our research and product teams to develop detections, evals, interventions, and tools to measure and mitigate deployment and user risks.

Qualifications

• Ability to make technical tradeoff decisions across policy experts, AI/ML researchers and software engineers.
• Strong user understanding of Safeguards concerns and best solutions.
• Ability to build product and engineering strategy across cross‑functional teams.
• Experience designing metrics to evaluate risks and system performance.
• Ability to articulate complex technical concepts to non-technical audiences.

Responsibilities

• Determine how to build in safety by design upstream and leverage downstream defenses.
• Write safety evals and communicate externally about safety.
• Drive impact via ruthless prioritization with clear requirements for MVP vs ideal state.
• Align and collaborate with policy, enforcement, research, engineering and stakeholders.
• Understand AI landscape to plan mitigation of deployment risks.
• Lead development of metrics to understand the area, performance, blind spots.

Skills

Technical tradeoffs

Cross-functional teams

Product strategy

Clear communication

Ambiguity handling

Education

Bachelor’s degree

Job description

Anthropic is seeking a Product Manager for the Safeguards team to own the ideation, design, development and deployment of safeguards systems and relevant product UX to ensure we are advancing frontier models safely to users across Claude.ai, 1P API, and external Cloud providers.

You will work closely with our research and product teams to develop detections, evals, interventions, and tools to measure and mitigate deployment and user risks.