Senior Safeguards Policy Lead, Cyber Harms

Society for AI Security

San Francisco (CA)

Hybrid

USD 180,000 - 280,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Anthropic in San Francisco, CA is seeking a senior policy leader to govern access to its sensitive cyber-relevant model capabilities. You will consolidate our controlled-access framework, update policy commitments, and serve as the primary policy contact with government and regulators.

The role requires deep engagement with regulators, partners, and the coordination around vulnerability disclosure. You won't write code, but you will translate complex technical materials—probes, classifiers, and

Qualifications

  • Bachelor's degree or equivalent required.
  • Experience building and defending policy positions.
  • Strong ability to translate technical material into policy.
  • Experience engaging with government and regulators on cybersecurity or AI matters.

Responsibilities

  • Own access-requirements policy and consolidate controlled-access framework.
  • Keep cyber-related policy commitments current with regulatory standards.
  • Serve as primary policy interface with government and regulators.
  • Build relationships across vulnerability disclosure, cybersecurity policy, and national security communities.
  • Author and maintain reporting to partners and regulators.
  • Translate technical evaluations into policy positions for external engagement.
  • Engage with technical teams to understand capabilities relevant to access policy.
  • Demonstrate experience engaging with US government and regulatory parties on cybersecurity.

Skills

Policy leadership
Regulatory engagement
Government liaison
Technical policy reading

Education

Bachelor's degree

Job description

We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the role

We're looking for a senior policy leader to own how Anthropic governs access to its most sensitive cyber-relevant model capabilities. You'll consolidate our controlled-access framework, keep our cyber-related product policy commitments current as standards shift, and serve as Anthropic's primary point of contact with government and regulatory stakeholders. This role works closely with regulators, partners, and the broader coordinated-vulnerability-disclosure community.

You don't need to write code in this role, but you should be comfortable engaging deeply with technical material — probes, classifiers, and trusted-access programs — and translating it into policy that holds up under scrutiny.

Key responsibilities
  • Own Anthropic's access-requirements policy and lead consolidation of the controlled-access framework across existing and emerging access programs
  • Keep Anthropic's cyber-related policy commitments current with shifting industry and regulatory standards, and ensure they map cleanly to our technical safeguards
  • Serve as Anthropic's primary policy interface with government and regulatory stakeholders
  • Build and maintain relationships across the coordinated vulnerability disclosure, cybersecurity policy, and national security communities
  • Author and maintain reporting to partners and regulators
  • Translate technical evaluation and safeguard work into policy positions and external-facing standards engagement
  • Engage closely with technical teams to understand the capabilities of probes and classifiers relevant to access policy
  • Experience engaging directly with the US government and regulatory parties on matters related to cybersecurity
  • Experience authoring policy positions, formal reporting, or regulatory responses for government audiences
  • Extensive experience in cybersecurity policy, including coordinated vulnerability disclosure
Preferred qualifications
  • Experience coordinating sensitive pre-release or pre-publication engagement between a company and government partners (e.g., pre-deployment testing, incident notification, regulatory pre-briefs)
  • Familiarity with government information-sharing and incident-notification frameworks
  • Experience engaging directly with government agencies, regulators, or standards bodies on cybersecurity matters, including on AI
  • Ability to read and interpret technical security material, such as capability evaluations, vulnerability reports, or threat assessments
  • Established relationships across government and regulatory bodies focused on cybersecurity
  • A background spanning legal, technical, and policy disciplines related to vulnerabilities and disclosure
  • Active secret security clearance or higher, or eligibility to obtain one

The annual compensation range for this role is listed below.

For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Logistics

Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience

Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience

Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team. Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who w

How we're different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.

The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Safeguards Policy Analyst, Cyber Harms
Safeguards Policy Analyst, Cyber Harms

Society for AI Security • United States

Hybrid
USD 120,000 - 170,000
External Affairs, US Federal
External Affairs, US Federal

Precision Labs • Washington

Hybrid
USD 265,000 - 295,000
Program Manager, Safeguards Policy, Enforcement, and Threat Intelligence
Program Manager, Safeguards Policy, Enforcement, and Threat Intelligence

Candidate • San Francisco (CA)

Hybrid
USD 285,000 - 330,000
Manager, Cybersecurity Sales Specialist
Manager, Cybersecurity Sales Specialist

Anthropic • New York (NY)

Hybrid
USD 450,000 - 550,000
Staff+ Software Security Engineer
Staff+ Software Security Engineer

Anthropic • San Francisco (CA)

On-site
USD 405,000 - 485,000
Competitive salary
Flexible working hours
Generous vacation and parental leave
Safeguards Enforcement Lead, Cyber Harms
Safeguards Enforcement Lead, Cyber Harms

Anthropic • Washington

On-site
USD 285,000 - 330,000
Manager, Cybersecurity Sales Specialist
Manager, Cybersecurity Sales Specialist

Anthropic • Washington, Baltimore (MD)

Hybrid
USD 450,000 - 550,000
Competitive compensation
Equity donation matching
Generous vacation
+3
Staff + Software Security Engineer, Secure Frameworks
Staff + Software Security Engineer, Secure Frameworks

Anthropic • Seattle (WA)

Hybrid
USD 32,000 - 485,000
Safeguards Enforcement Analyst, Cyber Harm
Safeguards Enforcement Analyst, Cyber Harm

Society for AI Security • San Francisco (CA)

Hybrid
USD 120,000 - 180,000
Equity donation matching
Generous vacation and parental leave
Flexible working hours
+1
Manager, Cybersecurity Sales Specialist
Manager, Cybersecurity Sales Specialist

Anthropic Limited • Seattle (WA)

Hybrid
USD 450,000 - 550,000