Program Officer, AI Model Safety

Data; San Francisco (CA); On-site; USD 120,000 - 190,000; Full time

Job summary

Foundation seeks a founding grantmaker for its AI Model Safety program, combining deep technical fluency in frontier model evaluation and a drive to translate safety research into funded initiatives.

The role involves sourcing, evaluating, and distributing resources to grantees, while shaping the program's strategy and building partnerships across safety institutes, academia, funders, and industry safety teams.

Qualifications

• 3+ years of experience in AI safety, including hands-on research in model safety or evaluations.
• Deep fluency in AI model safety: evaluations, red-teaming, auditing, interpretability, control, and alignment research.
• Ability to assess frontier AI capabilities and risks and advise on ecosystem actions.
• Forecasting AI developments and associated safety work needs.
• Proven track record in owning ambitious, loosely scoped projects and delivering outcomes.
• Strong written communication highlighting risks and uncertainties transparently.

Responsibilities

• Run the program’s grantmaking across its domains from sourcing through investigation to distributing resources to grantees.
• Run grant investigations and make grant recommendations to the board.
• Identify and develop priority projects and founders, and seed new initiatives if needed.
• Collaborate with the AI Resources team to route safety resources to grantees.
• Develop the program’s strategy with the team lead and scan ecosystem activities and gaps.
• Build and maintain relationships with safety organizations, AI safety institutes, academic groups, other funders, and AI companies’ safety teams.

Skills

AI safety

Grantmaking

Research

Stakeholder management

Strategic thinking

Communication

Job description

We are looking for a founding grantmaker for the Foundation’s AI Model Safety program: someone with deep technical fluency in how frontier models are evaluated, audited, and made safer, who can turn that into a grant portfolio and a stronger field.

Responsibilities

• Run the program’s grantmaking across its domains (independent testing and evaluations, industry standards, foundational safety research, AI control, and other new ideas) from sourcing through investigation to getting resources into grantees’ hands.
• Run grant investigations and make grant recommendations to the board.
• Proactively identify the most important projects and organizations that need to exist, and make them happen: scope priority projects, find or develop the right founders, and actively build new initiatives, seeding them if required.
• Work with the AI Resources team to route AI resources to safety grantees and help them absorb it productively.
• Develop the program’s strategy with the team lead: what we should fund, what others in the ecosystem are doing, and where the gaps are.
• Build and maintain relationships across the safety ecosystem: independent safety organizations, AI safety institutes, academic groups, other funders (philanthropic and VC alike), and AI companies’ safety teams.

Skillset

• Have at least 3 years of experience in AI safety, ideally including hands‑on research in model safety or evaluations, whether in a research role, on a safety or evals team, in grantmaking, or helping start an organization.
• Have deep, current fluency in AI model safety: evaluations, red‑teaming, auditing, interpretability, control, and alignment research.
• Follow frontier AI capabilities and risks closely enough to have independent judgment about them, with views on the risks that matter most and on what each part of the ecosystem should do.
• Have a view on where AI is going, which risks it brings, and what to do about them: your own takes on how capabilities will develop, and what that means for the safety work that will be needed.
• Excel at owning ambitious, loosely scoped projects: you find the right people, convince them to start new work, and support their success.
• Have a relentless prioritization mindset: you evaluate opportunities on impact, tractability, and neglectedness, and act on the ranking.
• Write and communicate: compelling, transparent documents that explain your reasoning and appropriately highlight risks, uncertainties, and downsides internally.
• Are deeply mission‑aligned and excited to help ensure AGI benefits all of humanity.

It would be great if you also have

• Grantmaking, VC, or philanthropic experience, especially seeding organizations or sub‑fields.
• A research track record in evaluations, interpretability, control, or adjacent technical safety areas.
• Existing relationships across safety organizations, AI safety institutes, and AI company safety teams.