Staff Software Engineer, AI Safety & Safeguards

Anthropic Limited

New York, Northern (NY, KY)

Hybrid

USD 320,000 - 485,000

Full time

5 days ago
Be an early applicant
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Anthropic is seeking a Staff+ Software Engineer, Account Creation to help build safety and oversight mechanisms for our AI systems. You will work on monitoring models, preventing misuse, and ensuring user well-being across the stack.

This role emphasizes building multi-layered defenses and surfacing abuse patterns to researchers to harden models, enabling real-time safety at scale. Hybrid work is expected, with visa sponsorship available where applicable.

Qualifications

  • Bachelor's degree in Computer Science or related field required.
  • Proficiency in Python and Typescript.
  • Ability to work across the stack and communicate clearly.
  • Experience with safety, AI/ML systems is a plus.

Responsibilities

  • Develop monitoring systems to detect unwanted behaviors in API partners.
  • Build abuse detection mechanisms and infrastructure.
  • Surface abuse patterns to research teams to harden models.
  • Contribute to real-time safety defenses at scale.

Education

Bachelor's degree in Computer Science or related field

Tools

Python
Typescript

Job description

Anthropic is seeking a Staff+ Software Engineer, Account Creation to help build safety and oversight mechanisms for our AI systems. You will work on monitoring models, preventing misuse, and ensuring user well-being across the stack.

This role emphasizes building multi-layered defenses and surfacing abuse patterns to researchers to harden models, enabling real-time safety at scale. Hybrid work is expected, with visa sponsorship available where applicable.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Software Engineer, AI Safety & Abuse Detection
Staff Software Engineer, AI Safety & Abuse Detection

EngineersOfAI • San Francisco (CA), Northern (KY)

Hybrid
USD 320,000 - 485,000
Staff Software Engineer, AI Safety & Safeguards
Staff Software Engineer, AI Safety & Safeguards

Jobs in JS • Seattle (WA)

Hybrid
USD 320,000 - 485,000
Staff Software Engineer - AI Safety & Safeguards
Staff Software Engineer - AI Safety & Safeguards

Menlo Ventures • New York (NY)

Hybrid
USD 320,000 - 485,000
Equity donation matching
Flexible hours
Office space
+1
Staff Software Engineer — AI Safety & Distributed Systems
Staff Software Engineer — AI Safety & Distributed Systems

Anthropic • New York (NY)

Hybrid
USD 320,000 - 485,000
Staff Software Engineer, AI Safety & Abuse Detection
Staff Software Engineer, AI Safety & Abuse Detection

Anthropic • San Francisco (CA)

Hybrid
USD 320,000 - 485,000
Equity donation matching
Generous vacation and parental leave
Flexible working hours
+1
Staff Software Engineer, Distributed Systems for Safe AI
Staff Software Engineer, Distributed Systems for Safe AI

Anthropic • San Francisco (CA)

On-site
USD 170,000 - 250,000
Staff+ Software Engineer, Account Creation
Staff+ Software Engineer, Account Creation

EngineersOfAI • San Francisco (CA), Northern (KY)

Hybrid
USD 320,000 - 485,000
Staff+ Software Engineer, Account Creation San Francisco, CA | New York City, NY | Seattle, WA
Staff+ Software Engineer, Account Creation San Francisco, CA | New York City, NY | Seattle, WA

Anthropic Limited • New York (NY), Northern (KY)

Hybrid
USD 320,000 - 485,000
Software Engineer, Safeguards
Software Engineer, Safeguards

Anthropic • San Francisco (CA)

On-site
USD 320,000 - 485,000
Staff+ Software Engineer, Safeguards
Staff+ Software Engineer, Safeguards

Menlo Ventures • New York (NY)

On-site
USD 320,000 - 485,000
Equity donation matching
Flexible hours
Office space
+1