Staff+ Software Engineer, Account Abuse

Anthropic Limited

San Francisco (CA)

Hybrid

USD 320,000 - 485,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity donation matching
Generous vacation and parental leave
Flexible working hours
Office space

Job summary

Anthropic Limited, based in San Francisco, seeks a Software Engineer for the Account Abuse team. You will build scalable systems that gather and analyze signals, balance tradeoffs, and coordinate with stakeholder teams across the company.

The ideal candidate has a CS degree, strong Python and SQL skills, and 8+ years in software engineering, preferably in integrity, fraud, or abuse detection, with experience building trust and safety tooling for AI systems.

Qualifications

  • A Bachelor’s degree in Computer Science, Software Engineering or comparable experience
  • Proficiency in Python, SQL, and data analysis tools.
  • Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders
  • 8+ years of industry software engineering experience (preferably with integrity, fraud, or abuse detection)
  • Experience building trust and safety mechanisms for AI/ML systems and related tooling

Responsibilities

  • Ability to think and respond quickly in a rapidly-changing greenfield environment
  • Jumping into other teams’ code to identify key points to gather signals or introduce interventions with minimal impact on their systems’ stability, complexity, or overall architecture
  • Integration with third-party data-enrichment vendors
  • Creating monitoring dashboards, alerts, and internal admin UX
  • Working closely with data scientists to understand usage patterns and with Policy & Enforcement to maximize human-review impact
  • Building robust and reliable multi-layered defenses
  • Lead root cause analyses and deep-dive investigations into account activity to identify abuse patterns and inform enforcement actions

Job description

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About The Role

The Account Abuse team is tasked with ensuring Anthropic’s computing capacity is allocated fairly, minimizing resources available to bad actors and preventing them from coming back. As a software engineer on this team, you will build systems that gather and analyze signals at scale, balancing tradeoffs and coordinating closely with stakeholder teams throughout the company. The ideal candidate can see things from opponents’ perspectives, understand their means and motives, and anticipate their responses to countermeasures.

Responsibilities
  • Ability to think and respond quickly in a rapidly-changing greenfield environment
  • Jumping into other teams’ code to identify key points to gather signals or introduce interventions with minimal impact on their systems’ stability, complexity, or overall architecture
  • Integration with third-party data-enrichment vendors
  • Creating monitoring dashboards, alerts, and internal admin UX
  • Working closely with our data scientists to maintain situational awareness of our current usage patterns and trends, and with our Policy & Enforcement team to maximize the impact of their human-review availability
  • Building robust and reliable multi-layered defenses
  • Lead root cause analyses and deep-dive investigations into account activity to identify abuse patterns, uncover emerging attack vectors, and inform both immediate enforcement actions and longer-term systemic defenses
You May Be a Good Fit If You Have
  • A Bachelor’s degree in Computer Science, Software Engineering or comparable experience
  • Proficiency in Python, SQL, and data analysis tools.
  • Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders
Strong Candidates May Also
  • 8+ years of industry software engineering experience (not including internships and co-ops), preferably with a focus on integrity, spam, fraud, or abuse detection.
  • Have experience building trust and safety mechanisms for and using AI/ML systems, such as fraud-detection models or security monitoring tools or the infrastructure to support these systems at scale
  • Have worked closely with operational teams to build custom internal tooling
Annual Salary

$320,000—$485,000 USD

Logistics
  • Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
  • Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
  • Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
  • Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
  • Visa sponsorship: We do sponsor visas! However, we aren’t able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

We think AI systems like the ones we’re building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.

How We’re Different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We’re an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.

This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff+ Software Engineer, Account Abuse
Staff+ Software Engineer, Account Abuse

Anthropic Limited • Seattle (WA)

Hybrid
USD 320,000 - 485,000
Competitive compensation
Equity donation matching (optional)
Generous vacation and parental leave
+2
Staff+ Software Engineer, Account Abuse
Staff+ Software Engineer, Account Abuse

Anthropic Limited • New York (NY)

Hybrid
USD 320,000 - 485,000
Staff+ Software Engineer, Account Abuse (Machine Learning)
Staff+ Software Engineer, Account Abuse (Machine Learning)

Anthropic Limited • San Francisco (CA)

Hybrid
USD 320,000 - 485,000
Equity donation matching
Generous vacation and parental leave
Flexible working hours
+1
Staff+ Software Engineer, Account Abuse (Machine Learning)
Staff+ Software Engineer, Account Abuse (Machine Learning)

Anthropic Limited • New York (NY)

Hybrid
USD 320,000 - 485,000
Staff+ Software Engineer, Account Abuse (Machine Learning)
Staff+ Software Engineer, Account Abuse (Machine Learning)

FDE Times • New York (NY)

Hybrid
USD 320,000 - 485,000
Account Security & Abuse Enforcement Specialist
Account Security & Abuse Enforcement Specialist

Anthropic Limited • Washington, Baltimore (MD)

Hybrid
USD 245,000 - 285,000
Office space
Flexible working hours
Equity donation matching
+1
Safeguards Enforcement Analyst, Account Takeover & Credential Abuse
Safeguards Enforcement Analyst, Account Takeover & Credential Abuse

Anthropic Limited • San Francisco (CA)

Hybrid
USD 245,000 - 285,000
Safeguards Enforcement Analyst, Account Takeover & Credential Abuse
Safeguards Enforcement Analyst, Account Takeover & Credential Abuse

Anthropic Limited • Washington, Baltimore (MD)

Hybrid
USD 245,000 - 285,000
Office space
Flexible working hours
Equity donation matching
+1
Staff+ Software Engineer, Account Abuse (Machine Learning)
Staff+ Software Engineer, Account Abuse (Machine Learning)

Anthropic Limited • New York (NY)

Hybrid
USD 320,000 - 485,000
Generous vacation
Parental leave
Flexible working hours
+1
Staff+ Software Engineer, Distributed Systems
Staff+ Software Engineer, Distributed Systems

Anthropic Limited • San Francisco (CA)

Hybrid
USD 320,000 - 485,000
Equity donation matching
Generous vacation & parental leave
Flexible working hours
+1