Software Engineer - Trust & Safety for AI Infra

OpenRouter

New York (NY)

On-site

USD 140,000 - 200,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

OpenRouter in New York, NY is seeking a Software Engineer for its Trust & Safety team to own detection, enforcement, and review systems that keep abuse and fraud off the platform. You’ll build safeguards, review tooling, and guardrails protecting millions of LLM requests and payments daily.

This hands-on IC role spans the inference path, payments flow, and data platform, with heavy emphasis on shipping without heavy process.

Qualifications

  • 4+ years building and operating production systems, ideally in trust & safety, fraud, payments risk, security, or anti-abuse.
  • Proficient in React, TypeScript, Next.js, and JS runtimes.
  • Ability to write SQL against large event datasets and reason about base rates, precision and recall, and cost of a wrong decision.
  • Strong written and verbal communication, able to explain incident findings, detection rules, and systems.

Responsibilities

  • Build and operate technical systems across signup, payments, and usage to detect abuse and fraud early.
  • Own the technical enforcement pipeline end to end, from detection proposing a candidate to a human reviewing it to restrictions landing across our systems.
  • Build the internal tools that support investigation and enforcement decision-making, including case queues, evidence summaries, bulk review and enactment, and alerting mechanisms.
  • Ship technical solutions for content safety on the inference path, including illegal content detection and reporting, and KYC systems.
  • Help make abuse uneconomical by building systems, tools, and heuristics for quick detection and scalable enforcement.
  • Help investigate incidents directly in the data and build the analytics plane to size the pattern and separate real abuse from false positives.
  • Build defensible monitoring for risk, abuse spikes, and fraud, reducing false positives.
  • Set the technical direction for how we prevent abuse as the platform grows and evolves.
  • Work with data scientists on feature exploration and training of risk and abuse ML models.

Skills

React
TypeScript
Next.js
SQL
Data analysis
Problem solving
Communication
Adversarial thinking

Job description

OpenRouter in New York, NY is seeking a Software Engineer for its Trust & Safety team to own detection, enforcement, and review systems that keep abuse and fraud off the platform. You’ll build safeguards, review tooling, and guardrails protecting millions of LLM requests and payments daily.

This hands-on IC role spans the inference path, payments flow, and data platform, with heavy emphasis on shipping without heavy process.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Trust & Safety Software Engineer – AI Platform
Trust & Safety Software Engineer – AI Platform

OpenRouter, Inc • United States

On-site
USD 215,000 - 285,000
Trust & Safety Software Engineer - Abuse & Fraud Defenses
Trust & Safety Software Engineer - Abuse & Fraud Defenses

OpenRouter • United States

On-site
USD 140,000 - 210,000
Software Engineer, Trust & Safety
Software Engineer, Trust & Safety

OpenRouter • New York (NY)

On-site
USD 140,000 - 200,000
Software Engineer, Trust & Safety
Software Engineer, Trust & Safety

OpenRouter, Inc • United States

On-site
USD 215,000 - 285,000
Trust & Safety Engineer — AI-Driven Threat Detection
Trust & Safety Engineer — AI-Driven Threat Detection

Vercel • New York (NY)

On-site
USD 196,000 - 294,000
Competitive pay
Equity
Healthcare
+3
Trust & Safety Platform Engineer - AI-Driven Safety at Scale
Trust & Safety Platform Engineer - AI-Driven Safety at Scale

Partiful • New York (NY)

Hybrid
USD 165,000 - 210,000
401(k) with up to 6% matching
Health, dental, and vision insurance
Free OneMedical membership, telehealth
+5
Principal Engineer, AI-Driven Trust & Safety
Principal Engineer, AI-Driven Trust & Safety

Intuit, Inc. • New York (NY)

On-site
USD 261,000 - 353,000
Cash bonus
Equity rewards
Benefits
Principal Trust & Safety Engineer — AI-Driven Risk
Principal Trust & Safety Engineer — AI-Driven Risk

Intuit Inc. • New York (NY)

On-site
USD 261,000 - 353,000
Principal Trust & Safety Engineer - AI, Risk + Equity
Principal Trust & Safety Engineer - AI, Risk + Equity

Intuit, Inc. • New York (NY)

Hybrid
USD 261,000 - 353,000
Cash bonus
Equity rewards
Benefits package
Remote Software Engineer, Trust & Risk - Real-Time Safety
Remote Software Engineer, Trust & Risk - Real-Time Safety

Whatnot Inc. • San Francisco (CA)

Hybrid
USD 150,000 - 210,000
Health Insurance
WFH Support
Home office setup allowance
+6