Trust & Safety Engineer - AI Platform Risk & Abuse

OpenRouter; United States; On-site; USD 120,000 - 210,000; Full time

Job summary

OpenRouter is seeking a Software Engineer on the Trust & Safety team to own detection, enforcement, and review systems that guard against abuse and illegal content. You will build systems that detect abuse, create heuristics for automated action, and develop reviewer tooling across signup, payments, and usage paths.

This hands-on IC role spans inference path, payments, internal review tooling, and data platforms.

Qualifications

• 4+ years building and operating production systems, preferably in trust & safety, fraud, payments risk, security, or anti-abuse.
• Proficient in React, TypeScript, Next.js, and JS runtimes.
• Ability to write SQL against large event datasets and reason about base rates, precision, recall, and the cost of a wrong decision.
• Strong written and verbal communication, able to explain incident findings and rules to diverse audiences.

Responsibilities

• Build and operate technical systems across signup, payments, and usage to detect abuse and fraud early.
• Own the technical enforcement pipeline end to end, from detection proposing a candidate to a human reviewing it to restrictions landing across our systems.
• Build internal tools to support investigation and enforcement decision-making, including case queues and bulk review.
• Ship technical solutions for content safety on the inference path and KYC systems to detect and stop fraud and abuse.
• Help make abuse uneconomical by building systems and heuristics for quick detection and scalable enforcement.
• Help investigate incidents directly in the data and build analytics to size patterns and separate real abuse from false positives.
• Build defensible monitoring for risk, abuse spikes, and fraud, reducing false positives.
• Set technical direction for preventing abuse as the platform grows and evolves.
• Work with data scientists on feature exploration and training risk/abuse ML models.

Skills

React

TypeScript

Next.js

JS runtimes

SQL

Trust & Safety

Tools

Stripe Radar

BigQuery

ClickHouse

Job description

OpenRouter is seeking a Software Engineer on the Trust & Safety team to own detection, enforcement, and review systems that guard against abuse and illegal content. You will build systems that detect abuse, create heuristics for automated action, and develop reviewer tooling across signup, payments, and usage paths.

This hands-on IC role spans inference path, payments, internal review tooling, and data platforms.