Software Engineer - Trust & Safety for AI Infra

OpenRouter; New York (NY); On-site; USD 140,000 - 200,000; Full time

Job summary

OpenRouter in New York, NY is seeking a Software Engineer for its Trust & Safety team to own detection, enforcement, and review systems that keep abuse and fraud off the platform. You’ll build safeguards, review tooling, and guardrails protecting millions of LLM requests and payments daily.

This hands-on IC role spans the inference path, payments flow, and data platform, with heavy emphasis on shipping without heavy process.

Qualifications

• 4+ years building and operating production systems, ideally in trust & safety, fraud, payments risk, security, or anti-abuse.
• Proficient in React, TypeScript, Next.js, and JS runtimes.
• Ability to write SQL against large event datasets and reason about base rates, precision and recall, and cost of a wrong decision.
• Strong written and verbal communication, able to explain incident findings, detection rules, and systems.

Responsibilities

• Build and operate technical systems across signup, payments, and usage to detect abuse and fraud early.
• Own the technical enforcement pipeline end to end, from detection proposing a candidate to a human reviewing it to restrictions landing across our systems.
• Build the internal tools that support investigation and enforcement decision-making, including case queues, evidence summaries, bulk review and enactment, and alerting mechanisms.
• Ship technical solutions for content safety on the inference path, including illegal content detection and reporting, and KYC systems.
• Help make abuse uneconomical by building systems, tools, and heuristics for quick detection and scalable enforcement.
• Help investigate incidents directly in the data and build the analytics plane to size the pattern and separate real abuse from false positives.
• Build defensible monitoring for risk, abuse spikes, and fraud, reducing false positives.
• Set the technical direction for how we prevent abuse as the platform grows and evolves.
• Work with data scientists on feature exploration and training of risk and abuse ML models.

Skills

React

TypeScript

Next.js

SQL

Data analysis

Problem solving

Communication

Adversarial thinking

Job description

OpenRouter in New York, NY is seeking a Software Engineer for its Trust & Safety team to own detection, enforcement, and review systems that keep abuse and fraud off the platform. You’ll build safeguards, review tooling, and guardrails protecting millions of LLM requests and payments daily.

This hands-on IC role spans the inference path, payments flow, and data platform, with heavy emphasis on shipping without heavy process.