Software Engineer, Trust & Safety

United States Digital Space LLC; United States; Hybrid; USD 196,000 - 294,000; Full time

Benefits offered by this job

Equity

Healthcare

Mentorship & events

Flexible time off

WFH equipment budget

Job summary

United States Digital Space LLC is seeking a Software Engineer for Trust & Safety to build and operate defenses protecting developers and projects at internet scale. You’ll analyze threat actor behavior, develop LLM-driven detection, and deploy scalable mitigations in collaboration with product, security, and infrastructure teams.

The role offers a mix of hands-on development, research, and production work, with in-office anchor days in SF on Monday, Tuesday, and Friday, and a fully remote

Qualifications

• 5+ years of experience in abuse prevention, trust & safety, or security engineering.
• Strong programming skills in JavaScript/TypeScript and Python.
• Hands-on experience working with LLMs, including prompt engineering, evaluation, and fine-tuning.
• Solid understanding of cloud infrastructure, including AWS.
• Strong understanding of real-world threat actor behavior and abuse tactics.

Responsibilities

• Analyze threat actor behavior and evolving abuse patterns across large, heterogeneous datasets to inform detection logic, policy decisions, and scalable mitigations.
• Research, prototype, and implement state-of-the-art LLM-driven techniques for abuse detection, classification, and prevention.
• Design and develop production-ready systems that detect and disrupt abusive behavior across the company platform.
• Build, maintain, and fine-tune internal tools, datasets, and evaluation pipelines for trust and safety workflows.
• Collaborate closely with security, product, and infrastructure teams to bring research ideas into stable, scalable production systems.

Skills

JavaScript/TypeScript

Python

LLMs

AWS

Threat analysis

Job description

About the company:

the company is the agentic infrastructure company. We free people and agents to ship what’s next.

For more than a decade, the company has shaped how the web is built. As the team behind Next.js, v0, and AI SDK, we create products that help builders move from idea to production with speed, security, and exceptional developer experience.

Now, software is entering a new era, and the next generation of products will not just be used by people. They will be built, extended, and operated by agents.

We are building the platform for that future, trusted by companies likeOpenAI, PayPal, Ramp, Supreme, and millions of developers worldwide. Whether you’re building our products, supporting our customers, growing our community, or shaping our story, you’ll help define what comes next.

As a Software Engineer on our Trust & Safety at the company, you’ll build and operate systems that protect millions of developers and projects from abuse at internet scale. You’ll analyze real-world threat actor behavior, detect emerging abuse patterns across large datasets, and design production-ready mitigations to keep the platform safe without slowing developers. This role blends security engineering, data analysis, and applied LLM techniques, working closely with product, infrastructure, and security teams to turn evolving threats into scalable defenses.

If you’re based within a pre-determined commuting distance of one of our offices (SF, NY, London, or Berlin), the role includes in-office anchor days on Monday, Tuesday, and Friday. If you're located beyond that distance, the role is fully remote. For location-specific details, please connect with our recruiting team.

What you will do:

• Analyze threat actor behavior and evolving abuse patterns across large, heterogeneous datasets to inform detection logic, policy decisions, and scalable mitigations.

• Research, prototype, and implement state-of-the-art LLM-driven techniques for abuse detection, classification, and prevention.

• Design and develop production-ready systems that detect and disrupt abusive behavior across the the company platform.

• Build, maintain, and fine-tune internal tools, datasets, and evaluation pipelines for trust and safety workflows.

• Collaborate closely with security, product, and infrastructure teams to bring research ideas into stable, scalable production systems.

About You:

• 5+ years of experience in abuse prevention, trust & safety, or security engineering.

• Strong programming skills in JavaScript/TypeScript and Python.

• Hands-on experience working with LLMs, including prompt engineering, evaluation, and fine-tuning.

• Collaborate closely with security, product, and infrastructure teams to bring research ideas into stable, scalable production systems.

• Solid understanding of cloud infrastructure, including AWS.

• Strong understanding of real-world threat actor behavior and abuse tactics.

• Experience owning systems end-to-end, from initial research through production deployment and iteration.

Benefits:

• Competitive compensation package, including equity.

• Inclusive Healthcare Package.

• Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.

• Flexible Time Off.

• We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.

The San Francisco, CA base pay range for this role is $196,000 - $294,000. Actual salary will be based on job-related skills, experience, and location. Compensation outside of San Francisco may be adjusted based on employee location. The total compensation package may include benefits, equity-based compensation, and eligibility for a company bonus or variable pay program depending on the role. Your recruiter can share more details during the hiring process.

the company is committed to fostering and empowering an inclusive community within our organization. We do not discriminate on the basis of race, religion, color, gender expression or identity, sexual orientation, national origin, citizenship, age, marital status, veteran status, disability status, or any other characteristic protected by law. the company encourages everyone to apply for our available positions, even if they don't necessarily check every box on the job description.