Senior Software Engineer, Risk

United States Digital Space LLC

Deutschland

Vor Ort

EUR 65.000 - 85.000

Vollzeit

14 Tage+

Erhalte mehr Antworten von Arbeitgebern

Versende in nur wenigen Minuten einen passgenauen Lebenslauf.

Benefits dieser Stelle

Competitive Salary & Equity
Health, Dental, Vision and Life Insurance
Flexible Time Off (FTO)
Autonomous Work Environment
Quarterly Team Gatherings

Zusammenfassung

United States Digital Space LLC is seeking an experienced Security Engineer to design and implement innovative solutions for detecting and responding to abuse scenarios in AI-generated content.

The role involves building LLM guardrails, analyzing attack patterns, and collaborating with cross-functional teams. Strong skills in Python, data analysis, and incident response are essential. Benefits include competitive salary, health insurance, and flexible time off.

Qualifikationen

  • 4+ years of experience in security engineering, anti-abuse, trust & safety, or fraud detection.
  • Strong programming skills in Python and/or TypeScript.
  • Experience with SQL and data analysis at scale.
  • Experience building or fine-tuning ML/LLM-based classifiers.

Aufgaben

  • Design and implement LLM guardrails for abuse detection.
  • Build AI-powered systems for identifying malicious patterns.
  • Analyze attack patterns and create detection rules.
  • Track abuse trends and adapt defenses.

Kenntnisse

Security engineering
Programming (Python, TypeScript)
Data analysis
ML/LLM-based classifiers
Investigation of abuse patterns
Clear communication
Familiarity with attack patterns

Tools

BigQuery
Slurper
Snyk
CI/CD tools
Kubernetes

Jobbeschreibung

About the role

the company is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, the company is democratizing software development by removing traditional barriers to application creation.

In this role you will…
  • Design and implement LLM guardrails that detect abuse scenarios in AI-generated code and agent interactions
  • Build AI-powered detection systems that use LLMs to identify malicious patterns, classify threats, and automate response decisions
  • Build and operate abuse detection systems that identify phishing, cryptomining, account takeover, and financial fraud across millions of daily user actions
  • Design automated response mechanisms that enforce platform policies without manual intervention
  • Own the full abuse response lifecycle: detection, investigation, enforcement, and handling appeals alongside Support and Legal
  • Analyze attack patterns using BigQuery and Hex, turning investigation findings into new detection rules
  • Maintain and extend internal detection tools (Slurper, Netwatch) that continuously monitor user activity
  • Integrate and tune security scanners (SAST, SCA) in CI pipelines with tight performance SLAs
  • Track abuse trends, measure detection effectiveness, and adapt defenses as attack patterns evolve
Required skills and experience
  • 4+ years of experience in security engineering, anti-abuse, trust & safety, or fraud detection
  • Strong programming skills in Python and/or TypeScript for building detection systems and automation
  • Experience with SQL and data analysis at scale (BigQuery, Snowflake, or similar)
  • Experience building or fine-tuning ML/LLM-based classifiers for security or abuse detection
  • Familiarity with prompt injection, jailbreaking, and other LLM‑specific attack vectors
  • Ability to investigate complex abuse patterns and translate findings into automated defenses
  • Familiarity with common attack patterns: phishing infrastructure, account takeover, credential stuffing, resource abuse
  • Clear communication skills for working across Security, Support, Legal, and Engineering teams
Nice to have
  • Experience at a platform company dealing with user-generated content or compute abuse (hosting providers, cloud platforms, developer tools)
  • Background in fraud detection, payment abuse, or financial crime
  • Familiarity with device fingerprinting, IP reputation, and email validation services
  • Experience with CI/CD security tooling (SAST, SCA, Dependabot, Snyk)
  • Knowledge of container security, Linux internals, or cloud infrastructure (GCP preferred)
  • Prior work with abuse reporting pipelines, trust & safety tooling, or content moderation systems
Tools + Tech Stack for this role
  • Languages: Python, TypeScript, Go, SQL
  • Data: BigQuery, Hex
  • Detection tools: Slurper, Netwatch, Stytch (device fingerprint); ClearOut (email reputation)
  • CI/CD Security: Dependabot, Snyk, SAST/SCA scanners
  • Infrastructure: GCP, Kubernetes
  • Collaboration: Linear, Slack, Zendesk (for abuse reports)
This role may not be a fit if
  • You prefer deep security research over building operational detection systems
  • You want to focus on vulnerability management, pentesting, or bug bounty triage (that’s our Security team)
  • You’re looking for a role with predictable, well-defined problems rather than constantly adapting to adversarial behavior
  • You prefer working in isolation rather than partnering closely with Support, Legal, and cross‑functional teams
  • You’re uncomfortable making enforcement decisions that affect real users
Benefits
  • Competitive Salary & Equity
  • 401(k) Program with a 4% match (US Only)
  • Health, Dental, Vision and Life Insurance
  • Short Term and Long Term Disability
  • Paid Parental, Medical, Caregiver Leave
  • Flexible Time Off (FTO) + Holidays
  • Commuter Benefits (In-Office Only)
  • Monthly Wellness Stipend
  • Autonomous Work Environment
  • In Office Set‑Up Reimbursement (In-Office Only)
  • Quarterly Team Gatherings
  • In Office Amenities (In-Office Only)

This is a full‑time role that can be held from our Foster City, CA office. The role has an in‑office requirement of Monday, Wednesday, and Friday.

To achieve our mission of making programming more accessible around the world, we need our team to be representative of the world. We welcome your unique perspective and experiences in shaping this product. We encourage people from all kinds of backgrounds to apply, including and especially candidates from underrepresented and non‑traditional backgrounds.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.
oder ziehe deine Datei hierhin.
Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Sr./Staff Security Engineer
Sr./Staff Security Engineer

Oscilar • Deutschland

Remote
EUR 80.000 - 110.000
100% Medical/Dental for you and dependents
Stock options
Caju Card for monthly meal allowance
+2
Staff Software Engineer - AI Platform Team
Staff Software Engineer - AI Platform Team

United States Digital Space LLC • Deutschland

Hybrid
EUR 70.000 - 90.000
Full Stack Software Engineer, Cybersecurity Products
Full Stack Software Engineer, Cybersecurity Products

OpenAI • Deutschland

Hybrid
EUR 131.000 - 185.000
Relocation assistance
Senior Software Engineer, Adaptive Classification Team
Senior Software Engineer, Adaptive Classification Team

Abnormal Security • Deutschland

Remote
EUR 157.000 - 227.000
Software Engineer, Cloudforce One
Software Engineer, Cloudforce One

United States Digital Space LLC • Deutschland

Hybrid
EUR 60.000 - 80.000
Medical/Rx Insurance
Flexible Spending Accounts
401(k) Retirement Savings Plan
+1
Security Lead
Security Lead

United States Digital Space LLC • Berlin

Vor Ort
EUR 120.000 - 180.000
Equity and cash compensation package
Self-development budget
Flat hierarchy with direct access to a
+2
AI Security Research & Red Team Engineer
AI Security Research & Red Team Engineer

Socket.dev • Deutschland

Hybrid
EUR 144.000 - 180.000
Equity plan
Senior Software Engineer - AI Security
Senior Software Engineer - AI Security

Sophos • Deutschland

Remote
EUR 70.000 - 90.000
Software Engineer, Agent Productivity
Software Engineer, Agent Productivity

Docwrite • Deutschland

Remote
EUR 156.000 - 226.000
Security Engineer
Security Engineer

Jobtailor • Deutschland

Vor Ort
EUR 80.000 - 110.000