Senior Security Engineer (Any Programming)

VettedBench

United States

Remote

USD 140,000 - 200,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

VettedBench is seeking a Senior Software Security Engineer to develop high-quality training and evaluation tasks for frontier AI coding models. You will transform real-world vulnerabilities into Harbor-format audit-and-patch tasks across multiple languages, enabling rigorous security benchmarking.

You will reproduce vulnerabilities, build reproducible Docker environments, and document vulnerability context, reproduction steps, and patch requirements in a fully remote setting.

Qualifications

  • 5+ years of professional software engineering experience.
  • Expert-level proficiency in at least one listed language.
  • Strong understanding of CWE, CVE and OWASP Top 10.
  • Ability to reproduce vulnerabilities and write proof-of-vulnerability tests.
  • Experience with security tooling and static-analysis tools.

Responsibilities

  • Source and analyze real-world vulnerabilities from CVEs and advisories.
  • Reproduce vulnerabilities and develop proof-of-vulnerability tests.
  • Build Harbor-format tasks across languages such as Python, JavaScript/TypeScript, Java, C/C++, C#, Go, Rust, Ruby, PHP, Kotlin, and Swift.
  • Create reproducible Docker-based environments with pinned dependencies.
  • Review AI-generated patches and document findings.

Skills

Python
JavaScript/TS
Java
C/C++
Go
Rust

Tools

Git
Linux
Bash
Docker
CodeQL
Semgrep

Job description

Role Overview

We are seeking a Senior Software Security Engineer to develop high-quality training and evaluation tasks for frontier AI coding models. You will transform real-world open-source vulnerabilities—including CVEs, security advisories, and bug reports—into Harbor-format audit-and-patch tasks across multiple programming languages.

This role combines software security research, vulnerability reproduction, benchmark development, automated testing, and technical review. The goal is to create realistic tasks that evaluate whether AI systems can identify, understand, exploit, and securely remediate software vulnerabilities without relying on superficial pattern matching or known patches.

What does day-to-day look like
  • Source and analyze real-world vulnerabilities from CVEs, security advisories, bug reports, and open-source repositories.
  • Classify vulnerabilities using the most specific applicable CWE and map them to relevant OWASP Top 10 categories where appropriate.
  • Reproduce vulnerabilities and develop reliable proof-of-vulnerability tests.
  • Build Harbor-format audit-and-patch tasks across languages such as Python, JavaScript/TypeScript, Java, C/C++, C#, Go, Rust, Ruby, PHP, Kotlin, and Swift.
  • Write realistic task instructions that describe the security issue without revealing the vulnerable code, exploit details, or expected fix.
  • Create reproducible Docker-based environments with pinned dependencies and clear setup procedures.
  • Harden verifiers against gaming, overfitting, test manipulation, and hardcoded solutions.
  • Screen out tasks that can be solved by copying a well-known upstream patch without understanding the vulnerability.
  • Review and score AI-generated patches and reasoning using clearly defined technical rubrics.
  • Document vulnerability context, reproduction steps, expected behavior, patch requirements, test methodology, and review decisions.
Requirements
  • 5+ years of professional software engineering experience.
  • Expert-level proficiency in at least one of Python, JavaScript/TypeScript, Java, C/C++, C#, Go, Rust, Ruby, PHP, Kotlin, or Swift.
  • Strong understanding of software security concepts, including CWE, CVE, and the OWASP Top 10.
  • Ability to reproduce vulnerabilities and write proof-of-vulnerability tests.
  • Hands-on experience with security tooling, including sanitizers, fuzzers, and static-analysis tools such as CodeQL or Semgrep.
  • Strong proficiency with Git, Linux, Bash, and Docker.
  • Excellent technical writing and documentation skills.
  • Ability to work independently in a fully remote, research-oriented environment.
Benefits
  • Work from home
Experience
  • Software security: 5 years (Required)

Work Location: Remote

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Security Engineer Lead
Senior Software Security Engineer Lead

VettedBench • United States

Remote
USD 27,000 - 32,000
Senior Software Security Engineer Pod Lead
Senior Software Security Engineer Pod Lead

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 165,000
Application Security Analyst
Application Security Analyst

Alignerr Corp. • New York (NY)

Remote
USD 55,000 - 110,000
Fully remote
Flexible schedule
Remote Senior Security Engineer: Vulnerability Benchmarking
Remote Senior Security Engineer: Vulnerability Benchmarking

VettedBench • United States

Remote
USD 140,000 - 200,000
Vulnerabilities Security Researcher
Vulnerabilities Security Researcher

Request Technology, LLC • United States

On-site
USD 120,000 - 150,000
Bonus eligibility
Senior Software Security Engineer - AI Training
Senior Software Security Engineer - AI Training

Braintrust • United States

Remote
USD 17,000 - 24,000
Security Engineer
Security Engineer

present of AI • San Francisco (CA)

On-site
USD 150,000 - 210,000
Application Security Analyst
Application Security Analyst

Alignerr Corp. • Atlanta (GA)

Remote
USD 55,000 - 110,000
Fully remote
Flexible schedule
Global collaboration
Senior Software Security Engineer – Pod Lead
Senior Software Security Engineer – Pod Lead

Turing • United States

Remote
USD 124,000 - 193,000
Fully remote
AI projects with leading LLMs
Security Engineer, Application Security
Security Engineer, Application Security

OpenAI, Inc. • United States

Hybrid
USD 100,000 - 150,000