Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
VettedBench is seeking a Lead Software Security Engineer to head a pod delivering secure coding training and evaluation tasks for frontier AI models. The role focuses on transforming real-world vulnerabilities into Harbor-format tasks across multiple languages, with emphasis on security testing and reproducibility.
You will plan task deliveries, oversee throughput, mentor trainers, and participate in weekly client reporting while ensuring quality, security, and timely delivery in a fully remote,
6+ years of professional software engineering experience.
Expert-level proficiency in at least one of Python, JavaScript/TypeScript, Java, C/C++, C#, Go, Rust, Ruby, PHP, Kotlin, or Swift.
Strong understanding of software security concepts, including CWE, CVE, and the OWASP Top 10
We are seeking a Lead Software Security Engineer to lead a team of trainers who will develop high-quality training and evaluation tasks for frontier AI coding models and step in to perform tasks when there is a high volume. You will transform real-world open-source vulnerabilities—including CVEs, security advisories, and bug reports—into Harbor-format audit-and-patch tasks across multiple programming languages.
This role combines software security research, vulnerability reproduction, benchmark development, automated testing, and technical review. The goal is to create realistic tasks that evaluate whether AI systems can identify, understand, exploit, and securely remediate software vulnerabilities without relying on superficial pattern matching or known patches.
Plan task deliveries by batch, assign work across pod members, and track daily throughput against phase-specific targets.
Monitor pod progress, identify bottlenecks, and ensure tasks move through each stage of production on schedule.
Lead weekly client reporting, communicate delivery status, and raise risks early, including tooling issues, rate limits, safety blocks, and resource constraints.
Collaborate with the team to clarify requirements and align on scope, task volume, and difficulty changes.
Conduct final reviews of completed tasks to ensure they meet the required quality, security, reproducibility, and evaluation standards.
Calibrate Pod Leads and trainers on CWE classification, verifier robustness, task difficulty, and acceptance criteria.
Use throughput and quality data to forecast staffing needs for each project phase.
Initiate hiring and onboarding waves approximately three weeks ahead of projected capacity requirements.
Maintain clear documentation of delivery plans, risks, quality findings, throughput metrics, and staffing forecasts.
6+ years of professional software engineering experience.
Expert-level proficiency in at least one of Python, JavaScript/TypeScript, Java, C/C++, C#, Go, Rust, Ruby, PHP, Kotlin, or Swift.
Strong understanding of software security concepts, including CWE, CVE, and the OWASP Top 10.
Ability to reproduce vulnerabilities and write proof-of-vulnerability tests.
Hands-on experience with security tooling, including sanitizers, fuzzers, and static-analysis tools such as CodeQL or Semgrep.
Strong proficiency with Git, Linux, Bash, and Docker.
Excellent technical writing and documentation skills.
Ability to work independently in a fully remote, research-oriented environment.
Strong judgment on verifier robustness and on scoring AI patches. Clear, supportive communicator with some experience mentoring others.
Proven track record on this project or equivalent security-dataset work.
Pay: From ₹250,000.00 per month