Cybersecurity Engineer - AI Benchmarking Lead

Gramian Consulting Group

Indonesia

Remote

IDR 1,510,526,000 - 3,021,053,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Gramian Consultancy seeks an experienced Lead Software Security Engineer to lead trainers in developing high-quality AI benchmarking tasks. You will oversee delivery, coordinate team capacity, and contribute hands-on vulnerability research for Harbor-format audit-and-patch tasks across multiple languages.

The role focuses on transforming real-world vulnerabilities into robust tasks, ensuring secure remediation and benchmark integrity. Remote work with PST overlap applies.

Qualifications

  • 6+ years of professional software engineering experience.
  • Expert-level proficiency in at least one programming language from the list.
  • Ability to reproduce software vulnerabilities and develop proof-of-vulnerability tests.
  • Hands-on experience with security tooling (sanitizers, fuzzers, static analysis such as CodeQL/Semgrep).
  • Strong writing, documentation, and communication skills.

Responsibilities

  • Team & Delivery Management: Plan task deliveries by batch, assign work across pod members, and track throughput against targets.
  • Progress Monitoring: Monitor pod performance, identify bottlenecks, resolve delivery issues, ensure tasks move through stages on schedule.
  • Client Communication: Lead weekly reporting, communicate delivery status, and escalate risks.
  • Scope & Requirements Alignment: Clarify requirements with the client and align on task scope, volume, complexity.
  • Technical Quality Assurance: Final reviews to ensure quality, security, reproducibility, evaluation standards.
  • Team Calibration: Train Pod Leads and trainers on CWE classification, verifier robustness, and acceptance criteria.
  • Capacity Planning: Forecast staffing needs across project phases.
  • Recruitment & Onboarding: Initiate hiring waves ahead of capacity requirements.
  • Hands-on Technical Contribution: Research vulnerabilities, reproduce issues, develop tests, and review benchmark tasks when workload spikes.
  • Documentation & Reporting: Maintain clear docs of plans, risks, and decisions.

Skills

Python
Java
C / C++
C#
Go
Rust
Ruby
PHP
Kotlin
Swift

Tools

Git
Linux
Bash
Docker

Job description

Cybersecurity Engineer - AI Benchmarking Lead

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

We are seeking an experienced Lead Software Security Engineer to lead a team of trainers developing high-quality training and evaluation tasks for frontier AI coding models. You will oversee project delivery, coordinate team capacity, maintain technical quality standards, and step in to perform hands‑on vulnerability research and task development when workloads increase.

The project focuses on transforming real-world open-source vulnerabilities—including CVEs, security advisories, and bug reports—into Harbor-format audit‑and‑patch tasks across multiple programming languages. These tasks evaluate whether AI systems can identify, understand, reproduce, and securely remediate software vulnerabilities rather than relying on superficial pattern matching or copying known patches.

This position combines software security expertise, technical leadership, benchmark development, quality assurance, and delivery management. The ideal candidate is an experienced security-focused software engineer who can lead contributors, make sound technical decisions, manage delivery expectations, and maintain hands‑on involvement in the work.

Engagement Type: Contractor assignment
Duration: 3 months
Start Date: Expected to start next week
Commitment: 40 hours per week
Work Arrangement: Fully remote
Time Zone Requirement: Minimum 4 hours of overlap with PST
Project Focus: Software security research, AI coding model training and evaluation, benchmark development, and technical team leadership.

Key Responsibilities

Team & Delivery Management: Plan task deliveries by batch, assign work across pod members, and track daily throughput against phase‑specific targets.

Progress Monitoring: Monitor pod performance, identify bottlenecks, resolve delivery issues, and ensure tasks move through production stages on schedule.

Client Communication: Lead weekly client reporting, communicate delivery status, and proactively elevate risks involving tooling issues, rate limits, safety blocks, and resource constraints.

Scope & Requirements Alignment: Collaborate with the client to clarify requirements and align on task scope, volume, complexity, and difficulty changes.

Technical Quality Assurance: Conduct final reviews of completed tasks to ensure they meet required quality, security, reproducibility, and evaluation standards.

Team Calibration: Train and calibrate Pod Leads and trainers on CWE classification, verifier robustness, task difficulty, technical requirements, and acceptance criteria.

Capacity Planning: Use throughput and quality data to forecast staffing needs across project phases.

Recruitment & Onboarding: Initiate hiring and onboarding waves approximately three weeks ahead of projected capacity requirements.

Hands‑on Technical Contribution: Step in to research vulnerabilities, reproduce security issues, develop proof‑of‑vulnerability tests, and create or review benchmark tasks during periods of high workload.

Documentation & Reporting: Maintain clear documentation of delivery plans, risks, quality findings, throughput metrics, staffing forecasts, and project decisions.

Requirements

6+ years of professional software engineering experience.

Expert‑level proficiency in at least one of the following programming languages:

Python

Java

C / C++

C#

Go

Rust

Ruby

PHP

Kotlin

Swift

Strong understanding of software security concepts, including CWE, CVE, and OWASP Top 10.

Ability to reproduce software vulnerabilities and develop proof‑of‑vulnerability tests.

Hands‑on experience with security tooling, including sanitizers, fuzzers, and static‑analysis tools such as CodeQL or Semgrep.

Strong proficiency with Git, Linux, Bash, and Docker.

Strong technical judgment when evaluating verifier robustness, security patches, and AI‑generated code.

Experience reviewing technical work and maintaining consistent quality standards across multiple contributors.

Some experience mentoring engineers, trainers, or technical contributors.

Excellent technical writing, documentation, and communication skills.

Ability to work independently in a fully remote, research‑oriented environment.

Proven track record working on this project or equivalent software security dataset, benchmark development, or security evaluation work.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Cybersecurity Engineer - AI Benchmarking
Cybersecurity Engineer - AI Benchmarking

Gramian Consulting Group • Indonesia

Remote
IDR 240,000,000 - 420,000,000
Lead Cybersecurity Engineer - Remote AI Benchmarking
Lead Cybersecurity Engineer - Remote AI Benchmarking

Gramian Consulting Group • Indonesia

Remote
IDR 1,510,526,000 - 3,021,053,000
Senior Cybersecurity Engineer - AI Benchmarking & Vulnerability
Senior Cybersecurity Engineer - AI Benchmarking & Vulnerability

Gramian Consulting Group • Indonesia

Remote
IDR 240,000,000 - 420,000,000
Engineering Manager – Software Security
Engineering Manager – Software Security

Codefeast • Indonesia

On-site
IDR 420,000,000 - 640,000,000
Senior Application Security Engineer - GenAI Security Evaluation
Senior Application Security Engineer - GenAI Security Evaluation

Gramian Consulting Group • Indonesia

Remote
IDR 2,169,590,000 - 3,254,384,000
Application Security Engineer | $20/hr Remote
Application Security Engineer | $20/hr Remote

Crossing Hurdles • Indonesia

Remote
IDR 414,033,000 - 589,683,000
Cyber Security Specialist
Cyber Security Specialist

Codefeast • Indonesia

On-site
IDR 500,000,000 - 800,000,000
Remote Senior Software Security Engineer - AI Trainer
Remote Senior Software Security Engineer - AI Trainer

Crossing Hurdles • Indonesia

Remote
IDR 414,033,000 - 589,683,000
Senior Hardware Engineering & AI Systems Specialist (MSc/PhD)
Senior Hardware Engineering & AI Systems Specialist (MSc/PhD)

Gramian Consulting • Indonesia

Remote
IDR 997,807,000 - 1,496,711,000
Application Security Lead | 25/hr Remote
Application Security Lead | 25/hr Remote

Crossing Hurdles • Indonesia

Remote
IDR 478,333,000 - 629,386,000