Remote Senior Software Security Engineer — AI Benchmarking

Gramian Consulting

Pakistan

Remote

PKR 22,656,000 - 35,242,000

Full time

8 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Gramian Consultancy is seeking an experienced Senior Software Security Engineer to develop training and evaluation tasks for AI coding models. You will transform real-world vulnerabilities into Harbor-format audit-and-patch tasks across multiple programming languages.

This role combines software security research, vulnerability reproduction, benchmark development, automated testing, and technical review. Remote contract engagement.

Qualifications

  • 5+ years of professional software engineering experience.
  • Expert-level proficiency in at least one of the listed programming languages.
  • Strong understanding of software security principles and common vulnerability classes.
  • Ability to independently reproduce vulnerabilities and develop PoVs.
  • Hands-on experience with security testing and analysis tools.

Responsibilities

  • Vulnerability Research: Source and investigate real-world vulnerabilities from CVEs and advisories.
  • Security Classification: Map to CWE and OWASP Top 10 categories.
  • Vulnerability Reproduction: Reproduce issues and develop PoV tests.
  • Benchmark Development: Build Harbor-format tasks across languages.
  • Task Authoring: Write realistic instructions without exposing exploit details.
  • Environment Setup: Create Docker-based reproducible environments.
  • Verifier Development: Harden automated verifiers to prevent gaming.
  • Patch Evaluation: Score AI-generated patches with rigorous rubrics.
  • Quality Assurance: Filter tasks not requiring deep understanding.
  • Technical Documentation: Document context, steps, patches, and decisions.

Skills

Python
JavaScript/TypeScript
C/C++
Go
Rust
Security testing
Docker
Git

Tools

CodeQL
Semgrep
Linux
Docker

Job description

Gramian Consultancy is seeking an experienced Senior Software Security Engineer to develop training and evaluation tasks for AI coding models. You will transform real-world vulnerabilities into Harbor-format audit-and-patch tasks across multiple programming languages.

This role combines software security research, vulnerability reproduction, benchmark development, automated testing, and technical review. Remote contract engagement.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Security Engineer - AI Benchmarking Remote
Senior Software Security Engineer - AI Benchmarking Remote

The Briefed • Pakistan

Remote
PKR 4,000,000 - 7,000,000
Senior Software Security Engineer - AI Benchmark Development
Senior Software Security Engineer - AI Benchmark Development

Gramian Consulting • Pakistan

Remote
PKR 22,656,000 - 35,242,000
Senior Software Security Engineer AI Benchmark Lead Remote
Senior Software Security Engineer AI Benchmark Lead Remote

The Briefed • Pakistan

Remote
PKR 11,065,000 - 22,130,000
Remote Engineering Manager - Security & AI Benchmark
Remote Engineering Manager - Security & AI Benchmark

Gramian Consulting • Pakistan

Remote
PKR 22,865,000 - 45,729,000
Engineering Manager: Software Security & AI Benchmark
Engineering Manager: Software Security & AI Benchmark

The Briefed • Pakistan

Remote
PKR 3,200,000 - 7,200,000
Senior at Gramian Consulting Group, Remote Pakistan NEW
Senior at Gramian Consulting Group, Remote Pakistan NEW

The Briefed • Pakistan

Remote
PKR 4,000,000 - 7,000,000
Remote Cyber Engineer – App Security & Pen Testing
Remote Cyber Engineer – App Security & Pen Testing

AI Trainer HQ • Pakistan

Remote
PKR 30,486,000 - 38,108,000
Engineering Manager - Software Security & AI Benchmark Delivery
Engineering Manager - Software Security & AI Benchmark Delivery

Gramian Consulting • Pakistan

Remote
PKR 22,865,000 - 45,729,000
Cyber Engineer (3+ Years Experience)
Cyber Engineer (3+ Years Experience)

AI Trainer HQ • Pakistan

Remote
PKR 30,486,000 - 38,108,000
Lead Software at Gramian Consulting Group, Remote Pakistan NEW
Lead Software at Gramian Consulting Group, Remote Pakistan NEW

The Briefed • Pakistan

Remote
PKR 11,065,000 - 22,130,000
Top locations