Senior Software Security Engineer - AI Benchmarking

Gramian Consulting

Colombia

A distancia

COP 60.000.000 - 90.000.000

Jornada completa

hace 23 horas
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

Gramian Consultancy is seeking an experienced Senior Software Security Engineer to develop training and evaluation tasks for advanced AI coding models. You will transform real-world vulnerabilities into Harbor-format audit-and-patch tasks across multiple languages.

This role combines software security research, vulnerability reproduction, benchmark development, automated testing, and technical review. Fully remote contractor engagement offered.

Formación

  • 5+ years of professional software engineering experience.
  • Expert-level proficiency in at least one listed programming language.
  • Strong understanding of software security principles and common vulnerability classes.
  • Practical knowledge of CWE, CVE, and OWASP Top 10.
  • Ability to independently reproduce vulnerabilities and develop proof-of-vulnerability tests.
  • Hands-on security testing and analysis tooling experience.

Responsabilidades

  • Vulnerability Research: source and investigate real-world vulnerabilities from CVEs and advisories.
  • Security Classification: identify and map to CWE and OWASP Top 10.
  • Vulnerability Reproduction: reproduce issues and develop proof-of-vulnerability tests.
  • Benchmark Development: build Harbor-format tasks across languages and ecosystems.
  • Task Authoring: write realistic instructions without exposing code or patches.
  • Environment Setup: create Docker-based reproducible environments.
  • Verifier Development: design automated verifiers to prevent gaming and overfitting.
  • Patch Evaluation: review AI-generated patches with structured rubrics.
  • Quality Assurance: avoid superficial pattern matching.
  • Technical Documentation: document context, steps, and remediation.

Conocimientos

Python
JavaScript / TypeScript
Java
C / C++
C#
Go
Rust
Ruby
PHP
Kotlin
Swift
Git
Linux
Bash
Docker

Herramientas

CodeQL
Semgrep
Sanitizers
Fuzzers

Descripción del empleo

Gramian Consultancy is seeking an experienced Senior Software Security Engineer to develop training and evaluation tasks for advanced AI coding models. You will transform real-world vulnerabilities into Harbor-format audit-and-patch tasks across multiple languages.

This role combines software security research, vulnerability reproduction, benchmark development, automated testing, and technical review. Fully remote contractor engagement offered.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Software Security Engineer - AI Benchmark Development
Senior Software Security Engineer - AI Benchmark Development

Gramian Consulting • Colombia

A distancia
COP 60.000.000 - 90.000.000
Senior AI Security Engineer - Remote, Vulnerability Trainer
Senior AI Security Engineer - Remote, Vulnerability Trainer

Crossing Hurdles • Colombia

A distancia
COP 76.938.000 - 104.093.000
Application Security Engineer | $20/hr Remote
Application Security Engineer | $20/hr Remote

Crossing Hurdles • Colombia

A distancia
COP 76.938.000 - 104.093.000
Senior Open-Source QA Engineer (Remote, Part-time)
Senior Open-Source QA Engineer (Remote, Part-time)

Anyone AI Inc. • Colombia

A distancia
COP 66.960.000 - 133.920.000
Remote work
Flexible hours
Sr. AI Security Engineer
Sr. AI Security Engineer

Backblaze • Colombia

Presencial
COP 285.938.952 - 393.166.059
Senior AI Security Engineer — Agentic & Runtime Safeguards
Senior AI Security Engineer — Agentic & Runtime Safeguards

Backblaze External Website • Colombia

A distancia
COP 140.000.000 - 210.000.000
Senior Software Engineer – Open Source & SWE-Bench Evaluation
Senior Software Engineer – Open Source & SWE-Bench Evaluation

Anyone AI Inc. • Colombia

A distancia
COP 66.960.000 - 133.920.000
Remote work
Flexible hours
AI Benchmark Investigator & QA Analyst
AI Benchmark Investigator & QA Analyst

Crossing Hurdles • Colombia

Presencial
COP 188.816.000 - 314.693.000
AI Benchmark Architect & OSINT Research Writer
AI Benchmark Architect & OSINT Research Writer

Crossing Hurdles • Colombia

Presencial
COP 95.484.000 - 190.967.000
Remote AI Evaluation Researcher — Benchmark & QA Expert
Remote AI Evaluation Researcher — Benchmark & QA Expert

Crossing Hurdles • Colombia

Presencial
COP 60.000.000 - 90.000.000