Remote Senior App Security Engineer for AI Code Eval

Braintrust; United States; Teletrabalho; USD 103 000 - 124 000; Tempo integral

Resumo da oferta

Leading AI Lab is seeking a contractor to evaluate security-focused coding tasks and improve LLM performance. Remote candidates in the United States and other eligible locations may participate for a 20 hours per week commitment at $75–$90 per hour.

You will bring 5+ years of software development and strong Python skills, along with hands-on vulnerability research, exploit verification, and security patch experience. Fluency in English is required.

Qualificações

• Minimum 5 years of professional software development experience.
• Strong Python skills required.
• Hands-on vulnerability research or exploit verification experience.
• Ability to document findings with clear technical feedback.
• Fluent in written and spoken English.

Responsabilidades

• Evaluate coding tasks involving vulnerabilities, exploit verification and security patches.
• Create high-quality coding prompts and reference answers for benchmarks.
• Evaluate model outputs for code generation, refactoring, debugging and implementation.
• Identify and document model failures, edge cases and reasoning gaps.
• Compare private language models with leading external models.
• Build or configure coding environments for evaluation and reinforcement learning.
• Follow detailed annotation and evaluation guidelines consistently.

Conhecimentos

5+ years software development

Python

Vulnerability research

Exploit verification

Security patches

English fluency

Ferramentas

Python

Descrição da oferta de emprego

Leading AI Lab is seeking a contractor to evaluate security-focused coding tasks and improve LLM performance. Remote candidates in the United States and other eligible locations may participate for a 20 hours per week commitment at $75–$90 per hour.

You will bring 5+ years of software development and strong Python skills, along with hands-on vulnerability research, exploit verification, and security patch experience. Fluency in English is required.