Remote AI Security Evaluation Engineer

OpenTrain AI, Inc.; United States; Remote; USD 55,000 - 110,000; Part time

Job summary

OpenTrain AI, Inc. is seeking an Application Security Evaluation Expert to build secure and vulnerable application fixtures and deterministic tests for AI systems. This remote contractor role emphasizes strong security judgment, coding, testing, and documentation.

You will design fixtures with embedded vulnerabilities or secure solutions, develop deterministic tests, document findings, and support improvements to evaluation pipelines for robust AI training.

Qualifications

• Extensive application security experience or secure software development experience.
• Knowledge of OSWE, LLM security, and AI-powered static analysis.
• Ability to design or evaluate security architecture for traditional and agent-based applications.

Responsibilities

• Design and implement small application fixtures with embedded vulnerabilities or secure solutions.
• Create scenarios involving sensitive information disclosure and excessive agency.
• Develop deterministic tests and security-context manifests to assess application security consistently.
• Build hidden answer keys for evaluating vulnerable and secure code.
• Improve synthetic security tasks so they remain realistic and challenging.
• Document technical findings, methods, insights, and practical recommendations.
• Review peer contributions and support agent-based security architecture and evaluation-pipeline improvements.

Skills

Application security

Secure software development

OSWE knowledge

LLM security

AI-powered static analysis

Job description

OpenTrain AI, Inc. is seeking an Application Security Evaluation Expert to build secure and vulnerable application fixtures and deterministic tests for AI systems. This remote contractor role emphasizes strong security judgment, coding, testing, and documentation.

You will design fixtures with embedded vulnerabilities or secure solutions, develop deterministic tests, document findings, and support improvements to evaluation pipelines for robust AI training.