Security Engineer, Cybersecurity AI Evaluation

OpenTrain AI, Inc.; United States; Remote; USD 91,000 - 129,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a Security Engineer to craft cybersecurity prompts and assess AI responses using your security engineering and offensive security expertise.

This remote, part-time role in the United States offers flexibility with 20+ hours per week and pay up to $80 per hour for qualifying project work. You will evaluate AI outputs for security relevance and quality, drawing on practical security engineering judgement.

Qualifications

• Minimum three years of professional experience in security engineering or offensive security.
• Fluency in English.
• Experience with cybersecurity testing, red teaming, malware analysis, threat hunting, or vulnerability research.
• Ability to create cybersecurity prompts and judge AI-generated responses.

Responsibilities

• Create prompts that test cybersecurity knowledge in realistic security scenarios.
• Evaluate AI responses for quality, accuracy, and cybersecurity relevance.
• Use practical judgment from security engineering or offensive security work.
• Work independently in an asynchronous remote environment.

Skills

Security engineering

Offensive security

Prompts writing

AI evaluation

Threat analysis

Tools

Burp Suite

Nmap

Wireshark

Metasploit Framework

BloodHound

Impacket

Nessus

Hashcat

Job description

Security Engineer, Cybersecurity AI Evaluation

Create cybersecurity prompts and evaluate AI responses using your security engineering or offensive security expertise. This remote U.S. role offers flexible 20+ hour weeks and up to $80 per hour for qualifying project work.

Remote Hourly · $80/hr

$80/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Posted

Open to applicants in

United States

The work

You will help improve large language models by creating cybersecurity prompts and judging how well the models respond. Your reviews should reflect practical security engineering or offensive security knowledge.

The work is remote and asynchronous. Project assignments may vary across cybersecurity evaluation activities.

• Create prompts that test cybersecurity knowledge in realistic security scenarios.
• Evaluate AI responses for quality, accuracy, and cybersecurity relevance.
• Use practical judgment from security engineering or offensive security work.
• Contribute independently in an asynchronous remote workflow.

What it pays and takes

• Pay: Up to $80 per hour for qualifying project work.
• Schedule: 20+ hours per week with flexible participation.
• Location: Open to candidates in the United States.
• Language: Fluency in English.
• Experience: At least three years of professional experience in security engineering or offensive security.
• Relevant backgrounds include penetration testing, red teaming, malware analysis, threat hunting, threat intelligence, vulnerability research, and security consulting.
• Tools: Hands‑on experience with one or more of Burp Suite, Nmap, Wireshark, Metasploit Framework, BloodHound, Impacket, Nessus, or Hashcat.
• Skills: Ability to write cybersecurity prompts and make informed judgments about AI‑generated responses.

About AI training work

AI training is the human work behind systems that learn from examples. Contributors write prompts, review model responses, and provide ratings that help make AI more accurate and useful. OpenTrain is a platform where people find AI training and data‑labeling roles, build a profile, and apply to projects.

Requirements

Job details

Location

100% remote

United States

Pay

Hourly · $80/hr

Languages

Engagement

Contract, part-time

Generative AI & RLHF

Data type

Text

Create IEP and intervention scenarios, explain decisions, and rate AI responses for educational and legal fit. Remote contract work pays $40 to $70 per hour, with 20+ hours weekly.

Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more

Create engineering analysis problems and worked answers for AI evaluation, drawing on reliability, quality, process, or test engineering experience. The contract pays $115 per hour and requires 20+ hours weekly.

Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more

Create realistic quantitative finance problems and step‑by‑step solutions to evaluate AI models. This remote contract role pays $115 per hour, requires 20+ hours per week, and calls for a graduate degree and three years of quant experience.

Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more

Review AI‑generated work on government budgets, grants, and program reporting for $70 per hour. This remote, part‑time project requires 5+ years of public‑sector experience and at least 20 hours a week.

Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more

Create realistic product analytics problems and detailed answers to evaluate AI systems, drawing on experiments, metrics, retention, and growth. Remote contract work pays $115 per hour and requires at least 20 hours per week.

Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more