Cybersecurity Expert for Safe AI Evaluation

Mpathic; United States; On-site; USD 103,000 - 165,000; Part time

Job summary

mpathic.ai is seeking cybersecurity experts to design advanced prompts and evaluate AI systems for security relevance and reliability. You will shape how AI understands software security, cyber defense, and vulnerability research, operating within a multidisciplinary team.

The role focuses on creating realistic scenarios, assessing AI responses for accuracy, and maintaining high-quality, responsible evaluations across complex security topics.

Qualifications

• Bachelor's or Master's in CS, Cybersecurity, or related field.
• 5+ years of professional software engineering experience.
• Strong knowledge of cybersecurity principles and secure development.

Responsibilities

• Design realistic cybersecurity prompts across diverse domains.
• Evaluate AI-generated responses for accuracy and usefulness.
• Assess model handling of sensitive/dual-use topics.
• Apply structured rubrics to annotate prompts and outputs.
• Provide actionable feedback to improve safety and reliability.

Skills

Cybersecurity

Software engineering

English communication

Judgment & evaluation

Education

Bachelor's or Master's in Computer Science or Cybersecurity

Job description

mpathic.ai is seeking cybersecurity experts to design advanced prompts and evaluate AI systems for security relevance and reliability. You will shape how AI understands software security, cyber defense, and vulnerability research, operating within a multidisciplinary team.

The role focuses on creating realistic scenarios, assessing AI responses for accuracy, and maintaining high-quality, responsible evaluations across complex security topics.