AI Security Evaluator for Cyber Threats (Contract)

Obsidian; San Francisco (CA); Remote; USD 322,875 - 396,675; Full time

Job summary

Obsidian is seeking experienced cybersecurity professionals to enhance AI systems' reasoning for threat detection and security operations. Responsibilities include reviewing AI outputs, creating cybersecurity scenarios, and annotating data across use cases.

Ideal candidates should have over 3 years in cybersecurity roles, and certifications like CISSP or CEH are advantageous. Compensation is competitive, with task completion pay between $1,750 and $2,150, plus bonuses for top performers.

Qualifications

• 3+ years of professional experience in cybersecurity at an enterprise organization, MSSP, or government environment.
• Professional certifications such as CISSP, CISM, CEH, or OSCP are a plus.
• Strong analytical thinking and structured evaluation task translation ability.

Responsibilities

• Review and evaluate AI-generated outputs in cybersecurity contexts.
• Create realistic scenarios based on cybersecurity workflows.
• Annotate, label, and validate data across diverse cybersecurity use cases.
• Provide structured feedback on AI accuracy regarding cybersecurity standards.
• Collaborate with research teams to refine evaluation frameworks.

Skills

Cybersecurity expertise

Analytical thinking

Clear written communication

Job description

Obsidian is seeking experienced cybersecurity professionals to enhance AI systems' reasoning for threat detection and security operations. Responsibilities include reviewing AI outputs, creating cybersecurity scenarios, and annotating data across use cases.

Ideal candidates should have over 3 years in cybersecurity roles, and certifications like CISSP or CEH are advantageous. Compensation is competitive, with task completion pay between $1,750 and $2,150, plus bonuses for top performers.