Remote Cybersecurity Analyst - AI Evaluation Specialist

mercor; United States; Remote; USD 2,411,000 - 2,962,000; Full time

Job summary

Mercor is seeking a Cybersecurity Expert for contract work, focusing on evaluating AI-generated security outputs and developing realistic cyber threat scenarios. The role emphasizes structured feedback on frameworks and data labeling to improve AI-assisted security analysis.

The candidate should bring 3+ years in enterprise cybersecurity, including SOC, DFIR, pentest, and threat intelligence, with strong communication skills and attention to detail.

Qualifications

• 3+ years of professional cybersecurity experience in an enterprise, MSSP, consultancy, or government/defense setting.
• Background in SOC analysis, incident response (DFIR), penetration testing, threat intelligence, or security architecture.
• Strong analytical thinking and the ability to translate security operations into structured evaluation tasks.
• Clear written communication and attention to detail.

Responsibilities

• Review and evaluate AI-generated outputs related to threat analysis, vulnerability assessment, and security architecture recommendations.
• Create realistic scenarios based on cybersecurity workflows such as incident response runbooks, threat hunting queries, and penetration testing reports.
• Annotate, label, and validate data across cybersecurity use cases like CVE classification accuracy and SIEM alert triage.
• Provide structured feedback on AI accuracy in cybersecurity frameworks (NIST CSF, MITRE ATT&CK) and threat intelligence standards (STIX/TAXII).
• Collaborate asynchronously with research teams to refine evaluation frameworks for cybersecurity AI.

Skills

SOC analysis

Incident response

Penetration testing

Threat intelligence

Security architecture

Analytical thinking

Written communication

Education

CISSP

CISM

CEH

OSCP

GIAC certifications

Security+

Job description

Mercor is seeking a Cybersecurity Expert for contract work, focusing on evaluating AI-generated security outputs and developing realistic cyber threat scenarios. The role emphasizes structured feedback on frameworks and data labeling to improve AI-assisted security analysis.

The candidate should bring 3+ years in enterprise cybersecurity, including SOC, DFIR, pentest, and threat intelligence, with strong communication skills and attention to detail.