Cybersecurity Evaluation Specialist — Remote Contract

mercor; San Francisco (CA); Hybrid; CAD 2,411,000 - 2,962,000; Full time

Job summary

Mercor is seeking a Cybersecurity Expert for a contract engagement, working remotely. You will review AI-generated outputs related to threat analysis, vulnerability assessments, and security architecture recommendations.

Responsibilities include creating realistic cybersecurity scenarios, annotating data for CVE classification, and providing structured feedback on frameworks like NIST CSF and MITRE ATT&CK. Strong written communication and practical defense experience preferred.

Qualifications

• 3+ years of professional cybersecurity experience in enterprise, MSSP, consultancy, or government/defense environment.
• Background in SOC analysis, incident response (DFIR), penetration testing, threat intelligence, or security architecture.
• Strong analytical thinking and ability to translate security operations into structured evaluation tasks.
• Clear written communication and attention to detail.

Responsibilities

• Review and evaluate AI-generated outputs related to threat analysis, vulnerability assessment, and security architecture recommendations.
• Create realistic scenarios based on cybersecurity workflows such as incident response runbooks, threat hunting queries, and penetration testing reports.
• Annotate, label, and validate data across cybersecurity use cases like CVE classification accuracy and SIEM alert triage.
• Provide structured feedback on AI accuracy in areas such as cybersecurity frameworks (NIST CSF, MITRE ATT&CK) and threat intelligence standards (STIX/TAXII).
• Collaborate asynchronously with research teams to refine evaluation frameworks for cybersecurity AI.

Skills

Cybersecurity experience

SOC analysis

Incident response

Threat intelligence

Security architecture

Clear communication

Job description

Mercor is seeking a Cybersecurity Expert for a contract engagement, working remotely. You will review AI-generated outputs related to threat analysis, vulnerability assessments, and security architecture recommendations.

Responsibilities include creating realistic cybersecurity scenarios, annotating data for CVE classification, and providing structured feedback on frameworks like NIST CSF and MITRE ATT&CK. Strong written communication and practical defense experience preferred.