AI Security Evaluation Lead - SOC Benchmarking (Remote)

CrowdStrike Inc.; Lazio; Ibrido; EUR 132.000 - 167.000; Tempo pieno

Vantaggi offerti da questo lavoro

Competitive salary

Stock options

Private Healthcare insurance

Life insurance

Training budget

Flexible time off

Team hangouts

Descrizione del lavoro

CrowdStrike is seeking an Evaluation Lead to build and guide a team dedicated to designing rigorous evaluations for AI models in cybersecurity. You will ground models in real SOC workflows and translate findings into actionable engineering improvements.

You will apply hands-on SOC experience, lead a team of researchers and engineers, and set strategy for evaluating AI/LLM systems across security use cases, including incident response and threat hunting.

Competenze

• Hands-on SOC experience with day-to-day security operations.
• At least 3 years in a management or team-leadership position.
• Strong knowledge of incident response and threat hunting workflows.
• Familiarity with AI/LLM capabilities and agentic systems.

Mansioni

• Lead, mentor and grow a team of researchers and engineers focused on evaluating AI models in cybersecurity tasks.
• Define strategy, roadmap and success metrics for evaluating AI/LLM and agentic systems across security use cases.
• Design and standardize evaluation methodologies, benchmark datasets and testing pipelines rooted in real SOC workflows.
• Assess models for accuracy, robustness, reliability in security-analyst scenarios.
• Establish quantitative and qualitative metrics reflecting performance against threat challenges.
• Translate evaluation findings into actionable improvements with cross-functional teams.

Conoscenze

SOC experience

Team leadership

Mentoring

Security operations

AI/LLM familiarity

Communication skills

Strumenti

Python

SIEM/SOAR

LLM evaluation frameworks

Descrizione del lavoro

CrowdStrike is seeking an Evaluation Lead to build and guide a team dedicated to designing rigorous evaluations for AI models in cybersecurity. You will ground models in real SOC workflows and translate findings into actionable engineering improvements.

You will apply hands-on SOC experience, lead a team of researchers and engineers, and set strategy for evaluating AI/LLM systems across security use cases, including incident response and threat hunting.