AI Security Data & ML Evaluation Engineer

Menlo Security; Bracknell; Presencial; GBP 70.000 - 110.000; Jornada completa

Descripción de la vacante

Menlo Security is seeking a Data & AI / ML Evaluation Engineer to own data collection, curation, and continuous evaluation across security AI products. You will build automated data ingestion pipelines, manage labeling workflows, and operate evaluation harnesses for SLMs and detection models.

You will work with research and software teams to turn telemetry into actionable model improvements, using Python and related tools, with a focus on security threat data from web, file, and macro sources.

Formación

• 2–4 years of software/data engineering or QA/evaluation experience.
• Strong Python programming skills; knowledge of C++ and SQL a plus.
• Experience with ML model training and evaluation workflows.
• Experience building data pipelines, web scrapers, or processing systems.
• Familiarity with data formats, storage configs, and bugs/metrics tracking.
• Structured approach to dataset labeling and validation.

Responsabilidades

• Design automated data collection, mining, and web-scraping pipelines.
• Build data processing and dataset curation workflows for models.
• Train and retrain PI SLMs, Shadow-AI models, and PI detection.
• Develop benchmarking and evaluation harnesses for model quality.
• Create automated training pipelines for various models.
• Collaborate with research and software teams to improve models.

Conocimientos

Python

C++

SQL

ML algorithms

Herramientas

Docker

Kubernetes

Terraform

Linux

Descripción del empleo

Menlo Security is seeking a Data & AI / ML Evaluation Engineer to own data collection, curation, and continuous evaluation across security AI products. You will build automated data ingestion pipelines, manage labeling workflows, and operate evaluation harnesses for SLMs and detection models.

You will work with research and software teams to turn telemetry into actionable model improvements, using Python and related tools, with a focus on security threat data from web, file, and macro sources.