Lead AI Architect for Secure, Scalable LLMs

mymoose; Ireland; Sur place; EUR 150 000 - 210 000; Plein temps

Résumé du poste

Rapid7 is expanding its AI Engineering organization to define and build the next generation of AI for security products. As a Principal AI Engineer, you will set the technical direction for LLMs and agentic systems, staying hands-on with core issues from transformer internals to deployment.

You will mentor senior engineers and influence product and platform investments across Detection, Response, and Remediation.

Qualifications

• 12+ years of software or ML engineering experience with leadership in AI systems.
• Proven ability to lead multi-team architectural decisions and mentor engineers.

Responsabilités

• Define architecture and technical roadmap for LLM and agentic AI systems across company security products.
• Lead model strategy: frontier vs open-source models, fine-tuning, distillation or post-training.
• Fine-tune, distill and post-train open-source LLMs on security data from data curation to deployment.
• Set engineering standards for context engineering and inference optimization.
• Optimize LLM inference at scale with techniques like speculative decoding and KV-cache management.
• Establish evals as release gates and lead design reviews.
• Stay hands-on: write critical model, training and inference code; mentor Staff and Senior engineers.

Connaissances

AI engineering

ML engineering

Python

PyTorch

Distributed systems

Inference optimization

LLMs

Mentoring

Formation

PhD in Computer Science/ML or related field

Equivalent industry depth demonstrated

Outils

vLLM

TensorRT-LLM

DeepSpeed

FSDP

QLoRA/LoRA

Description du poste

Rapid7 is expanding its AI Engineering organization to define and build the next generation of AI for security products. As a Principal AI Engineer, you will set the technical direction for LLMs and agentic systems, staying hands-on with core issues from transformer internals to deployment.

You will mentor senior engineers and influence product and platform investments across Detection, Response, and Remediation.