Senior Principal AI Engineer — Security LLM Architect

mymoose; Ireland; On-site; EUR 180,000 - 230,000; Full time

Job summary

Rapid7 is scaling its AI Engineering capabilities to shape the next generation of AI across security products. As a Senior Principal AI Engineer, you will define technical direction for LLMs and agentic systems, balance frontier and open-source approaches, and mentor senior engineers while driving cross‑team architectural decisions.

You will lead high‑impact initiatives, prototype critical model and inference code, and partner with executives to influence product strategy.

Qualifications

• Over 14 years in software or ML engineering, with production LLM/agentic AI systems
• PhD in Computer Science, Machine Learning or related field preferred
• Proven track record building scalable AI systems adopted across products
• Strong PyTorch skills with distributed training experience

Responsibilities

• Set the AI technical vision, architecture and multi-year roadmap for LLM/agentic systems
• Define company-wide model strategy for frontier/open-source vs tuned models
• Lead high-risk initiatives including fine-tuning, distillation and post-training of LLMs
• Establish standards for context engineering, inference optimization and eval strategies
• Lead scale-up of LLM inference balancing quality, latency and cost
• Mentor senior engineers and represent AI engineering to executives and customers

Skills

LLM systems

Python

PyTorch

Distributed systems

Mentoring

Education

PhD in CS/ML

Tools

vLLM/TensorRT-LLM

DeepSpeed

AWS

Job description

Rapid7 is scaling its AI Engineering capabilities to shape the next generation of AI across security products. As a Senior Principal AI Engineer, you will define technical direction for LLMs and agentic systems, balance frontier and open-source approaches, and mentor senior engineers while driving cross‑team architectural decisions.

You will lead high‑impact initiatives, prototype critical model and inference code, and partner with executives to influence product strategy.