Senior Principal AI Architect: LLM & Agentic Systems

Divvy Cloud Corp.; Dublin; Remote; EUR 138,000 - 186,000; Full time

Job summary

Rapid7 is scaling its AI Engineering leadership to shape next‑gen AI across security products. This Senior Principal AI Engineer will define the technical direction for LLMs and agentic systems, balancing research with production needs and mentoring senior engineers.

You will set architecture, drive multi‑team initiatives, and partner with executives to align product strategy with AI capabilities, all while hands‑on coding and prototyping critical components.

Qualifications

• 20+ years of combined software/ML experience with leadership in AI.
• Track record of production AI systems across multiple products.
• Deep knowledge of LLMs, transformer architectures and training.
• Hands-on fine-tuning, distillation and post-training of open-weight LLMs.
• Experience with context engineering and evaluation benchmarks.
• Strong skills in inference optimization and scalable serving.

Responsibilities

• Set multi-year AI technical vision and roadmaps for LLMs and agents.
• Define company-wide model strategy, including open-source vs frontier models.
• Lead complex, high-risk AI initiatives across teams, incl. fine-tuning and post-training.
• Establish standards for context engineering, inference, and evaluation.
• Lead optimization of LLM inference at scale, balancing quality, latency and cost.
• Mentor engineers across levels and influence executive-level decisions.

Skills

LLM architecture

Agentic AI systems

Transformer internals

Inference optimization

Fine-tuning

Distillation

Post-training

Context engineering

Evaluation benchmarks

Pretrain/train understanding

Python fundamentals

Distributed training

PyTorch

AWS/GPU workflows

Education

PhD in Computer Science, ML or related field

Tools

PyTorch

vLLM

TensorRT-LLM

DeepSpeed

LoRA/QLoRA

AWS

CUDA

Triton

Job description

Rapid7 is scaling its AI Engineering leadership to shape next‑gen AI across security products. This Senior Principal AI Engineer will define the technical direction for LLMs and agentic systems, balancing research with production needs and mentoring senior engineers.

You will set architecture, drive multi‑team initiatives, and partner with executives to align product strategy with AI capabilities, all while hands‑on coding and prototyping critical components.