Senior Principal AI Architect: LLMs & Agent Systems

Divvy Cloud Corp.; California; On-site; USD 238,000 - 322,000; Full time

Benefits offered by this job

None

Job summary

Rapid7 is seeking a Senior Principal AI Engineer to set the technical direction for LLMs and agentic systems across security products. You will define model strategy, lead high-stakes initiatives, and mentor engineers while shaping product and platform investments.

Expect hands-on prototyping and collaboration with executives to drive strategic outcomes. You will influence architecture, evaluation standards and scalable inference, balancing quality, latency and cost for enterprise customers.

Qualifications

• Extensive experience designing and leading production AI systems.
• Strong background in LLM internals, training, fine-tuning and inference.
• Proven ability to drive architectural direction and standards.
• Advanced PyTorch expertise including distributed training.
• Experience with context engineering and evaluation benchmarking.

Responsibilities

• Set the AI technical vision and multi-year roadmap for LLMs and agents.
• Lead complex, high-risk initiatives across multiple teams.
• Define company-wide model strategy and capabilities investment.
• Mentor senior engineers and influence executives on AI strategy.
• Prototype and build critical model, training and inference code.

Skills

LLMs

Agentic AI

Architectural leadership

Mentoring

Python fundamentals

Communication & influence

Model optimization

Inference tuning

Strategic roadmap

Cross-team collaboration

Education

PhD in CS/ML/AI or equivalent

Tools

PyTorch

Open-source LLMs

DeepSpeed

vLLM / TensorRT-LLM

CUDA / Triton

Job description

Rapid7 is seeking a Senior Principal AI Engineer to set the technical direction for LLMs and agentic systems across security products. You will define model strategy, lead high-stakes initiatives, and mentor engineers while shaping product and platform investments.

Expect hands-on prototyping and collaboration with executives to drive strategic outcomes. You will influence architecture, evaluation standards and scalable inference, balancing quality, latency and cost for enterprise customers.