Remote Senior Principal AI Architect

Divvy Cloud Corp.; United States; Remote; USD 256,000 - 346,000; Full time

Job summary

Rapid7 is seeking a Senior Principal AI Engineer to set technical direction for LLMs and agentic systems across security products. You will guide model strategy, tuning, and deployment, balancing performance and cost while staying hands-on with challenging problems.

You will mentor engineers, influence product and platform investments, and represent Rapid7’s AI efforts to executives and customers as the AI program scales globally.

Qualifications

• 14+ years of software or ML engineering experience with 2+ years building production LLM or agentic AI systems.

Responsibilities

• Set the AI technical vision, architecture and multi-year roadmap for LLM and agentic systems.
• Define company-wide model strategy and investment areas for frontier or open-source models.
• Lead complex initiatives including fine-tuning, distillation and post-training of open-source LLMs on security data.
• Establish standards for context engineering, inference optimization and evaluation as release gates.
• Lead optimization of LLM inference at scale balancing quality, latency and cost.
• Prototype and develop critical model, training and inference code with hands-on activity.
• Mentor and develop Principal, Staff and Senior engineers across Rapid7.

Skills

LLMs

Transformers

Fine-tuning

Distillation

Context engineering

Inference optimization

Python

Distributed training

Open-source models

Education

PhD in CS/ML or equivalent depth

Tools

vLLM

SGLang

TensorRT-LLM

CUDA

DeepSpeed

Job description

Rapid7 is seeking a Senior Principal AI Engineer to set technical direction for LLMs and agentic systems across security products. You will guide model strategy, tuning, and deployment, balancing performance and cost while staying hands-on with challenging problems.

You will mentor engineers, influence product and platform investments, and represent Rapid7’s AI efforts to executives and customers as the AI program scales globally.