Senior Principal AI Engineer — LLM & Agentic Systems Lead

Rapid7

United States

Remote

USD 256,000 - 346,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Rapid7 is seeking a Senior Principal AI Engineer to define and steer the technical direction of LLMs and agentic AI across our security products. You will stay hands-on, guide architectural decisions and balance efforts across training, inference, and deployment to maximize value for global customers.

You’ll mentor senior engineers, influence product strategy, and partner with executives to drive strategic investments in AI platforms that scale securely and efficiently.

Qualifications

  • 14+ years of software or ML engineering experience with 2+ years building production LLM/agentic AI systems.
  • Proven record of building scalable AI platforms adopted across products and teams.
  • Deep knowledge of transformer architectures, training and serving, with hands-on model work.

Responsibilities

  • Set the AI technical vision, architecture and multi-year roadmap for LLM and agentic systems across products.
  • Define company-wide model strategy including frontier vs open-source choices and fine-tuning approaches.
  • Lead complex initiatives: fine-tuning, distillation, post-training of open-source LLMs on security data.
  • Establish standards for context engineering, inference optimization and evaluation gates.

Skills

LLM expertise
Architectural leadership
Python
Distributed training
Inference optimization
Model fine-tuning
Evaluation benchmarks

Education

PhD in Computer Science, ML or AI

Tools

PyTorch
DeepSpeed
CUDA
TensorRT

Job description

Rapid7 is seeking a Senior Principal AI Engineer to define and steer the technical direction of LLMs and agentic AI across our security products. You will stay hands-on, guide architectural decisions and balance efforts across training, inference, and deployment to maximize value for global customers.

You’ll mentor senior engineers, influence product strategy, and partner with executives to drive strategic investments in AI platforms that scale securely and efficiently.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Principal AI Engineer: LLM & Agentic Systems Lead
Remote Principal AI Engineer: LLM & Agentic Systems Lead

Rapid7 • United States

Remote
USD 221,000 - 299,000
Principal AI Engineer: Security LLMs & Agentic Systems
Principal AI Engineer: Security LLMs & Agentic Systems

mymoose • United States

On-site
USD 180,000 - 340,000
Staff AI Engineer: LLM/Agentic AI for Cyber Defense
Staff AI Engineer: LLM/Agentic AI for Cyber Defense

Rapid7 • California

Hybrid
USD 187,000 - 252,000
Senior AI Engineering Manager — Scale Production AI
Senior AI Engineering Manager — Scale Production AI

mymoose • Boston (MA)

On-site
GBP 90,000 - 140,000
Principal AI Engineer
Principal AI Engineer

Rapid7 • United States

Remote
USD 221,000 - 299,000
Senior Manager - AI Engineering
Senior Manager - AI Engineering

mymoose • Boston (MA)

On-site
GBP 90,000 - 140,000
Principal AI Engineer
Principal AI Engineer

mymoose • United States

On-site
USD 180,000 - 340,000
Principal AI Engineer: LLMs & Agentic Systems Lead
Principal AI Engineer: LLMs & Agentic Systems Lead

FactSet • Norwalk (CT)

On-site
USD 180,000 - 235,000
Health insurance
Employee stock purchase program (edic)
Flexible work accommodations
Senior AI Architect — Agentic LLM Systems Leader
Senior AI Architect — Agentic LLM Systems Leader

Lendistry • Dallas (TX)

On-site
USD 111,000 - 185,000
Medical, Dental, Vision Insurance
Paid Time Off
Birthday Day Off
+3
Remote Senior AI Engineer: LLM & Agentic AI Architect
Remote Senior AI Engineer: LLM & Agentic AI Architect

Intive • United States

Remote
USD 130,000 - 180,000
Udemy access
Mentorship program
Learning & Development
+2