Remote Principal AI Engineer: LLM & Agentic Systems Lead

Rapid7

United States

Remote

USD 221,000 - 299,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Rapid7 is seeking a Principal AI Engineer to define the technical direction for LLMs and agentic AI systems across security products. You will stay hands-on, shaping architecture, training, and inference strategies while mentoring senior engineers and influencing product investments.

You will lead model strategy, tuning, and evaluation to balance accuracy, latency, and cost, enabling secure, scalable AI for Global customers.

Qualifications

  • 12+ years of software or ML engineering experience
  • 2+ years building production LLM or agentic AI systems
  • Strong understanding of transformer architecture and training to inference optimization
  • Experience with distributed training and mixed precision

Responsibilities

  • Define architecture and technical roadmap for LLM and agentic AI systems across Detection/Response and Exposure/Remediation
  • Lead model strategy: frontier vs open-source models; fine-tune or distill
  • Fine-tune, distill and post-train open-source LLMs on security data
  • Set engineering standards for context engineering, inference optimization, evaluation
  • Optimize LLM inference at scale (speculative decoding, KV-cache, batching, quantization)
  • Establish evals as release gate for AI systems
  • Lead design reviews and resolve complex trade-offs
  • Stay hands-on: prototype and build model/training/inference code
  • Mentor Staff and Senior engineers; shape product investments
  • Build cross-functional partnerships across Engineering, Product, and other teams
  • Connect customer needs to technical decisions to deliver measurable outcomes

Skills

Leadership
ML engineering
LLMs
Python
Distributed systems
PyTorch
Inference optimization
Model tuning
Security domain knowledge

Education

PhD in CS/ML or related field

Tools

PyTorch
DeepSpeed
TensorRT-LLM
vLLM
CUDA

Job description

Rapid7 is seeking a Principal AI Engineer to define the technical direction for LLMs and agentic AI systems across security products. You will stay hands-on, shaping architecture, training, and inference strategies while mentoring senior engineers and influencing product investments.

You will lead model strategy, tuning, and evaluation to balance accuracy, latency, and cost, enabling secure, scalable AI for Global customers.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Principal AI Engineer — LLM & Agentic Systems Lead
Senior Principal AI Engineer — LLM & Agentic Systems Lead

Rapid7 • United States

Remote
USD 256,000 - 346,000
Principal AI Engineer: Security LLMs & Agentic Systems
Principal AI Engineer: Security LLMs & Agentic Systems

mymoose • United States

On-site
USD 180,000 - 340,000
Staff AI Engineer: LLM/Agentic AI for Cyber Defense
Staff AI Engineer: LLM/Agentic AI for Cyber Defense

Rapid7 • California

Hybrid
USD 187,000 - 252,000
Principal AI Engineer
Principal AI Engineer

Rapid7 • United States

Remote
USD 221,000 - 299,000
Principal AI Engineer
Principal AI Engineer

mymoose • United States

On-site
USD 180,000 - 340,000
Remote Principal AI Engineer - LLM Systems & Audit Tools
Remote Principal AI Engineer - LLM Systems & Audit Tools

7Seventy • United States

Remote
USD 180,000 - 230,000
Remote Principal AI Engineer | Lead Gen AI & LLM Systems
Remote Principal AI Engineer | Lead Gen AI & LLM Systems

Robotic Technologies Automation • Dallas (TX)

Remote
USD 78,000 - 112,000
Principal AI Engineer
Principal AI Engineer

VERISIGN • Reston (VA)

On-site
USD 180,000 - 260,000
Remote Senior AI Engineer: LLM & Agentic AI Architect
Remote Senior AI Engineer: LLM & Agentic AI Architect

Intive • United States

Remote
USD 130,000 - 180,000
Udemy access
Mentorship program
Learning & Development
+2
Senior Manager - AI Engineering
Senior Manager - AI Engineering

mymoose • Boston (MA)

On-site
GBP 90,000 - 140,000