Principal AI Engineer: Security LLMs & Agentic Systems

mymoose

United States

On-site

USD 180,000 - 340,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Rapid7 is expanding its AI Engineering leadership to shape the next generation of AI across security products. You will define architecture for LLM and agentic systems, guide model strategy, and mentor engineers to build scalable, production-grade AI that delivers real impact for global customers.

You will stay hands-on, prototype critical components, and help establish standards for context management, inference optimization, and evaluation across teams.

Qualifications

  • 12+ years of software or ML engineering experience, including production LLM or agentic AI systems.
  • Strong track record influencing multiple teams with technical leadership and standards.
  • Deep understanding of transformer architecture and model serving from scratch.

Responsibilities

  • Define architecture and roadmap for LLM and agentic AI across security products.
  • Lead model strategy: frontier vs open-source, fine-tuning, distillation, post-training.
  • Fine-tune/open-source LLMs on security data from data curation to deployment.
  • Set engineering standards for context engineering, inference, and eval across teams.
  • Optimize LLM inference at scale with techniques like speculative decoding and KV-cache.
  • Establish evaluation gates for releases and lead design reviews.
  • Hands-on prototype and build model, training, and inference code.

Skills

LLMs fundamentals
PyTorch
Distributed systems
Python
Mentoring/leadership
Transformer architectures
Model fine-tuning
Inference optimization

Education

PhD in CS/ML preferred

Tools

PyTorch (deep)
FSDP
DeepSpeed
TensorRT-LLM
vLLM

Job description

Rapid7 is expanding its AI Engineering leadership to shape the next generation of AI across security products. You will define architecture for LLM and agentic systems, guide model strategy, and mentor engineers to build scalable, production-grade AI that delivers real impact for global customers.

You will stay hands-on, prototype critical components, and help establish standards for context management, inference optimization, and evaluation across teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Principal AI Engineer — LLM & Agentic Systems Lead
Senior Principal AI Engineer — LLM & Agentic Systems Lead

Rapid7 • United States

Remote
USD 256,000 - 346,000
Remote Principal AI Engineer: LLM & Agentic Systems Lead
Remote Principal AI Engineer: LLM & Agentic Systems Lead

Rapid7 • United States

Remote
USD 221,000 - 299,000
Staff AI Engineer: LLM/Agentic AI for Cyber Defense
Staff AI Engineer: LLM/Agentic AI for Cyber Defense

Rapid7 • California

Hybrid
USD 187,000 - 252,000
Senior Manager - AI Engineering
Senior Manager - AI Engineering

mymoose • Boston (MA)

On-site
GBP 90,000 - 140,000
Principal AI Engineer
Principal AI Engineer

mymoose • United States

On-site
USD 180,000 - 340,000
Senior AI Engineering Manager — Scale Production AI
Senior AI Engineering Manager — Scale Production AI

mymoose • Boston (MA)

On-site
GBP 90,000 - 140,000
Principal AI Engineer
Principal AI Engineer

Rapid7 • United States

Remote
USD 221,000 - 299,000
Remote AI Security Engineer - LLM/ML
Remote AI Security Engineer - LLM/ML

IVANS Insurance Solutions • United States

Remote
USD 80,000 - 120,000
Medical, Dental, Vision Coverage
Holiday and Vacation Time
Health & Wellness Days
+1
Senior AI Security Engineer - LLM/Agentic - Remote
Senior AI Security Engineer - LLM/Agentic - Remote

Affirm, Inc. • Boston (MA)

Remote
USD 204,000 - 264,000
100% subsidized medical coverage
Tech stipends
Flexible time off
+1
Principal AI Security Engineer
Principal AI Security Engineer

zipcolimited • United States

Remote
USD 203,000 - 254,000
Remote-first (US)
Office in Manhattan (optional)