Staff AI Engineer: LLM/Agentic AI for Cyber Defense

Rapid7

California

Hybrid

USD 187,000 - 252,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Rapid7 is seeking a Staff AI Engineer to design, build and ship LLM and agentic AI systems across security products. You’ll own end-to-end technical solutions, balancing model choices, inference latency and cost, and stay hands-on with hard problems.

You’ll mentor engineers, influence cross-team alignment with Product and Platform teams, and help translate customer needs into scalable AI solutions that enhance our security portfolio.

Qualifications

  • 8+ years of software or ML engineering experience including 2+ years building production LLM or agentic AI systems.
  • Proven track record leading delivery of scalable AI systems used across teams or products.
  • Deep understanding of LLMs: transformers, attention, tokenization, encodings.
  • Advanced PyTorch skills with training loops and distributed training.
  • Hands-on fine-tuning and post-training of open-weight LLMs (LoRA/QLoRA) and distillation.
  • Experience with context engineering and evaluation benchmarks for LLM/agent systems.
  • Strong inference optimization and scale-ready serving (vLLM, TensorRT-LLM).
  • Strong Python fundamentals and mix of ML, classical ML and distributed systems knowledge.
  • Ability to lead projects, mentor teammates, and manage risks.

Responsibilities

  • Lead design and architecture of LLM and agentic AI systems across products.
  • Define model strategy: frontier vs open-source, fine-tuning vs post-training.
  • Fine-tune, distill and post-train open-weight LLMs on security data.
  • Improve engineering practices for context engineering and inference optimization.
  • Establish evals as release gates for AI systems.
  • Lead design reviews and resolve complex trade-offs.
  • Prototype and implement model training and inference code.
  • Mentor engineers and align solutions with customer needs.

Skills

LLM systems
Agentic AI
Transformer basics
PyTorch
LoRA
QLoRA
Distillation
Context engineering
Inference optimization
Distributed training
Python

Education

Master’s degree in Computer Science / ML / AI or related field

Tools

vLLM
SGLang
TensorRT-LLM
DeepSpeed

Job description

Rapid7 is seeking a Staff AI Engineer to design, build and ship LLM and agentic AI systems across security products. You’ll own end-to-end technical solutions, balancing model choices, inference latency and cost, and stay hands-on with hard problems.

You’ll mentor engineers, influence cross-team alignment with Product and Platform teams, and help translate customer needs into scalable AI solutions that enhance our security portfolio.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal AI Engineer: Security LLMs & Agentic Systems
Principal AI Engineer: Security LLMs & Agentic Systems

mymoose • United States

On-site
USD 180,000 - 340,000
Remote Principal AI Engineer: LLM & Agentic Systems Lead
Remote Principal AI Engineer: LLM & Agentic Systems Lead

Rapid7 • United States

Remote
USD 221,000 - 299,000
Senior Principal AI Engineer — LLM & Agentic Systems Lead
Senior Principal AI Engineer — LLM & Agentic Systems Lead

Rapid7 • United States

Remote
USD 256,000 - 346,000
Staff AI Engineer
Staff AI Engineer

Rapid7 • California

Hybrid
USD 187,000 - 252,000
Senior Manager - AI Engineering
Senior Manager - AI Engineering

mymoose • Boston (MA)

On-site
GBP 90,000 - 140,000
Senior AI Security Engineer - LLM/Agentic - Remote
Senior AI Security Engineer - LLM/Agentic - Remote

Affirm, Inc. • Boston (MA)

Remote
USD 204,000 - 264,000
100% subsidized medical coverage
Tech stipends
Flexible time off
+1
Staff AI Security Engineer — Enterprise LLM Security (Remote)
Staff AI Security Engineer — Enterprise LLM Security (Remote)

Society for AI Security • United States

Remote
USD 204,000 - 290,000
Remote-friendly
Medical coverage for you and dependets
Staff Applied AI Engineer — Build Enterprise LLMs (Remote)
Staff Applied AI Engineer — Build Enterprise LLMs (Remote)

People In AI • United States

Hybrid
USD 250,000 - 300,000
Principal AI Engineer
Principal AI Engineer

mymoose • United States

On-site
USD 180,000 - 340,000
Remote AI Security Engineer - LLM/ML
Remote AI Security Engineer - LLM/ML

IVANS Insurance Solutions • United States

Remote
USD 80,000 - 120,000
Medical, Dental, Vision Coverage
Holiday and Vacation Time
Health & Wellness Days
+1