Staff AI Engineer – LLM & Agentic Security Systems

mymoose; United States; On-site; USD 180,000 - 260,000; Full time

Job summary

Rapid7 is seeking a Staff AI Engineer to design, build, and ship LLM and agentic AI systems across security products. You will own technical solutions, provide architectural guidance, and mentor engineers while balancing quality, latency and cost in production deployments.

You will work hands-on with transformer internals, fine-tuning, distillation, and evaluation, shaping the AI strategy for Detection and Response and Exposure and Remediation areas.

Qualifications

• 8+ years of software or ML engineering experience
• 2+ years building production LLM or agentic AI systems
• Master's degree preferred or equivalent experience
• Track record delivering scalable AI systems across teams

Responsibilities

• Design, build and ship LLM and agentic AI systems end-to-end
• Lead design reviews and technical roadmaps for AI systems
• Fine-tune and post-train open-weight LLMs for security data
• Optimize inference for quality, latency and cost
• Mentor engineers and partner with product teams

Skills

Production AI systems

Leadership

LLM knowledge

PyTorch

Inference optimization

Context engineering

Python

Mentoring

Education

Master's degree in CS/ML

Tools

PyTorch

vLLM

TensorRT-LLM

DeepSpeed

Job description

Rapid7 is seeking a Staff AI Engineer to design, build, and ship LLM and agentic AI systems across security products. You will own technical solutions, provide architectural guidance, and mentor engineers while balancing quality, latency and cost in production deployments.

You will work hands-on with transformer internals, fine-tuning, distillation, and evaluation, shaping the AI strategy for Detection and Response and Exposure and Remediation areas.