Staff AI Engineer: LLM & Agentic Security Architect

Divvy Cloud Corp.; California; On-site; USD 187,000 - 252,000; Full time

Job summary

Rapid7’s AI Engineering team builds production‑grade AI powering detection, response and remediation within our security platform. You’ll design and ship LLM and agentic AI systems, guide architecture, and mentor engineers across teams.

You’ll stay hands‑on with model tuning, inference optimization and evaluation, balancing quality, latency and cost to deliver scalable, secure solutions for customers. Lead reviews and partner with Product to align with customer needs.

Qualifications

• 8+ years of software or ML engineering experience including 2+ years building production LLM or agentic AI systems.
• Track record of delivering scalable AI systems used by multiple teams or products.
• Deep understanding of LLMs, transformer architecture, attention, tokenization and encodings.

Responsibilities

• Design, build and ship LLM and agentic AI systems across Rapid7’s security products.
• Lead architecture and technical roadmap for your area.
• Fine‑tune, distill and post‑train open‑source LLMs on security data.
• Improve inference optimization and context management for long‑running workflows.
• Establish eval gates for AI system releases and mentor engineers.

Skills

LLM systems

Mentorship

Architectural design

Inference optimization

PyTorch

Context engineering

Cross‑functional leadership

Communication

Education

Master’s degree in CS/ML/AI or related field

Tools

PyTorch

FSDP/DeepSpeed

vLLM / TensorRT‑LLM

Job description

Rapid7’s AI Engineering team builds production‑grade AI powering detection, response and remediation within our security platform. You’ll design and ship LLM and agentic AI systems, guide architecture, and mentor engineers across teams.

You’ll stay hands‑on with model tuning, inference optimization and evaluation, balancing quality, latency and cost to deliver scalable, secure solutions for customers. Lead reviews and partner with Product to align with customer needs.