Chief AI Architect for LLM & Agentic Systems

Divvy Cloud Corp.; California; On-site; USD 274,000 - 371,000; Full time

Job summary

Rapid7’s AI Engineering team seeks a Distinguished AI Engineer to set multi-year AI tech strategy for our security platform, leading LLM and agentic AI initiatives and guiding investments across Detection, Response and Remediation.

You will mentor senior engineers, shape standards for responsible-AI, evaluate new models, and partner with executives to align AI with product and customer needs, balancing performance, cost and risk across AWS and production systems.

Qualifications

• 16+ years of software or ML engineering experience, with 2+ years leading production LLM or agentic AI projects.
• Track record defining technical strategy and platforms with company-wide impact through leadership and standards.
• Authoritative expertise in LLMs and AI systems, including transformer training, evaluation and inference at scale.
• Broad technical breadth across predictive AI, classical ML, distributed systems and data platforms.
• Experience shaping evaluation strategy, safety and responsible‑AI practices for LLM and agent systems.
• Experience scaling AI workloads in production, ideally on AWS.
• Ability to communicate a compelling technical vision and influence senior leadership.

Responsibilities

• Define the AI technology vision, architecture strategy and multi-year roadmap across Detection, Response and Remediation.
• Shape investment and model strategy, including build vs buy vs partner decisions.
• Sponsor high-risk AI initiatives and unblock hard technical problems.
• Establish engineering, evaluation and responsible‑AI standards across AI systems.
• Partner with executives to align AI strategy with business and product directions.
• Mentor and develop senior engineers and build AI leadership capability.
• Represent Rapid7 as a voice in AI and security with customers and partners.

Skills

LLMs & agentic AI

Production ML systems

Transformer architecture

AWS & cloud infra

Strategic leadership

Mentoring engineers

Education

PhD in CS/ML/AI or equivalent depth

Tools

Open-source ML frameworks

Job description

Rapid7’s AI Engineering team seeks a Distinguished AI Engineer to set multi-year AI tech strategy for our security platform, leading LLM and agentic AI initiatives and guiding investments across Detection, Response and Remediation.

You will mentor senior engineers, shape standards for responsible-AI, evaluate new models, and partner with executives to align AI with product and customer needs, balancing performance, cost and risk across AWS and production systems.