Senior Product Manager - Accelerated Compute Memory Systems

Medium; Washington (District of Columbia); Remote; USD 250,000 +; Full time

Job summary

A technology company is seeking an experienced Product Manager to oversee its Large-Scale AI Infrastructure. In this role, you will drive the strategy for the HPC RAG platform and manage product vision while collaborating with various teams to meet milestones. The ideal candidate has significant experience in AI/ML infrastructure and large-scale systems. This position offers a remote-first work environment along with comprehensive health benefits.

Benefits

100% Company paid Health/Dental/Vision benefits

Unlimited PTO

401k

Life Insurance

Short-term and Long-term Disability

Qualifications

• 10+ years in product management, with at least 5 in AI/ML infrastructure.
• Experience building high-performance distributed systems at scale.
• Familiarity with compliance environments and certifications.

Responsibilities

• Define and drive the strategy for Pryon’s HPC RAG platform.
• Own the end-to-end product vision.
• Align roadmap delivery across various teams.

Skills

AI/ML infrastructure

Large-scale distributed systems

High-throughput production environments

Low-latency production

Technical communication

Tools

HPC cluster management software

Slurm

Job description

About Pryon:

We’re a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now we’re building an industry-leading knowledge management and Retrieval-Augmented Generation (RAG) platform. Our proprietary, cutting-edge natural language processing capabilities transform unstructured data into meaningful experiences that increase productivity with unmatched accuracy and speed.

We are seeking a Product Manager for Large-Scale AI Infrastructure to define and drive the strategy for Pryon’s HPC RAG platform. This platform is designed to ingest and index petabyte-scale multimodal data and serve low-latency, high-throughput inference across mission-critical knowledge bases.

The ideal candidate has a proven track record in AI platforms and distributed systems at scale. You’ll be responsible for shaping the product vision, setting performance and compliance targets, and aligning roadmap execution across engineering, infrastructure, and research teams to meet our beta and GA milestones.

In This Role You Will:

• Own the end-to-end product vision for Pryon’s HPC platform across data ingestion, retrieval, inference, compliance, and scalability.
• Translate scale targets (thousands of concurrent requests, billions of documents, and sub-second latency) into actionable product requirements and success metrics.
• Partner with Engineering, Security, Research and Infrastructure teams to design horizontal scalability, multimodal ingestion, and regulatory compliance (FOIA, OIG, CISA).
• Collaborate with federal and enterprise customers to capture requirements for IL5/6 and public-facing deployments.
• Drive roadmap alignment across ingestion, retrieval, ranking, and inference sub-tracks, ensuring delivery against Beta and GA milestones.
• Serve as the internal and external voice of the AI platform, presenting to agency stakeholders, strategic partners, and the Pryon executive team.

What You’ll Need to Be Successful:

• 10+ years in product management, with at least 5 in AI/ML infrastructure or large-scale distributed systems.
• Proven track record building state of the art inference and RAG: direct experience delivering high-performance distributed systems at scale.
• Deep familiarity with RAG architectures, multimodal ingestion, and LLM-backed retrieval.
• Familiarity with HPC cluster management software such as Slurm
• Strong background in high-throughput, low-latency production environments—ideally with petabyte-scale ingestion and real-time inference.
• Understanding of federal compliance environments (audit logging, IL5/6 certifications).
• Ability to balance technical depth with executive-level communication, ensuring teams and stakeholders are aligned.

Benefits for Full Time Employees:

• Remote first organization
• 100% Company paid Health/Dental/Vision benefits for you and your dependents
• Life Insurance, Short-term and Long-term Disability
• 401k
• Unlimited PTO

We are interested in every qualified candidate who is authorized to work in the United States. However, we are not able to sponsor or take over sponsorship of employment visas at this time.

Pryon will not consider race, religion, sex, sexual preference, or national origin in ways that violate the Nation’s civil rights laws.