Principal PM, AI Inference Infra & AMG Strategy (Remote)

Scrolllaunch; Northern (KY); Hybrid; USD 150,000 - 190,000; Full time

Job summary

WEKA is seeking a Product Manager to own the roadmap and go-to-market for Augmented Memory Grid (AMG), part of the NeuralMesh platform. This is a deeply technical PM role at the intersection of AI inference infrastructure, high-performance networking, and enterprise storage.

You will work closely with engineering, GPU/inference partners (NVIDIA, hyperscalers, GPU clouds), and large-scale customers running LLM inference to shape AMG's next capabilities.

Qualifications

• Must-have: hands-on product or engineering exp with LLM inference serving (vLLM, Triton, TensorRT-LLM, RAY Serve).
• Understand KV-cache, prefix/context caching, quantization, batching strategies.

Responsibilities

• Own AMG product roadmap: memory offload, memory tiering, and integration with inference engines.
• Collaborate with engineering to trade-off GPU memory, networking, and storage aspects.
• Work with enterprise customers and cloud partners to gather requirements and validate benchmarks.

Skills

Inference depth

Model systems

Networking fluency

Enterprise experience

PM experience

Tools

vLLM

NVIDIA Triton

TensorRT-LLM

Ray Serve

Job description

WEKA is seeking a Product Manager to own the roadmap and go-to-market for Augmented Memory Grid (AMG), part of the NeuralMesh platform. This is a deeply technical PM role at the intersection of AI inference infrastructure, high-performance networking, and enterprise storage.

You will work closely with engineering, GPU/inference partners (NVIDIA, hyperscalers, GPU clouds), and large-scale customers running LLM inference to shape AMG's next capabilities.