Senior Technical Product Manager — AI Inference & Software

Positron Corporation

United States

Remote

USD 200,000 - 350,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
Life & disability coverage
Remote work setup
Unlimited PTO
13 holidays
401(k) with matching
Equity

Job summary

Positron AI is seeking aTechnical Product Manager to own AI inference planning, translating model and system advances into concrete, well-scoped requirements for the inference software stack. You will bridge engineering, GTM, and ecosystem partners, tracking the frontier and turning insights into engineering tasks.

You will leverage agentic AI daily to refine roadmaps, drive cross-functional collaboration, and shape a high-performance serving and managed-service strategy in a fast-evolving AI

Qualifications

  • 10+ years across ML systems or serving-stack engineering with performance trade-offs.
  • Deep expertise in transformer internals at operator level and hardware implications.
  • Hands-on experience with production inference serving at scale and observability.
  • Fluency with open-source inference ecosystems and model deployment cycles.
  • Strong skills in performance analysis, benchmarking, and math justification.
  • Experience in competitive landscaping of inference providers and stacks.
  • Ability to learn quickly across full stack from models to fleet-scale serving.
  • Excellent communication and leadership in uncertain environments.
  • Daily use of agentic AI for research, analysis, and drafting requirements.

Responsibilities

  • Lead all aspects of AI inference and software product planning.
  • Write requirements for the inference software stack across models, numerics, and serving features.
  • Partner with engineering and GTM to deliver a clear, defensible roadmap.
  • Develop scope and feasibility frameworks translating model innovations into engineering tasks.
  • Track the model frontier and feed market needs back into the roadmap.
  • Engage ecosystem partners to align technology roadmaps with product goals.
  • Define software lifecycle, versions, releases, and deprecation policies.
  • Ensure thorough internal and customer-facing documentation.
  • Automate planning processes using agentic AI.

Skills

ML systems
Inference serving
Transformer internals
Open-source runtimes
Model governance
System performance analysis
Communication
Decision history
Agentic AI workflows

Tools

vLLM
SGLang-class runtimes
Inference runtimes

Job description

Positron AI is seeking aTechnical Product Manager to own AI inference planning, translating model and system advances into concrete, well-scoped requirements for the inference software stack. You will bridge engineering, GTM, and ecosystem partners, tracking the frontier and turning insights into engineering tasks.

You will leverage agentic AI daily to refine roadmaps, drive cross-functional collaboration, and shape a high-performance serving and managed-service strategy in a fast-evolving AI

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead, Silicon & Systems for AI Inference Hardware
Lead, Silicon & Systems for AI Inference Hardware

Positron • United States

Remote
USD 200,000 - 350,000
Health insurance
Life & disability coverage
Remote-first culture
+1
AI Inference Product Manager — Serverless & Auto-Scaling
AI Inference Product Manager — Serverless & Auto-Scaling

AIToolboard • Alexandria (VA)

Hybrid
USD 140,000 - 190,000
Senior Product Manager — AI Inference Platform
Senior Product Manager — AI Inference Platform

NVIDIA Corporation (old) • Santa Clara (CA)

Hybrid
USD 208,000 - 380,000
Equity
Benefits
Technical Product Manager, AI Inference & Software
Technical Product Manager, AI Inference & Software

Positron Corporation • United States

Remote
USD 200,000 - 350,000
Health insurance
Life & disability coverage
Remote work setup
+4
Technical Program Manager — AI Inference Platform
Technical Program Manager — AI Inference Platform

Baseten • United States

Remote
USD 140,000 - 170,000
Senior Product Manager – AI Infrastructure & Scale
Senior Product Manager – AI Infrastructure & Scale

Baseten • United States

Remote
USD 150,000 - 190,000
Senior Director, AI Inference Platforms
Senior Director, AI Inference Platforms

Tensordyne • Sunnyvale (CA)

Remote
USD 250,000 - 450,000
Comprehensive benefits
Flexible spending options
Recognition programs
Senior Technical AI Product Manager
Senior Technical AI Product Manager

Hidden Jobs • United States

Remote
USD 140,000 - 190,000
Director of AI Inference Platform Strategy
Director of AI Inference Platform Strategy

Tensordyne • United States

Remote
USD 180,000 - 280,000
Comprehensive benefits
Competitive compensation
Flexible spending options
+1
Senior AI Inference Platform Lead
Senior AI Inference Platform Lead

NVIDIA • Santa Clara (CA)

On-site
USD 208,000 - 328,000
Equity
Benefits package