Senior Product Manager, Inference Platform (Remote)

Jobgether; United States; Remote; USD 228,000 - 285,000; Full time

Benefits offered by this job

Health coverage

401(k) with employer match

Paid parental leave

Remote work support

Disability and life insurance

Career development

Flexible remote work arrangement

Collaborative, international team

Meaningful impact on AI infrastructure

Job summary

JobGether is seeking a Senior Product Manager for the Inference Platform to own strategy, roadmap, and measurable outcomes for core capabilities. You will coordinate multiple engineering teams focused on APIs, routing, performance, and enterprise enablement, partnering with research to improve scalability and cost efficiency.

You will translate complex technical concepts into practical product decisions, conduct customer research, and shape opportunities from market signals to prioritized

Qualifications

• Experience launching and managing technical platform products from strategy through delivery and adoption.
• Senior-level PM experience leading multiple engineering teams.
• Strong technical understanding of AI inference, model serving, distributed systems, and production infra.
• Ability to analyze technical problems, evaluate trade-offs, and partner with engineers on decisions.
• Experience working with B2B/enterprise customers, especially technical buyers.
• Excellent written and verbal communication for stakeholders across orgs.
• Proven ability to prepare clear PRDs, RFCs, release notes, and technical docs.
• Ability to manage expectations and align cross-functional teams in a fast-moving environment.

Responsibilities

• Own product strategy, roadmap, and outcomes for a core AI inference platform stream.
• Coordinate cross-functional teams on public APIs, routing, performance, reliability, and enterprise enablement.
• Collaborate with engineering and research to improve scalability, reliability, and cost efficiency.
• Translate complex tech improvements into actionable platform capabilities for developers and enterprises.
• Conduct customer research, interviews, and proofs-of-concept with managed enterprise customers.
• Analyze open-source models, inference economics, and hardware trends to spot opportunities.
• Turn market insights into prioritized product initiatives and strategic investments.
• Communicate direction, requirements, trade-offs across engineering, sales, support, and leadership.
• Create PRDs, RFCs, release notes, and docs to support alignment and delivery.
• Adapt priorities as customer needs and tech conditions evolve.

Skills

Senior-level product management

Launch and manage platform products

AI inference, model serving, distrib.

Enterprise/B2B experience

Stakeholder management & communication

PRDs/RFCs/release notes writing

Cross-functional alignment

Ambiguity navigation

Analytical, customer-focused

Fast-moving environment adaptability

Job description

JobGether is seeking a Senior Product Manager for the Inference Platform to own strategy, roadmap, and measurable outcomes for core capabilities. You will coordinate multiple engineering teams focused on APIs, routing, performance, and enterprise enablement, partnering with research to improve scalability and cost efficiency.

You will translate complex technical concepts into practical product decisions, conduct customer research, and shape opportunities from market signals to prioritized