Senior Product Manager - Inference Platform

Jobgether; Oregon; Hybrid; USD 228,000 - 285,000; Full time

Benefits offered by this job

Competitive base salary

Comprehensive health coverage

Retirement savings with employer match

Paid parental leave

Remote work support

Insurance protection

Career development

Flexibility and ownership

Collaborative culture

Meaningful impact

Job summary

Jobgether in the United States is seeking a Senior Product Manager for an AI inference platform. You will own the strategy, roadmap, and outcomes for a core product stream, collaborating with engineering, research, and enterprise customers to drive adoption.

The role emphasizes scalability, cost efficiency, and enterprise enablement, with a remote work model and significant ownership in a fast-moving AI infrastructure context.

Qualifications

• Demonstrated experience launching and managing technical platform products from strategy through delivery and adoption.
• Senior-level product management experience with the ability to lead initiatives spanning multiple engineering teams.
• Strong technical understanding of AI inference, including model serving, distributed systems, and production infrastructure.
• Ability to independently analyze technical problems, evaluate trade-offs, and develop informed product decisions in close collaboration with engineers.
• Experience working with B2B or enterprise customers, particularly technical buyers.
• Excellent communication and stakeholder management skills across engineering, research, sales, support, and leadership.
• Strong written communication skills, including experience preparing clear PRDs, RFCs, release notes, and technical product documentation.
• Ability to manage expectations, prioritize competing needs, and maintain alignment across cross-functional teams.
• Comfort working in a fast-moving environment where product scope, technology, and customer requirements can change quickly.
• Strong analytical thinking and a customer-focused approach to product development.

Responsibilities

• Own the product strategy, roadmap, and measurable outcomes for a core stream of the AI inference platform.
• Coordinate and align multiple cross-functional engineering teams working on public APIs, request routing, performance optimization, reliability, and enterprise enablement.
• Partner with engineering and research teams to improve inference scalability, reliability, and cost efficiency.
• Translate complex technical improvements into dependable platform capabilities that deliver tangible value to developers and enterprise customers.
• Conduct customer research, interviews, and hands-on proofs of concept, with particular attention to managed enterprise customers.
• Analyze emerging open-source models, inference economics, hardware developments, and real-world AI adoption patterns to identify product opportunities.
• Turn market insights and customer feedback into prioritized product initiatives and strategic investment decisions.
• Communicate product direction, requirements, trade-offs, and expectations effectively across engineering, research, sales, support, and leadership.
• Develop clear product requirements documents (PRDs), request for comments (RFCs), release notes, and other documentation to support alignment and delivery.
• Adapt product priorities and execution plans as customer requirements, technologies, and market conditions evolve.

Skills

Technical product management

Cross-functional leadership

AI inference knowledge

Stakeholder management

PRD RFC documentation

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Product Manager - Inference Platform based in the United States.Take ownership of a core product stream within a high-performance AI inference platform designed to make large-scale AI workloads more efficient, reliable, and accessible. In this role, you will shape product strategy and roadmaps, guide execution across multiple engineering teams, and drive platform capabilities from conception through launch and adoption. You will work at the intersection of AI infrastructure, distributed systems, and enterprise software, translating complex technical challenges into customer-focused solutions. By collaborating closely with engineering, research, and enterprise customers, you will help optimize inference performance, scalability, and cost efficiency. You will also monitor emerging models, hardware, and market trends to identify opportunities for innovation. This remote opportunity offers significant ownership, technical depth, and the chance to influence the infrastructure powering the next generation of AI applications.

Accountabilities:

• Own the product strategy, roadmap, and measurable outcomes for a core stream of the AI inference platform.
• Coordinate and align multiple cross-functional engineering teams working on public APIs, request routing, performance optimization, reliability, and enterprise enablement.
• Partner with engineering and research teams to improve inference scalability, reliability, and cost efficiency.
• Translate complex technical improvements into dependable platform capabilities that deliver tangible value to developers and enterprise customers.
• Conduct customer research, interviews, and hands-on proofs of concept, with particular attention to managed enterprise customers.
• Analyze emerging open-source models, inference economics, hardware developments, and real-world AI adoption patterns to identify product opportunities.
• Turn market insights and customer feedback into prioritized product initiatives and strategic investment decisions.
• Communicate product direction, requirements, trade-offs, and expectations effectively across engineering, research, sales, support, and leadership.
• Develop clear product requirements documents (PRDs), request for comments (RFCs), release notes, and other documentation to support alignment and delivery.
• Adapt product priorities and execution plans as customer requirements, technologies, and market conditions evolve.

Requirements:

• Demonstrated experience launching and managing technical platform products from strategy through delivery and adoption.
• Senior-level product management experience with the ability to lead initiatives spanning multiple engineering teams.
• Strong technical understanding of AI inference, including model serving, distributed systems, and production infrastructure.
• Ability to independently analyze technical problems, evaluate trade-offs, and develop informed product decisions in close collaboration with engineers.
• Experience working with B2B or enterprise customers, particularly technical buyers.
• Excellent communication and stakeholder management skills across engineering, research, sales, support, and leadership.
• Strong written communication skills, including experience preparing clear PRDs, RFCs, release notes, and technical product documentation.
• Ability to manage expectations, prioritize competing needs, and maintain alignment across cross-functional teams.
• Comfort working in a fast-moving environment where product scope, technology, and customer requirements can change quickly.
• Strong analytical thinking and a customer-focused approach to product development.

Additional experience that would be an advantage:

• Experience with model post-training, including training draft models.
• Experience establishing and managing third-party technical partnerships.

Benefits:

• Competitive base salary: Annual compensation ranging from $228,000 to $285,000 , depending on experience, skills, qualifications, hiring level, and geographic location.
• Comprehensive health coverage: Medical, dental, and vision insurance fully paid by the employer for employees and their families.
• Retirement savings: 401(k) plan with an employer match of up to 4%, with immediate vesting.
• Paid parental leave: 20 weeks for primary caregivers and 12 weeks for secondary caregivers.
• Remote work support: Monthly reimbursement of up to $85 for mobile and internet expenses.
• Insurance protection: Employer-paid short-term disability, long-term disability, and life insurance coverage.
• Career development: Opportunities for professional growth, continuous learning, and skill development.
• Flexibility and ownership: A remote working arrangement that encourages autonomy and accountability.
• Collaborative culture: Work alongside talented international teams in an innovative, fast-moving environment.
• Meaningful impact: Contribute to advanced AI infrastructure and help shape the future of large-scale AI applications.