Staff Product Manager, AI Runtime & Data Platform

Georgian; Greater London; Hybrid; GBP 120,000 - 180,000; Full time

Benefits offered by this job

Participation in the company’s share/​

Flexible working from home policy

Work from outside of the UK for up to

Private healthcare

Job summary

PolyAI in London is seeking a highly technical senior product leader to own the platform underpinning our conversations: the runtime that serves conversations in production, the inference layer powering our models, and the data infrastructure that feeds both. This is an infrastructure-focused role with direct exposure to latency, cost, and reliability tradeoffs at scale.

You’ll set strategy for areas other teams build on top of, working closely with engineering leadership rather than through

Qualifications

• 6+ years of product management or related technical experience owning infrastructure, ML/data platform, or runtime-adjacent products.
• Bachelor’s degree (or foreign equivalent) in Computer Science, Engineering, Statistics, or a related field involving AI/ML or distributed systems, or equivalent industry experience.
• Strong working knowledge of how inference and model-serving infrastructure actually works: latency budgets, GPU/node economics, self-hosted vs. managed serving tradeoffs.
• Comfortable owning a roadmap with no end-user-visible surface, and able to make the business case for infrastructure investment on its own terms.
• Experience with data platform decisions: pipelines, residency/compliance constraints, and tradeoffs between centralizing vs. fragmenting data by region or product line.
• Demonstrated ability to operate at a senior level: setting direction, not just executing against someone else’s plan, and mentoring more junior PMs.

Responsibilities

• Own the product strategy for runtime, inference, and the data platform.
• Set direction on build-vs-buy and self-host-vs-managed tradeoffs for model serving.
• Build and own the evaluation framework for runtime and inference performance in production.
• Partner with infrastructure and platform engineering leadership to sequence a technical roadmap.
• Own how conversation data flows into and out of the platform, including data residency and access-control tradeoffs.
• Translate ambiguous technical constraints into decisions the business can plan around.
• Lead and influence a cross-functional group of engineers, data scientists, and infrastructure specialists.
• Represent this area in exec-level conversations on cost, capacity planning, and platform risk.

Skills

Infra product ownership

ML/data platform

Runtime/production systems

Cross-functional leadership

Strategic thinking

Executive communication

Education

Bachelor's degree in CS/Engineering/Statistics or AI/ML

Job description

PolyAI in London is seeking a highly technical senior product leader to own the platform underpinning our conversations: the runtime that serves conversations in production, the inference layer powering our models, and the data infrastructure that feeds both. This is an infrastructure-focused role with direct exposure to latency, cost, and reliability tradeoffs at scale.

You’ll set strategy for areas other teams build on top of, working closely with engineering leadership rather than through