Staff Product Manager (Runtime Team)

PolyAI

Greater London

Remote

GBP 120,000 - 180,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Employee equity options
Flexible WFH policy
Annual learning and development budget
WFH allowance
Private healthcare & dental
Fertility & family-forming programmes
Sabbatical program

Job summary

PolyAI is seeking a highly technical senior product leader to own the runtime that serves conversations, the inference layer powering models, and the data infrastructure feeding both. This is a deep infrastructure role with direct exposure to latency, cost, and reliability tradeoffs at scale.

You will set strategy for areas other teams build on top of, working closely with engineering leadership rather than through them.

Qualifications

  • 6+ years of product management or related technical experience owning infrastructure, ML/data platform, or runtime-adjacent products.
  • Bachelor’s degree (or foreign equivalent) in Computer Science, Engineering, Statistics, or AI/ML related field, or equivalent industry experience.
  • Strong working knowledge of inference and model-serving infrastructure, including latency budgets and hosting tradeoffs.
  • Comfortable owning a roadmap with no end-user surface and arguing for infra investment on its own terms.
  • Experience with data platform decisions: residency/compliance and data centralization vs fragmentation.
  • Demonstrated senior leadership: setting direction and mentoring junior PMs.
  • Entrepreneurial mindset in a high-growth environment and strong cross-functional communication.
  • Ability to translate infra tradeoffs for non-technical stakeholders.

Responsibilities

  • Own product strategy for runtime, inference, and data platform.
  • Set direction on build-vs-buy and self-host vs managed serving tradeoffs.
  • Build and own the evaluation framework for runtime performance and cost.
  • Coordinate a technical roadmap with infrastructure leadership.
  • Oversee data flows, residency, retention, and access-control decisions.
  • Translate capacity and data constraints into business decisions.
  • Lead cross-functional teams of engineers, data scientists, and infra specialists.
  • Represent the area in executive-level discussions on cost and risk.

Skills

Infrastructure ownership
ML/data platform
Runtime products
Cross-functional leadership

Education

Bachelor’s degree in CS/Engineering/Statistics or AI/ML or distributed systems

Tools

Latency budgets
GPU/node economics
Self-hosted vs managed serving

Job description

PolyAI is the Agentic Dialog Platform for building the conversational enterprise, used to build, run, govern, and improve dialog agents at scale.

PolyAI automates customer service through lifelike voice assistants that let customers lead a conversation. Our voice assistants make it possible for businesses to deliver outstanding customer service that rivals their human agents.

Our customers, which include the world's leading logos, are expanding how they use our platform, driving automation of critical customer service operations and integrating PolyAI into their daily customer service workflows.

We're looking for a highly technical, senior product leader to own the platform underneath everything our agents do: the runtime that serves conversations in production, the inference layer that powers our models, and the data infrastructure that feeds both. This is a deep infrastructure role with direct exposure to latency, cost, and reliability tradeoffs at scale, not a roadmap-and-backlog role. You'll set strategy for areas other teams build on top of, working closely with engineering leadership rather than through them

RESPONSIBILITIES
  • Own the product strategy for runtime (how conversations get served in production), inference (how our models are hosted and served, including self-hosted and third-party paths), and the data platform (how conversation and model data moves, is stored, and is queried across the business)
  • Set direction on build-vs-buy and self-host-vs-managed tradeoffs for model serving, including evaluating cost, latency, and scaling implications of infrastructure decisions before they’re made, not after
  • Build and own the evaluation framework for how we measure runtime and inference performance in production (latency, throughput, cost per minute/token, failure rates), and drive continuous improvement off that data
  • Partner directly with infrastructure and platform engineering leadership to sequence a technical roadmap that often has no visible customer-facing surface, and defend its priority against features that do
  • Own how conversation data flows into and out of the platform, including data residency, retention, and access-control tradeoffs that affect what the business can build or sell
  • Translate ambiguous technical constraints (capacity limits, model failure modes, data gaps) into decisions the rest of the business can plan around
  • Lead and influence a cross-functional group of engineers, data scientists, and infrastructure specialists without formal authority over them
  • Represent this area in exec-level conversations on cost, capacity planning, and platform risk
REQUIRED QUALIFICATIONS
  • 6+ years of product management or related technical experience, including a strong track record owning infrastructure, ML/data platform, or runtime-adjacent products, not just user-facing features
  • Bachelor’s degree (or foreign equivalent) in Computer Science, Engineering, Statistics, or a related field involving AI/ML or distributed systems, or equivalent industry experience
  • Strong working knowledge of how inference and model-serving infrastructure actually works: latency budgets, GPU/node economics, self-hosted vs. managed serving tradeoffs
  • Comfortable owning a roadmap with no end-user-visible surface, and able to make the business case for infrastructure investment on its own terms
  • Experience with data platform decisions: pipelines, residency/compliance constraints, and tradeoffs between centralizing vs. fragmenting data by region or product line
  • Demonstrated ability to operate at a senior level: setting direction, not just executing against someone else’s plan, and mentoring more junior PMs
  • Entrepreneurial mindset, comfortable with ambiguity and fast iteration in a high-growth environment
  • Exceptional cross-functional communication skills, particularly translating infrastructure tradeoffs for non-technical stakeholders

Compensation

We offer a competitive base salary, shaped by your experience and location, plus equity — so you share in the value you help create.

Participation in the company's employee share options plan

Tenure-Based PTO: You will receive 25 holidays when you join and will gain an additional 1 day after 2 years of service, then 1 day each year until capped at 32 holidays

Flexible working from home policy

Work from outside of the UK for up to 6 months each year

TELUS Health EAP 24/7 - offers you and your chosen family confidential, judgment-free support for any work, health, or life challenge

Annual learning and development allowance

We're all about making WFH work for you - that's why we offer a one-off WFH allowance when you join. Offering perks like noise-cancelling headphones or a comfortable desk chair to boost your comfort and focus!

Company-funded fertility and family-forming programmes

Private healthcare and dental cover, discounts on gym members and relaxation apps, and access to a range of mental health programs

Sabbatical Program: 5-week paid sabbatical available after 5 years of employment

At PolyAI, we take great pride in our values - they guide everything we do.

Our core values are:

Only the best We expect the best from our people, we hire people that expect the best from themselves, and we nurture this drive for excellence.

Ownership We care deeply about what we do. We take ownership of our initiatives, decisions and outcomes.

Relentlessly improve We demand more from ourselves and are always evolving. Continuous, obsessive improvement is the only way we will transform the world of conversational AI.

Bias for action Our world moves quickly and so do we. We take calculated risks and we deliver impact fast.

Disagree and commit We are all working toward the same goal. If we don't agree with something, we work hard to understand it and when a decision is made, we accept it and give it our all.

Build for people We want the world to enjoy the experiences they have with us. We are building for a future that prefers automation.

PolyAI is proud to be an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All employment decisions at PolyAI will be based on the business needs without attention to ethnicity, religion, sexual orientation, gender identity, family or parental status, national origin, neurodiversity status or disability status.

Kindly find the Privacy Notice for our recruitment process by following the link here . This document provides important information regarding how we handle your personal data throughout the recruitment journey.

Will you now or in the future require any visa or sponsorship support to work in the United Kingdom?

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Product Manager (Runtime Team)
Staff Product Manager (Runtime Team)

Georgian • Greater London

Hybrid
GBP 120,000 - 180,000
Participation in the company’s share/​
Flexible working from home policy
Work from outside of the UK for up to
+1
Staff Product Manager (Runtime Team) London, United Kingdom
Staff Product Manager (Runtime Team) London, United Kingdom

PolyAI Ltd. • Greater London

Hybrid
GBP 110,000 - 150,000
Employee stock options
25 holidays when you join + increases
WFH policy
+6
Staff Product Manager (Runtime Team)
Staff Product Manager (Runtime Team)

PolyAI • City Of London

Hybrid
GBP 120,000 - 180,000
Employee share options
WFH policy and remote work flexibility
6 months international remote per year
Senior Software Engineer - Runtime Team
Senior Software Engineer - Runtime Team

Teli Labs • Greater London

On-site
GBP 90,000 - 130,000
Employee share options plan
25 holidays + yearly increment to 32
WFH policy
+6
Senior Software Engineer - Runtime Team
Senior Software Engineer - Runtime Team

PolyAI • Greater London

Hybrid
GBP 90,000 - 150,000
Share options
WFH policy
Annual learning allowance
+1
Senior Software Engineer - Runtime Team (London based)
Senior Software Engineer - Runtime Team (London based)

EngRadar • Greater London

On-site
GBP 90,000 - 120,000
Employee share options
25 holidays on joining + additional 1/
WFH policy
+10
Deployment Strategist (Must be in U.K.)
Deployment Strategist (Must be in U.K.)

PolyAI • Greater London

Hybrid
GBP 70,000 - 120,000
Employee share options plan
WFH allowance
Annual learning and development budget
+1
Forward Deployed Engineer, Agentic AI
Forward Deployed Engineer, Agentic AI

FDE Times • United Kingdom

Remote
GBP 120,000 - 180,000
Share options plan
25 holidays + 1 year increase
WFH policy and mobility
Forward Deployed Engineer, Agentic AI United Kingdom
Forward Deployed Engineer, Agentic AI United Kingdom

PolyAI Ltd. • Greater London

Remote
GBP 90,000 - 130,000
Equity
25 holidays + 1 after 2 years + cap at
WFH policy
+4
Forward Deployed Engineer, Agentic AI
Forward Deployed Engineer, Agentic AI

PolyAI • Greater London

Hybrid
GBP 90,000 - 150,000
Private healthcare and dental cover
WFH allowance
Sabbatical program
+1