Staff Product Manager (Runtime Team)

PolyAI

London (KY)

Hybrid

USD 185,000 - 265,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Share options
25 holidays + growth days
Flexible WFH policy
Work from outside the UK up to 6M
Health & wellbeing programs
Learning & development allowance
Bike2Work scheme
Parental leave
Fertility & family-forming programmes
Sabbatical after 5 years

Job summary

PolyAI is seeking a senior product leader to own the platform underpinning conversations—runtime serving, model hosting, and data infrastructure. This is a deep, infra-heavy role with direct exposure to latency, cost, and reliability tradeoffs at scale.

You will set strategy with engineering leadership, drive a technical roadmap, and mentor senior PMs while aligning cross-functional teams toward scalable, secure data flows and platform reliability.

Qualifications

  • 6+ years of product management or related technical experience in infrastructure, ML/data platforms, or runtime-adjacent products.
  • Bachelor’s degree or foreign equivalent in CS/Engineering/Stats or related field with AI/ML or distributed systems relevance.
  • Strong knowledge of inference and model-serving infrastructure, including latency budgets and self-hosted vs managed serving.
  • Experience owning a roadmap with no end-user surface and building business cases for infra investments.
  • Experience with data platform decisions: pipelines, residency and regional data tradeoffs.
  • Proven senior-level leadership, mentoring PMs and influencing cross-functional teams.
  • Entrepreneurial, with comfort in ambiguity and fast iteration in a high-growth environment.
  • Exceptional communication skills for translating infra tradeoffs to non-technical stakeholders.

Responsibilities

  • Own product strategy for runtime, inference, and data platform serving conversations in production.
  • Set build-vs-buy and self-host-vs-managed tradeoffs with cost, latency, and scaling implications.
  • Build and own evaluation framework for runtime and inference performance metrics.
  • Collaborate with infrastructure leadership to sequence a technical roadmap with high internal impact.
  • Own data flows, residency, retention, and access-control tradeoffs across the platform.
  • Translate capacity limits and data gaps into actionable business decisions.
  • Lead cross-functional teams of engineers, data scientists, and infra specialists without direct authority.
  • Represent the area in exec-level discussions on cost, capacity, and platform risk.

Skills

Infrastructure product management
ML / data platform
Runtime systems
Cross-functional leadership

Education

Bachelor’s degree in Computer Science, Engineering, Statistics, or related field

Job description

PolyAI is the Agentic Dialog Platform for building the conversational enterprise, used to build, run, govern, and improve dialog agents at scale. Powered by Raven, a proprietary dialog model trained on more than a billion enterprise conversations, PolyAI agents are built for complexity, open at every layer, and sovereign by design. PolyAI serves hundreds of enterprises across 75 languages and 25 countries, including Metro Bank, Marriott, PG&E, and UniCredit.

PolyAI automates customer service through lifelike voice assistants that let customers lead a conversation. Our voice assistants make it possible for businesses to deliver outstanding customer service that rivals their human agents.

Our customers, which include the world’s leading logos, are expanding how they use our platform, driving automation of critical customer service operations and integrating PolyAI into their daily customer service workflows.

We’re looking for a highly technical, senior product leader to own the platform underneath everything our agents do: the runtime that serves conversations in production, the inference layer that powers our models, and the data infrastructure that feeds both. This is a deep infrastructure role with direct exposure to latency, cost, and reliability tradeoffs at scale, not a roadmap-and-backlog role. You’ll set strategy for areas other teams build on top of, working closely with engineering leadership rather than through them

RESPONSIBILITIES
  • Own the product strategy for runtime (how conversations get served in production), inference (how our models are hosted and served, including self-hosted and third-party paths), and the data platform (how conversation and model data moves, is stored, and is queried across the business)
  • Set direction on build-vs-buy and self-host-vs-managed tradeoffs for model serving, including evaluating cost, latency, and scaling implications of infrastructure decisions before they’re made, not after
  • Build and own the evaluation framework for how we measure runtime and inference performance in production (latency, throughput, cost per minute/token, failure rates), and drive continuous improvement off that data
  • Partner directly with infrastructure and platform engineering leadership to sequence a technical roadmap that often has no visible customer-facing surface, and defend its priority against features that do
  • Own how conversation data flows into and out of the platform, including data residency, retention, and access-control tradeoffs that affect what the business can build or sell
  • Translate ambiguous technical constraints (capacity limits, model failure modes, data gaps) into decisions the rest of the business can plan around
  • Lead and influence a cross-functional group of engineers, data scientists, and infrastructure specialists without formal authority over them
  • Represent this area in exec-level conversations on cost, capacity planning, and platform risk
REQUIRED QUALIFICATIONS
  • 6+ years of product management or related technical experience, including a strong track record owning infrastructure, ML/data platform, or runtime-adjacent products, not just user-facing features
  • Bachelor’s degree (or foreign equivalent) in Computer Science, Engineering, Statistics, or a related field involving AI/ML or distributed systems, or equivalent industry experience
  • Strong working knowledge of how inference and model-serving infrastructure actually works: latency budgets, GPU/node economics, self-hosted vs. managed serving tradeoffs
  • Comfortable owning a roadmap with no end-user-visible surface, and able to make the business case for infrastructure investment on its own terms
  • Experience with data platform decisions: pipelines, residency/compliance constraints, and tradeoffs between centralizing vs. fragmenting data by region or product line
  • Demonstrated ability to operate at a senior level: setting direction, not just executing against someone else’s plan, and mentoring more junior PMs
  • Entrepreneurial mindset, comfortable with ambiguity and fast iteration in a high-growth environment
  • Exceptional cross-functional communication skills, particularly translating infrastructure tradeoffs for non-technical stakeholders
Compensation

We offer a competitive base salary, shaped by your experience and location, plus equity — so you share in the value you help create.

Benefits
  • Participation in the company’s employee share options plan
  • Tenure-Based PTO: You will receive 25 holidays when you join and will gain an additional 1 day after 2 years of service, then 1 day each year until capped at 32 holidays
  • Flexible working from home policy
  • Work from outside of the UK for up to 6 months each year
  • TELUS Health EAP 24/7 - offers you and your chosen family confidential, judgment-free support for any work, health, or life challenge
  • Enhanced parental leave
  • Bike2Work scheme
  • Annual learning and development allowance
  • We’re all about making WFH work for you - that’s why we offer a one-off WFH allowance when you join. Offering perks like noise-cancelling headphones or a comfortable desk chair to boost your comfort and focus!
  • Company-funded fertility and family-forming programmes
  • Menopause care programme with Maven
  • Private healthcare and dental cover, discounts on gym members and relaxation apps, and access to a range of mental health programs
  • Sabbatical Program: 5-week paid sabbatical available after 5 years of employment

At PolyAI, we take great pride in our values - they guide everything we do. We believe that a strong culture leads to meaningful work and lasting impact.

Our core values are:

Only the best

We expect the best from our people, we hire people that expect the best from themselves, and we nurture this drive for excellence.

Ownership

We care deeply about what we do. We take ownership of our initiatives, decisions and outcomes.

Relentlessly improve

We demand more from ourselves and are always evolving. Continuous, obsessive improvement is the only way we will transform the world of conversational AI.

Bias for action

Our world moves quickly and so do we. We take calculated risks and we deliver impact fast.

Disagree and commit

We are all working toward the same goal. If we donʼt agree with something, we work hard to understand it and when a decision is made, we accept it and give it our all.

Build for people

We want the world to enjoy the experiences they have with us. We are building for a future that prefers automation.

PolyAI is proud to be an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All employment decisions at PolyAI will be based on the business needs without attention to ethnicity, religion, sexual orientation, gender identity, family or parental status, national origin, neurodiversity status or disability status.

Kindly find the Privacy Notice for our recruitment process by following the link here. This document provides important information regarding how we handle your personal data throughout the recruitment journey.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Deployment Strategist (Must be based in U.S.) New
Deployment Strategist (Must be based in U.S.) New

PolyAI Ltd. • United States

Remote
USD 150,000 - 200,000
Equity in the company
401k plan
Flexible PTO and holidays
+2
Senior Marketing Manager, EMEA
Senior Marketing Manager, EMEA

PolyAI • United States

Remote
USD 140,000 - 200,000
Employee share options
25 holidays + 1 day after 2 years + 1/
Flexible WFH policy
+10
Senior Account Manager (Pacific, Mountain, or Central time zone)
Senior Account Manager (Pacific, Mountain, or Central time zone)

Remotejobs • United States

Remote
USD 210,000 - 230,000
Equity in the business
Employee stock options
Comprehensive health coverage
+4
Enterprise Account Executive - U.S. (Evergreen Role)
Enterprise Account Executive - U.S. (Evergreen Role)

PolyAI • United States

Remote
USD 120,000 - 180,000
Equity in company
Health coverage
Life Insurance
+8
Product Manager, Agent Development - Financial Services
Product Manager, Agent Development - Financial Services

sierra • San Francisco (CA)

On-site
USD 150,000 - 210,000
Flexible PTO
Medical, dental, vision
Retirement plan
+2
Product Strategist | Digital Products & AI
Product Strategist | Digital Products & AI

PA Consulting Group • Charlotte (NC)

Hybrid
USD 120,000 - 180,000
Group medical insurance
Health Savings Account with company my
Teladoc and informed Nurse line
+12
Product Strategist | Digital Products & AI
Product Strategist | Digital Products & AI

PA Consulting • Charlotte (NC)

Hybrid
USD 110,000 - 160,000
Group medical insurance
Health Savings Account with company
Teladoc and Nurse line
+3
Principal Product Manager, Enterprise AI
Principal Product Manager, Enterprise AI

Okta Inc. • Bellevue (CA)

On-site
USD 188,000 - 289,000
Demand Generation Marketing Manager
Demand Generation Marketing Manager

PolyAI • United States

Remote
USD 125,000 - 140,000
Competitive salary
Equity participation
Comprehensive health coverage
+2
Principal Product Manager, AI Platforms (GTM Excellence)
Principal Product Manager, AI Platforms (GTM Excellence)

Palo Alto Networks, Inc. • Santa Clara (CA)

Remote
USD 126,000 - 204,000