Senior Technical Product Manager - AI Compute Platform

Nebius Group

United States

Remote

USD 170,000 - 210,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Nebius Group is building a leading AI cloud platform that enables developers and enterprises to train, deploy, and operate AI workloads with efficiency. We are growing the AI Compute Platform product team and seeking Technical Product Managers across the platform.

As a Technical Product Manager, you will own end-to-end responsibility for your slice of the platform, collaborating with engineering leaders and customers to define APIs, semantics, and platform behavior at hyperscaler quality.

Qualifications

  • 6+ years in Product Management, Platform PM, Infrastructure PM, or SRE / Engineering Lead with strong product instincts.
  • Strong technical foundation and cloud-infrastructure depth - comfort reasoning about API semantics, control-plane vs data-plane behavior, system events and lifecycle, multi-tenant.

Responsibilities

  • Own end-to-end product responsibility for your area - strategy, roadmap, discovery, delivery, adoption, measurable customer and platform outcomes.
  • Design and own the platform contracts customers depend on - APIs, semantics, system events, customer-facing surfaces, operational behavior - at hyperscaler quality.
  • Drive cross-team execution across platform engineering, networking, storage, Soperator/MK8S, observability, IAM, billing, capacity planning, support, and product design.
  • Turn customer pain into product commitments through structured discovery - interviews, usage analytics, support patterns, incident postmortems.
  • Engage engineering as a technical peer - debate API design, reason about system trade-offs, judge the quality of platform internals, and push back when the design is wrong.
  • Define and own success metrics - what you ship is measured by what changed for the customer or the platform, not by the size of the spec.
  • Be the product voice that customer-facing teams escape to when a system behavior, API contract, or operational pattern needs a product decision, not a workaround.

Skills

Product Management
Platform PM
Infrastructure PM
SRE/Engineering Lead
Cloud infrastructure

Job description

About Nebius :

Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.
Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.
Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.


The role:

Our customers build the frontier of AI on top of Nebius - training state-of-the‑art models, running production inference at scale, shipping the research and products that define where the field is going next.
We are building the AI cloud that the people building the frontier of AI choose deliberately - not on price, not on raw capacity, but on how it works to use it day to day. To do that, we are growing the AI Compute Platform product team and hiring multiple Technical Product Managers across the full surface of the platform.
Your scope will be defined by what you bring. We will match your technical strengths, customer experience, and product instincts to the area of the platform where you can have the most impact. The platform is broad - and at our scale, every slice is mission‑critical. If you want to help build the best AI cloud in the world - and you have the technical depth to engage engineering leaders as a peer (not as a translator) and the comfort to talk to customers directly - this team is for you.


The platform you'll help build:


  • Hardware platforms & launch - bringing new GPU and CPU platforms (GB300, Vera Rubin, ARM/Grace, future generations) to production with full launch readiness across the stack.

  • Cluster lifecycle & fleet operations - new region launches, 100,000+ GPU cluster bring‑up, platform sharding and allocation architecture, release engineering, host‑lifecycle automation, operational efficiency.

  • Reliability & Mission Control - autohealing, health checks, SLA, fault‑tolerant training, MTTR reduction, customer trust at scale, observability as a product.

  • Customer experience & developer surface - Compute APIs, console, CLI, IMDS and in‑VM signals, self‑service workflows, notifications, customer‑facing observability, unified UX across the product line.

  • GPU & InfiniBand foundational services - drivers, firmware, NCCL, IB/RoCE, NVLink topology, the foundational layer everything else builds on.

  • Managed runtime platforms - Soperator (Slurm‑on‑Kubernetes) and MK8S (Managed Kubernetes for AI workloads), powering training and inference for frontier labs.

  • Platform integrations & emerging workloads - Token Factory integration, RL and agentic workload infrastructure, capacity sharing, new business surfaces as they emerge.

  • Cross‑platform program & delivery - NVIDIA partnership programs, major‑maintenance orchestration, cross‑stream releases.


You will own one of the slices of this platform end‑to‑end - from strategy and roadmap through delivery, adoption, and measurable outcomes.


Your responsibilities will include (regardless of which slice you own):


  • Own end‑to‑end product responsibility for your area - strategy, roadmap, discovery, delivery, adoption, measurable customer and platform outcomes.

  • Design and own the platform contracts customers depend on - APIs, semantics, system events, customer‑facing surfaces, operational behavior - at hyperscaler quality.

  • Drive cross‑team execution across platform engineering, networking, storage, Soperator/MK8S, observability, IAM, billing, capacity planning, support, and product design.

  • Turn customer pain into product commitments through structured discovery - interviews, usage analytics, support patterns, incident postmortems. Close the loop so the same class of failure or friction does not recur.

  • Engage engineering as a technical peer - debate API design, reason about system trade‑offs, judge the quality of platform internals, and push back when the design is wrong.

  • Define and own success metrics - what you ship is measured by what changed for the customer or the platform, not by the size of the spec.

  • Be the product voice that customer‑facing teams (Support, CX, TAMs) escape to when a system behavior, API contract, or operational pattern needs a product decision, not a workaround.


We expect you to have:


  • 6+ years in Product Management, Platform PM, Infrastructure PM, or SRE / Engineering Lead with strong product instincts.

  • Strong technical foundation and cloud‑infrastructure depth - comfort reasoning about API semantics, control‑plane vs data‑plane behavior, system events and lifecycle, multi‑tenant o

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Product Manager - Inference Platform
Senior Product Manager - Inference Platform

Nebius • United States

Remote
USD 180,000 - 240,000
Technical product manager in AI compute platform
Technical product manager in AI compute platform

Nebius • United States

Remote
USD 180,000 - 240,000
Competitive compensation
Career growth and learning
International environment
Staff Product Manager (Compute)
Staff Product Manager (Compute)

Lambda • United States

On-site
USD 150,000 - 190,000
Health insurance
401k match
5 sick days and 12 paid holidays
+2
Product Director - AI Infrastructure Platforms
Product Director - AI Infrastructure Platforms

Testing Site - JPMC • Plano (TX)

On-site
USD 250,000 - 350,000
Senior AI Cloud Platform Product Manager
Senior AI Cloud Platform Product Manager

Nebius Group • United States

Remote
USD 170,000 - 210,000
Senior Sales Engineer - Token Factory
Senior Sales Engineer - Token Factory

Nebius Group • United States

Remote
USD 140,000 - 190,000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Group product manager for AI cloud platforms
Group product manager for AI cloud platforms

Nebius • United States

Remote
USD 140,000 - 210,000
Competitive compensation
Career growth
Flexibility and ownership
+4
Principal Product Marketing Manager - Enterprise
Principal Product Marketing Manager - Enterprise

Nebius Group • United States

Remote
USD 178,000 - 222,000
Health insurance
Remote work stipend
Career growth
Senior Director, Platform Product, Emerging Technology
Senior Director, Platform Product, Emerging Technology

Leadout Capital • San Francisco (CA)

On-site
USD 210,000 - 310,000
Product Engineer, Platform
Product Engineer, Platform

Pivots Hiring • San Mateo (CA)

On-site
USD 140,000 - 200,000