Sr. Staff Technical Product Manager

Groq

New York (NY)

Hybrid

USD 170,000 - 230,000

Full time

11 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Groq is seeking a Sr. Staff Product Manager to own product strategy and execution for the AI Inference Platform.

You will work at the intersection of AI infrastructure, cloud technology, and distributed systems, partnering with Engineering and cross-functional teams to translate complex challenges into scalable product experiences. You will lead and shape the roadmap, define requirements, and drive delivery from concept to reality, with a focus on high-performance inference workloads and

Qualifications

  • 10+ years in Product Management, including leadership of platform/infrastructure products.
  • Experience with AI inference, cloud infrastructure, or related environments.
  • Strong knowledge of distributed systems, cloud APIs, Kubernetes, observability.

Responsibilities

  • Define product strategy and execution for Groq's AI Inference Platform.
  • Translate customer needs into specs, features, success metrics, and execution plans.
  • Collaborate with Platform Engineering, Distributed Systems, Cloud Infrastructure, and other teams to drive roadmap and delivery.
  • Shape customer-facing cloud capabilities and developer workflows for scalable services.
  • Monitor market trends and identify opportunities to differentiate Groq's offerings.
  • Collaborate with Sales, Solutions Engineering, Customer Success, and Marketing on launches and adoption.

Skills

Product management leadership
Technical product management
AI/ML infrastructure
Distributed systems
Cloud infrastructure
APIs
Kubernetes
Observability
Cross-functional collaboration
Strategic planning

Job description

About Groq

Inference is the engine that powers AI, and Groq was built from the silicon up to deliver the world's fastest inference at scale. We pioneered the LPU-the first processor designed specifically for AI inference-and are transforming that innovation into a global cloud platform powering production AI workloads.

With the capital, infrastructure, and team to execute, we're uniquely positioned to define the next era of AI infrastructure. The opportunity is massive, and it's still wide open. Now let's go build it!

Mission:

Help shape the future of AI inference by building the platform capabilities that enable developers and enterprises to bring AI applications to life at scale. As a Sr. Staff Product Manager, you'll own product strategy and execution for critical areas of Groq's AI Inference Platform, turning complex infrastructure challenges into scalable, reliable, and intuitive product experiences.

You'll work at the intersection of AI infrastructure, cloud technology, and distributed systems, partnering closely with Engineering and cross-functional teams to define what we build and drive it from concept to delivery. This is an opportunity to influence product direction across the platform, and take hands‑on ownership of products that make high‑performance AI inference more accessible to customers.

Location:

This role will be based in one of our three hiring hubs: the Dallas, San Francisco, or New York City area. The person hired for this role must be based in one of these three areas. You'll have the flexibility to work remotely while we establish our local Groq office, with the expectation that this role will transition to onsite once the office opens.

Responsibilities & opportunities in this role:
  • Drive hands‑on product definition and delivery, translating customer needs, technical constraints, and business priorities into detailed specifications, feature requirements, success metrics, and execution plans from concept through launch and continuous improvement.
  • Bring deep AI infrastructure and cloud platform expertise to complex platform initiatives, contributing to technical specifications, architecture discussions, and roadmap priorities across multiple product workstreams.
  • Partner closely with Platform Engineering, Distributed Systems, Cloud Infrastructure, Reliability Engineering, Hardware Engineering and customer‑facing teams to deliver scalable, reliable, and customer‑centric platform capabilities.
  • Partner with engineering leadership to navigate technical tradeoffs and balance customer impact, technical investments, platform scalability, and long‑term architectural evolution.
  • Shape customer‑facing cloud capabilities, including inference APIs, developer workflows, and platform experiences that turn complex infrastructure into services that are easy to adopt, deploy, and scale.
  • Define and prioritize internal platform investments across cloud infrastructure, resource management, observability, and platform optimization to improve scalability, reliability, operational efficiency, and infrastructure utilization.
  • Lead customer discovery with enterprise AI customers and developers to understand inference workloads, deployment workflows, performance expectations, operational challenges, and emerging infrastructure needs.
  • Measure product adoption, customer experience, and platform performance using customer feedback, telemetry, and operational metrics to continuously improving customer outcomes.
  • Collaborate with Sales, Solutions Engineering, Customer Success, and Marketing to support product launches, customer adoption, and go‑to‑market initiatives.
  • Monitor the evolving AI inference and cloud infrastructure landscape to identify emerging technologies, customer needs, and opportunities for product differentiation.
  • Communicate product strategy, roadmap, priorities, risks, and progress to executive leadership and cross‑functional stakeholders.
Ideal candidates have/are:
  • 10+ years of Product Management experience, including at least 5 years leading highly technical platform, infrastructure, or cloud products.
  • Deep domain expertise and demonstrated ownership of technically complex products in AI inference, cloud infrastructure, or related environments such as inference engines, LLM serving platforms, neoclouds, or AI cloud services.
  • Strong understanding of distributed systems, cloud infrastructure, APIs, Kubernetes, observability, platform reliability, capacity planning, and multi-region architectures.
  • Proven ability to independently define and deliver complex technical products, including developing specifications, prioritizing features, and driving execution with engineering teams.
  • Strong technical judgment and a track record of partnering with senior engineering leaders to translate customer needs into product strategy, influence architectural decisions, and deliver scalable infrastructure capabilities.
  • Highly self‑directed and comfortable navigating ambiguity, making decisions, and driving progre
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr. Staff Technical Product Manager
Sr. Staff Technical Product Manager

Groq, Inc. • Dallas (TX), San Francisco (CA), New York (NY)

Hybrid
USD 310,000 - 365,000
LTI program
Employee benefits
Sr. Staff Technical Product Manager
Sr. Staff Technical Product Manager

Groq • San Francisco (CA)

Remote
USD 310,000 - 365,000
Staff/Sr. Staff Forward Deployed Engineer
Staff/Sr. Staff Forward Deployed Engineer

Groq • Texas

Hybrid
USD 180,000 - 240,000
Senior AI Infrastructure Product Leader - Cloud Platform
Senior AI Infrastructure Product Leader - Cloud Platform

Groq • New York (NY)

Hybrid
USD 170,000 - 230,000
Staff/Sr. Staff Platform Engineer, Kubernetes Infrastructure (GroqMetal)
Staff/Sr. Staff Platform Engineer, Kubernetes Infrastructure (GroqMetal)

Groq • San Francisco (CA)

Hybrid
USD 260,000 - 420,000
Senior AI Inference Platform Leader
Senior AI Inference Platform Leader

Groq • San Francisco (CA)

Remote
USD 310,000 - 365,000
Technical Product Marketing Manager
Technical Product Marketing Manager

Groq • San Francisco (CA)

Hybrid
USD 154,000 - 209,000
Long-Term Incentive (LTI)
Staff/Sr. Staff Network Design Engineer, AI/HPC
Staff/Sr. Staff Network Design Engineer, AI/HPC

Groq • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Staff/Sr. Staff Forward Deployed Engineer
Staff/Sr. Staff Forward Deployed Engineer

Groq • United States

Hybrid
USD 270,000 - 402,000
Senior Platform Engineer - AI Infra & Kubernetes
Senior Platform Engineer - AI Infra & Kubernetes

Groq • San Francisco (CA)

Hybrid
USD 260,000 - 420,000