Senior Product Manager, AI Data Platform & Open Source

Anyscale

Palo Alto (CA)

On-site

USD 120,000 - 160,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

A leading AI technology company is seeking a Senior Product Manager for their Ray Data scalable data processing library. This role involves driving product strategy while balancing open-source growth and commercial differentiation. Candidates should have over 3 years in product management, a solid technical background in distributed systems, and experience engaging with both developers and enterprise customers. This position offers opportunities to shape the future of AI data processing, working in a dynamic environment located in the Bay Area.

Qualifications

  • 3+ years of product management experience with technical products.
  • Strong technical background in distributed systems, ML infrastructure, or data processing.
  • Strategic thinking with ability to balance competing priorities and stakeholder needs.

Responsibilities

  • Drive the Ray Data product roadmap while ensuring balance between open source and commercial products.
  • Focus on community growth and ecosystem integrations for Ray Data.
  • Work with Product Marketing on market positioning and competitive analysis.
  • Assist sales and field engineering teams in customer engagements.

Skills

Product management experience
Technical background in distributed systems
Experience with developer and enterprise audiences
Strategic thinking

Job description

About the Role

Anyscale is seeking a Senior / Staff Product Manager to lead Ray Data, our scalable data processing library for ML and AI workloads.

This is a uniquely challenging role that requires balancing open source growth with commercial differentiation - driving rapid adoption in the open source Ray Data ecosystem while building compelling proprietary features for Anyscale RunTime, our high-performance commercial engine.

You'll own the entire Ray Data product roadmap in a competitive landscape, working closely with the engineering team, the field team, enterprise customers, and the open source community. Success requires:

  • Deeply ingraining yourself into the end-user experience to understand the nature of the product and its gaps and tradeoffs

  • Working closely with customers and open source users to draw the subtle line between growth and commercialization

  • Strategic thinking about which parts of the ML/Data lifecycle to focus on, identifying opportunities where our architectural strengths create the most value.

  • Thinking deeply about and clearly articulating the product strategy to stakeholders

Key Responsibilities
  • Drive the Ray Data product roadmap - Balance open source Ray Data feature development with Anyscale Runtime commercial differentiation to ensure that both Ray Data becomes the open source standard for AI data processing and Anyscale Runtime remains sufficiently compelling.

  • Drive open source Ray Data adoption - Focus on community growth, developer experience, and ecosystem integrations

  • Market Positioning & Enablement - Work closely with Product Marketing on strategic market positioning, field enablement, and competitive analysis to maintain differentiation.

  • Customer engagement - Drive key customer engagements assisting sales and field engineering teams.

Required Qualifications
  • 4+ years of product management experience with technical products

  • Strong technical background in distributed systems, ML infrastructure, or data processing

  • Experience working with developer and enterprise audiences

  • Strategic thinking with ability to balance competing priorities and stakeholder needs

  • Located in or willing to relocate to the Bay Area

Preferred Qualifications
  • Prior experience with open source products and commercial monetization strategies

  • Background in ML tooling, data infrastructure, or developer tools

About Ray Data

Ray Data is a scalable data processing library built on Ray Core that provides flexible and performant APIs for distributed data processing. It enables offline batch inference and data preprocessing for ML training, scaling data processing to large clusters while maintaining ease of use for developers.

Why Anyscale
  • We're on a mission to make scalable computing effortless. Ray is the AI Compute Engine at the center of some of the world's most powerful AI platforms

  • Our tech is in production at companies like OpenAI, Uber, Spotify, Instacart, and Cruise

  • We're backed by Andreessen Horowitz, NEA, and Addition, with $250M+ raised to date

  • Recent partnerships with Azure, CoreWeave, and Google Cloud are putting AI-native compute directly into enterprise environments

  • Competitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)

  • We offer flexible time off, paid parental leave, and mental health support

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior / Staff Product Manager - Ray Data
Senior / Staff Product Manager - Ray Data

Anyscale • San Francisco (CA)

On-site
USD 130,000 - 160,000
Staff Software Engineer, Platform Infrastructure (Foundations)
Staff Software Engineer, Platform Infrastructure (Foundations)

Anyscale • San Francisco (CA)

On-site
USD 260,000 - 380,000
Competitive salary and equity
Health/dental/vision coverage
Flexible time off
+2
Software Engineer, ML Developer Experience
Software Engineer, ML Developer Experience

Carbon Data Solutions • United States

Remote
USD 140,000 - 210,000
Customer Engineer, Infrastructure
Customer Engineer, Infrastructure

Carbon Data Solutions • United States

Remote
USD 120,000 - 180,000
Distributed LLM Inference Engineer - Scale HighThroughput AI
Distributed LLM Inference Engineer - Scale HighThroughput AI

Anyscale • Palo Alto (CA)

On-site
USD 120,000 - 160,000
Stock Options
Healthcare plans with 99% premium coverage
401k Retirement Plan
+6
Staff Software Engineer, Ray Core
Staff Software Engineer, Ray Core

Anyscale • United States

On-site
USD 180,000 - 240,000
Software Engineer (Ray Data)
Software Engineer (Ray Data)

Anyscale • San Francisco (CA)

On-site
USD 140,000 - 190,000
We have moved our Careers Page to: https://jobs.ashbyhq.com/anyscale
We have moved our Careers Page to: https://jobs.ashbyhq.com/anyscale

The Rundown AI, Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Staff Software Engineer, Ray Core
Staff Software Engineer, Ray Core

Anyscale • Town of Montana (WI)

On-site
USD 180,000 - 250,000
Health coverage
Dental coverage
Vision coverage
+3
Customer Engineer, Infrastructure
Customer Engineer, Infrastructure

Anyscale • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive salary and equity
Health/dental/vision coverage
Flexible time off
+2