Product Manager, Stream & Batch Processing in Data Infrastructure

Meta; City of Westminster; On-site; GBP 120,000 - 180,000; Full time

Job summary

Meta seeks a senior individual-contributor Product Manager to set the direction across streaming and batch processing. You will define a coherent customer experience, align platform strategy, and help teams migrate from legacy systems safely.

You will collaborate with engineering leaders across organizations to deliver measurable improvements in throughput, reliability, and efficiency. The role emphasizes ownership of the engine portfolio, authoring surfaces, and a unified platform strategy,

Qualifications

• 12+ years of experience in Product Management or equivalent relevant experience.
• Experience with or direct product ownership of at least one of Google Dataflow, Apache Beam, Flink, Kafka, Spark Structured Streaming, Iceberg or comparable systems.
• Demonstrated expertise in large-scale distributed data systems.
• Critical thinking and analytical leadership experience.
• Experience driving strategy and alignment across multiple organizations without direct authority.
• BA/BS in Computer Science or Information Systems.

Responsibilities

• Own the multi-year product strategy for stream and batch processing: engine portfolio, authoring surface, and convergence path.
• Advocate for internal customers: engineers and ML practitioners authoring pipelines.
• Translate pain points into abstractions that scale under load.
• Define what "+managed+" means internally: self-service, autoscaling, upgrades and deprecation.
• Set clear processing semantics, checkpointing, state management, and data freshness.
• Establish service level objectives: throughput, freshness, reliability, and compute efficiency.
• Measure whether platform reduces operational load for teams.
• Own adoption, deprecation, and migration to the converged path.
• Drive open source strategy: what to adopt, contribute upstream, and interior stays justified.
• Collaborate with ML data, ranking, warehouse teams; align across Ads, Reels, ML Infra.

Skills

12+ years PM experience

Distributed data systems

Cross-organizational alignment

Mentorship of senior PMs

Education

BA/BS in Computer Science or Information Systems

Tools

Google Dataflow

Apache Beam

Flink

Kafka

Spark Structured Streaming

Iceberg

Job description

Meta's products depend on data pipelines that process large-scale batch and real-time workloads. Today, those workloads span two ecosystems. Our streaming stack includes XStream and a growing managed Apache Flink footprint. Our batch stack includes Spark and Presto over Hive and Iceberg tables, Velox as a shared execution layer, and an internal workflow authoring and scheduling platform. These systems evolved separately. As a result, engineers encounter different authoring models, operational practices, guarantees, and migration paths depending on the workload they are building. We are looking for a senior individual-contributor PM to set the product direction across this portfolio. The immediate focus is to define a coherent customer experience across batch and streaming, align the long-term platform strategy, and help teams move from legacy systems safely. You will work closely with engineering leaders across multiple organizations. Success will require technical judgment, a strong,

Responsibilities

• 1. Own the multi-year product strategy for stream and batch processing at Meta: the engine portfolio, the authoring surface, and the convergence path between streaming and batch execution.
• 2. Act as the voice of the internal customer: software engineers, data engineers and ML practitioners authoring pipelines.
• 3. Turn their real pain (state management, event-time windowing, backfill, schema evolution, debugging a pipeline at 3am) into abstractions that hold up under load.
• 4. Define what "managed" should mean internally, covering self-service authoring, autoscaling, upgrade and deprecation, and hold the platform to that bar.
• 5. Establish the semantics customers can rely on, and the honest cost of each guarantee: processing semantics (at-least-once, at-most-once, exactly-once), checkpointing, state management, and freshness.
• 6. Establish the service level objectives this platform commits to: throughput, freshness and lag, reliability, and compute efficiency.
• 7. Instrument whether the platform is measurably reducing operational load for the teams on it.
• 8. Own adoption and deprecation as a single problem.
• 9. Drive migration onto the converged path, build the onboarding surface that makes it the obvious choice, and retire legacy engines safely for customers with production systems, oncall rotations and revenue depending on the one you're turning off.
• 10. Drive the open source strategy: what we adopt, what we contribute upstream, and where internal systems remain justified.
• 11. Partner with the ML data and ranking teams whose realtime feature pipelines are the most demanding tenants on this stack, and with the warehouse and analytics teams on the batch side of the boundary.
• 12. Drive alignment across Ads, Reels, ML Infra and the warehouse orgs largely without direct authority.
• 13. Establish consensus on strategy and priorities with engineering leadership, and present to executive audiences.
• 14. Raise the bar of the PM function through mentorship of senior PMs across Data Infrastructure, and support recruiting and interviewing.

understanding of internal customers, and the ability to turn a cross-organizational strategy into measurable adoption and operational improvements.

Qualifications

• 15. 12+ years of experience in Product Management or equivalent relevant experience
• 16. Experience with or direct product ownership of at least one of Google Dataflow, Apache Beam, Flink, Kafka, Spark Structured Streaming, Iceberg or comparable systems
• 17. Demonstrated expertise in large-scale distributed data systems
• 18. Critical thinking and analytical leadership experience
• 19. Experience driving strategy and alignment across multiple organizations without direct authority
• 20. BA/BS in Computer Science or Information Systems

Preferred Qualifications

• 21. Fluency in streaming semantics like event time versus processing time, windowing, watermarks, state backends, exactly-once delivery, deep enough to argue the tradeoffs
• 22. Hands on experience, for example, prior solutions architect or developer relations roles, is a strong plus
• 23. Experience owning autoscaling, multi-tenant capacity or compute efficiency as a product outcome on a fixed or constrained fleet
• 24. Experience with the ML side of streaming: realtime feature generation, freshness and coverage tradeoffs, training-serving consistency
• 25. A track record of successfully deprecating a system people depended on
• 26. Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
• 27. Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
• 28. Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies