Platform PM: Scalable AI Inference & Deployments (Equity)

The Consensus; New York (NY); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive compensation including equity

100% coverage of medical, dental, and vision insurance

Flexible PTO including Winter Break

Paid parental leave

Fertility and family-building stipend

Company-facilitated 401(k)

Networking opportunities with ML startups

Job summary

The Consensus is seeking a seasoned product manager to lead initiatives in making AI model serving reliable and efficient. You will work closely with engineering teams to enhance product scalability and performance.

The ideal candidate has over eight years of experience in product management, especially with distributed systems or machine learning platforms. Competitive benefits include full medical coverage and flexible PTO.

Qualifications

• 8+ years in product management with experience in infrastructure and distributed systems.
• Deep understanding of scaling, routing, and failover mechanisms.
• Proven capability of owning the product from backend to user experience.

Responsibilities

• Own autoscaling mechanisms to optimize workload placements.
• Ensure the reliability of production inference systems.
• Build the release engine for safe rollouts and traffic management.

Skills

Product management

Infrastructure

Distributed systems

Machine learning serving

Tools

Kubernetes

GPU infrastructure

Job description

The Consensus is seeking a seasoned product manager to lead initiatives in making AI model serving reliable and efficient. You will work closely with engineering teams to enhance product scalability and performance.

The ideal candidate has over eight years of experience in product management, especially with distributed systems or machine learning platforms. Competitive benefits include full medical coverage and flexible PTO.