Product Manager, Platform Experience & Developer Product

Cohere; United States; Hybrid; USD 150,000 - 190,000; Full time

Benefits offered by this job

Equity options

Hybrid work model

Competitive compensation

Professional development

Job summary

Cohere is seeking a Senior Product Manager to own our managed services and API/SDK roadmap, focusing on deployment models, data residency, provisioning, and developer experience. You will drive surfaces that enable enterprises to run Cohere's capabilities at scale, interfacing with developers and customers to shape the platform.

You will lead cross‑functional efforts across engineering, research, and GTM to ship features, measure success, and iterate quickly in a hybrid/remote setup with strong

Qualifications

• 5+ years of product management experience with developer-facing or platform-layer products such as APIs, SDKs, developer tooling, or infra.
• Strong technical fluency in API design, versioning, backward compatibility, and polished developer experience.
• Experience turning infrastructure capabilities into differentiated, customer-facing features.
• Experience building developer tooling surfaces like consoles, dashboards, analytics, observability, or debugging tools.
• Analytical by default: define success metrics, instrument data, and combine qualitative feedback for decisions.
• Excellent cross-functional collaboration with engineering, design, infrastructure, and GTM teams.

Responsibilities

• Drive roadmap across managed services, APIs, SDKs, and developer tooling, balancing near-term needs with long-term investments.
• Translate model and infrastructure capabilities into product surfaces developers and operators rely on.
• Engage with customers and developers to understand integration challenges and surface unmet needs.
• Define success metrics for platform health and developer experience and lead initiatives to improve them.
• Partner with engineering, research, writing, and developer relations to ship and document platform improvements.

Skills

Product management

Developer-facing products

API design

SDK development

Data-driven decision making

Tools

APIs

SDKs

Job description

Headquarters: Toronto

Who are we? Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what’s best for our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products. Join us on our mission and shape the future!

Role Overview

Managed Services and Models as a Service

Own Cohere’s managed service offerings as a product. This is broader than model serving alone. It includes the full range of how enterprises consume and operate Cohere’s capabilities, from shared multi-tenant model access to dedicated single-tenant deployments, and from synchronous real-time inference to high-volume asynchronous workloads. You will own the product thinking around deployment models, data residency and regional compliance requirements, self-serve provisioning, and the operational controls that give enterprises confidence in running production workloads on Cohere’s infrastructure.

API and SDK

Own the roadmap for how developers build on Cohere. This means setting the direction for our APIs and SDKs, thinking carefully about interface design and ergonomics, and ensuring we ship developer primitives that are stable, well-documented, and a joy to build with.

Developer Experience and Tooling

Own the surfaces that give developers visibility and control over their integration with Cohere. This includes the API console, credential and access management, usage and cost visibility, request observability, and sandbox and testing environments.

Responsibilities

• Drive the roadmap across managed services, APIs, SDKs, and developer tooling, balancing near-term customer needs with long-term platform investment.
• Translate model and infrastructure capabilities into well‑designed product surfaces that developers and enterprise operators can rely on.
• Engage directly with customers and developers to understand integration challenges, validate priorities, and surface unmet needs.
• Define success metrics for platform health and developer experience, and lead initiatives to move them.
• Partner with engineering, research, technical writing, and developer relations to ship and document platform improvements.

Requirements

• 5+ years of product management experience, with meaningful time spent owning developer-facing or platform-layer products such as APIs, SDKs, developer tools, or technical infrastructure.
• Strong technical fluency with API design and SDK development, including an understanding of versioning, backward compatibility, and what makes a developer experience feel polished and reliable.
• A track record of thinking about infrastructure as a product, with the ability to translate system-level capabilities into clearly differentiated, customer-facing features.
• Experience building or owning developer tooling surfaces such as consoles, dashboards, usage analytics, or observability and debugging tools.
• Analytical by default: you define success metrics before you build, instrument thoughtfully, and use data alongside qualitative feedback to make decisions.
• Strong collaborator who works well across engineering, design, infrastructure, and GTM teams, and who can communicate technical tradeoffs clearly to a range of stakeholders.
• Highly execution‑oriented with a bias toward shipping and iterating quickly.
• Demonstrated ownership across the full product lifecycle — from problem definition and scoping through launch, iteration, and eventual deprecation or migration.

Nice‑to‑Haves

• Experience owning a model serving or inference platform, including familiarity with deployment models such as multi‑tenant and dedicated infrastructure.
• Exposure to data residency, sovereignty, or regional compliance requirements as they apply to AI or cloud infrastructure products.
• Familiarity with asynchronous and high‑throughput workload patterns, and the product considerations they introduce around job management, status visibility, and cost attribution.
• Familiarity with the AI developer ecosystem and open standards, including orchestration frameworks such as LangChain and LlamaIndex, model serving frameworks such as vLLM, and an awareness of de facto interoperability standards and how they shape developer adoption and integration patterns.

Why join Cohere?

• Impact: Shape the developer surface of one of the world's leading enterprise AI platforms, used by developers and enterprises building production AI systems at scale.
• Innovation: Work alongside leading researchers and engineers solving complex ML challenges at the frontier of AI.
• Growth: Enjoy competitive compensation, equity options, and opportunities for professional development.
• Flexibility: Hybrid work model with offices in San Francisco, New York, and Toronto.

Hybrid work model with offices in San Francisco, New York, and Toronto.

Location Remote or hybrid (San Francisco, New York, Toronto).

If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!

We value and celebrate diversity and strive to create an inclusive work environment for all.

We welcome applicants from all backgrounds and are committed to providing equal opportunities.

Should you require any accommodations during the recruitment process, please submit an Acc