Lead Product Manager, Inference

Mistral; New York (NY); Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Healthcare coverage

Relocation support

Retirement plans

Meal/transportation allowances

Job summary

Mistral is building a sovereign AI cloud and seeks a Lead Product Manager to own the inference portfolio. You’ll define strategy, write specs, and work with customers and internal teams across inference, infrastructure, and GTM to deliver solutions that scale AI workloads.

You will operate as an individual contributor first, taking end-to-end ownership and setting the product bar as the most senior hire in this space.

Qualifications

• Proven track record delivering inference or cloud infrastructure products.
• Engineering background before moving into product management.
• Experience bringing infra or inference products to revenue and adoption.
• Ability to lead cross-functional teams and write clear specs.

Responsibilities

• Strategy and vision: define the inference portfolio’s vision, strategy, and goals.
• Roadmap and execution: own end-to-end lifecycle for serverless inference and related services.
• Customers: work with AI-native startups and enterprises to translate constraints into roadmaps.
• Engineering partnership: collaborate with inference engineering and cloud infra teams.
• Research and open source: track advances to improve product performance and efficiency.
• Team building: shape and grow the inference PM team as the portfolio scales.

Skills

Product management

Infrastructure

AI/inference infrastructure

Cross-functional collaboration

Education

Engineering degree

Job description

About Mistral

Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms.

We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited.

The role

Mistral is building a sovereign AI cloud. Our inference platform already serves production traffic at scale. We are hiring a Lead Product Manager to own the inference portfolio within our Cloud & Inference organization.

You’ll set strategy, write specs, sit with customers running production traffic, and work across our inference, infrastructure, and go-to-market teams to deliver real customer impact. Example problems you may work on include figuring out the next inference product we should launch to help our customers scale their AI workloads or how we cut fraudulent free-tier usage without adding friction for legitimate users.

You will work on state of the art infrastructure, in close collaboration with our science and research engineering teams. Your job is to turn that infrastructure into products that AI-native startups and enterprises pay for, integrated with our developer platform Studio.

You will operate as an individual contributor first — taking end-to-end ownership of complex and significant product lines — while building the foundation for the inference PM team as the portfolio grows. The size and shape of the team reporting into the role will be defined together with the VP Product once you're in place; from day one the expectation is hands‑on product leadership, not people management.

You will be the first PM fully dedicated to inference and the most senior product hire in the space. You will report to the VP Product - Cloud & Inference, and work day-to-day with our inference engineering teams in the US and Europe.

What you’ll do

• Strategy and vision: define the vision, strategy, and annual goals for the inference portfolio, aligned with customer needs and company objectives. Benchmark the managed‑inference field and pick where we win.

• Roadmap and execution: own the full lifecycle for serverless inference, dedicated endpoints, and adjacent services. Prioritize, ship, measure, iterate. Economics: own adoption, revenue contribution, and gross margin for your products. Treat cost‑per‑token, unit economics, and capacity tradeoffs as product decisions, and partner with GTM, Finance and Marketing on pricing, packaging, and launches.

• Customers: spend real time with AI‑native startups and enterprises running advanced production workloads. Turn their constraints, like latency, throughput, compliance, and cost, into roadmap choices.

• Engineering partnership: work daily with inference engineering and the cloud infrastructure teams behind our data centers on capacity planning, scheduling, routing, and reliability.

• Research and open source: track open‑source inference advances and emerging model architectures, and turn them into performance and efficiency gains for the product.

• Team building: as the portfolio scales, help shape and grow the inference PM team — hiring, mentoring, and setting the product bar.

What we’re looking for

• Deep product experience in tech and infrastructure with a track record of bringing inference, cloud infrastructure, or large‑scale distributed systems to market. You have built robust, at‑scale AI infrastructure first‑hand.

• An engineering background before moving into product management.

• You have taken an infra or inference product from early stage to material revenue and adoption, owning complex and significant product lines end to end.

• Player‑coach disposition: you lead from the front — hands‑on product work now, with the range and appetite to build and coach a team as we scale.

• Fluency in the economics of the business: gross margin, unit economics, and the tradeoffs behind token pricing and GPU capacity.

• High ownership and a strong bias for action. You prototype with AI coding tools, write your own specs, and unblock yourself without waiting for engineers or designers.

• Low ego, comfort in ambiguity, and credibility with executives, engineers, and customers alike.

What We Offer

We offer a comprehensive benefits package designed to support your well‑being, growth, and work‑life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location‑specific perks.

For the most up‑to‑date details on benefits available in your location, please refer to our Benefits page.

Privacy Policy

Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy.