Technical Product Manager - Inference

OpenKrill; United States; Remote; USD 180,000 - 240,000; Full time

Benefits offered by this job

Salary and equity

Health coverage

Parental leave

Relocation support

Job summary

Fundamental is seeking a senior product leader to own the strategy and roadmap for NEXUS inference offerings. You will focus on enterprise adoption, performance, reliability and economics, shaping deployment capabilities and governance controls for enterprise customers.

You'll work closely with engineering, research and Applied AI to turn cutting-edge infrastructure into consumable products, collaborating with GTM teams on packaging and pricing and driving adoption across large-scale customers.

Qualifications

• 7+ years of product management experience in model inference, infrastructure, developer platforms or API products.
• Strong understanding of inference, model serving and cloud infrastructure, with the ability to evaluate architecture and API choices.
• Experience working with enterprise ML, platform or IT teams to translate production requirements into delivery plans.
• Ability to turn ambiguous product goals into executable delivery plans with milestones and owners.
• Experience defining product success metrics and analytics to measure adoption, performance, reliability and cost.
• Experience shaping pricing and packaging for technical products with GTM alignment.

Responsibilities

• Own the strategy, roadmap and delivery of NEXUS inference offerings.
• Define deployment capabilities and enterprise controls for reliable integration into the platform.
• Collaborate with engineering, research and applied AI to turn infrastructure into consumable products for enterprises.
• Engage directly with enterprise customers to capture needs and translate them into roadmap decisions.
• Partner with product marketing and GTM teams on packaging and pricing for inference and deployment offerings.
• Own enterprise administration capabilities including customer portal, user management, access controls and auditability.

Skills

Product management

Model inference

Cloud infrastructure

APIs & API products

Enterprise customer engagement

Cross-functional collaboration

Job description

ABOUT FUNDAMENTAL

Fundamental is an AI research lab pioneering the future of enterprise decision-making. Our flagship model, NEXUS is the world's most powerful Large Tabular Model (LTM) - purpose-built for the structured records that contain trillions of dollars in business value. With $275m in funding from leading investors and trusted by Fortune 100 companies, Fundamental is giving businesses the Power to Predict.

At Fundamental, you'll work on unprecedented technical challenges in foundation model development and build technology that transforms how the world's largest companies make decisions. This is your opportunity to be part of a category-defining company from the ground-up. Join the team defining the future of enterprise AI.

ABOUT THE ROLE

You’ll own the product strategy and roadmap for NEXUS inference offerings, with a focus on customer adoption, performance, reliability and economics. You’ll also shape the deployment capabilities and enterprise controls customers need to integrate and operate these offerings reliably into the platform.

You’ll work on state-of-the‑art infrastructure in close collaboration with our engineering, research and applied AI teams. Your job is to turn that infrastructure into products enterprises can consume, with clear capabilities, performance levels and economics tradeoffs.

This is a senior, hands‑on and highly strategic individual contributor product role. You’ll also work closely with our customers to define their needs and build and communicate our production offering for our GTM teams.

WHAT YOU’LL DO

• Inference strategy and delivery: Own the strategy, roadmap and delivery of NEXUS inference offerings. Benchmark the landscape and translate customer needs and performance and cost tradeoffs into clear offerings. Partner with Engineering on scope, dependencies, capacity needs and delivery milestones. Prioritize, ship, measure and iterate.
• Inference economics: Own adoption, usage and costs for inference products. Use customer demand, usage and serving costs to guide the roadmap, working with engineering and go-to-market teams to improve product economics.
• Customer discovery: Spend time directly with enterprise customers running our models in advanced production workloads. Work with their ML, platform and IT teams, alongside Applied AI, to turn constraints around latency, throughput, compliance, reliability and cost into roadmap choices.
• Engineering partnership: Work daily with inference and other engineering teams on capacity planning, product priorities and timeline.
• Model admin operations: Own the capabilities customers need to deploy and operate NEXUS models reliably, including deployment versioning, controlled upgrades and rollback, and monitoring and alerts.
• Deployment offerings and pricing: Define how customers consume NEXUS across managed services and customer‑controlled environments, including deployment, integration, upgrade and support requirements. Partner with product marketing and go-to-market teams on packaging and pricing for inference and deployment offerings.
• Enterprise administration: Own the product roadmap for administrative and governance capabilities, including the customer portal, user and API key management, access controls, auditability, usage visibility and data‑handling controls.

MUST HAVE EXPERIENCE

• 7+ years of product management experience in model inference, infrastructure, developer platforms or API products, with a track record of owning technical products from early development through launch and measurable adoption or revenue growth.
• Strong understanding of inference, model serving and cloud infrastructure, with the ability to evaluate architecture and API choices and translate latency, throughput, capacity, reliability and cost tradeoffs into product decisions.
• Strong commercial judgment and understanding of infrastructure economics, with experience using customer needs, usage patterns and cost drivers to shape product offerings and priorities in partnership with engineering and go-to-market teams.
• Experience working directly with enterprise ML, platform or IT teams to understand production requirements, distinguish reusable capabilities from customer‑specific requests, and make difficult prioritization decisions.
• Experience turning ambiguous product goals into executable delivery plans with clear owners, milestones and dependencies, and driving cross‑functional delivery through launch by tracking progress and resolving blockers.
• Experience defining product success metrics and establishing the analytics and tracking needed to measure adoption, usage, performance, reliability and cost, using those insights to identify risks and prioritize improvements.

NICE TO HAVE EXPERIENCE

• Direct experience owning inference or model‑serving products is preferred.
• Experience shaping pricing and packaging for technical products.
• Previous experience in software, infrastructure or ML engineering before moving into product management.
• Experience bringing products into customer‑controlled environments, such as customer VPCs, and addressing the integration, security, administration and support requirements needed for production adoption.
• Experience building enterprise security, identity and access management product capabilities, or integrations with data and ML platforms.

BENEFITS

• Competitive compensation with salary and equity
• Comprehensive health coverage for you and your dependents
• Paid parental leave for all new parents, inclusive of adoptive and surrogate journeys
• Relocation support for employees moving to join the team in one of our office locations
• A high‑trust, low‑ego culture that values diversity of thought, ownership and initiative, with respect for personal boundaries and working styles