Principal Technical Product Manager, Hardware & AI Infrastructure

Nscale; Bellevue (WA); On-site; USD 180,000 - 240,000; Full time

Job summary

Nscale is seeking a Principal Technical Product Manager to define and deliver the next generation of hardware infrastructure powering large-scale AI workloads. You will own GPU and compute hardware portfolio from roadmaps to deployment, collaborating with engineers, customers, and partners.

You will translate complex technical and business trade-offs into clear recommendations, develop TCO models, and drive cross-functional decisions across engineering, supply chain, and commercial teams.

Qualifications

• 8+ years in technical product management or related roles with ownership of hardware or infra products.
• Strong server/data-center infrastructure knowledge (compute, accelerators, networking, storage, power, cooling).
• Ability to define products, roadmaps, evaluate tech options, and drive decisions with incomplete information.
• Experience with TCO modeling, financial analysis, pricing, or cost/performance optimization.
• Proven leadership with technical customers and strategic partners, including executive-level discussions.

Responsibilities

• Define multi-generation GPU and compute hardware roadmaps, evaluating emerging technologies and market trends.
• Own hardware product definition and lifecycle strategy with requirements, architectures, configurations, and targets.
• Partner with engineering, supply chain, OEMs/ODMs through NPI, qualification, deployment, and production readiness.
• Drive platform architecture decisions, standardization, supplier strategy, and OEM-to-ODM evolution.
• Translate customer feedback into product requirements and strategic direction.

Skills

8+ yrs exp

Technical product management

Hardware product management

Infrastructure engineering

Systems engineering

Product strategy

Communication skills

Cross-functional leadership

Education

Bachelor's degree in CS/EE or related

Tools

GPU infrastructure

Job description

Role Overview

Nscale is seeking a Principal Technical Product Manager to help define and deliver the next generation of hardware infrastructure powering large-scale AI workloads.

Nscale is seeking a Principal Technical Product Manager to help define and deliver the next generation of hardware infrastructure powering large-scale AI workloads. You will help own Nscale's GPU and compute hardware portfolio, from long-range technology roadmaps and customer requirements through product definition, NPI, deployment, and lifecycle management. You will also bring a customer-focused perspective to the internal software and tooling we build to automate infrastructure deployment, ensuring our solutions meet the needs of the engineers and operators who use them.

This role requires strong technical judgment, business acumen, and the ability to make complex hardware and infrastructure decisions. You will evaluate trade-offs across performance, cost, reliability, and scalability, working with engineering teams, customers, and strategic partners to define and deliver competitive infrastructure products.

We are looking for someone who can operate across the entire problem: understand emerging hardware, engage deeply with engineers and customers, build a TCO model, develop a roadmap, create a compelling executive presentation, make a recommendation, and drive the organization to a decision.

Key Responsibilities

Hardware Product Strategy & Delivery

• Define and drive multi-generation GPU and compute hardware roadmaps, evaluating emerging technologies, customer requirements, market trends, and infrastructure economics.
• Own hardware product definition, including requirements, reference architectures, configurations, performance targets, and lifecycle strategy.
• Partner with engineering, supply chain, OEMs, ODMs, and technology partners through NPI, qualification, production readiness, and deployment.
• Drive strategic decisions on platform architecture, component selection, standardization, supplier strategy, and OEM-to-ODM evolution.
• Ensure hardware requirements, BOMs, acceptance criteria, and deployment readiness are clearly defined and communicated across teams.

Customer & Strategic Partner Leadership

• Engage directly with sophisticated AI customers to understand workloads, technical requirements, performance priorities, and future infrastructure needs.
• Build trusted relationships with strategic technology partners, including silicon providers, OEMs, and ODMs, aligning roadmaps, technical requirements, and joint development priorities.
• Lead executive and technical discussions with customers and partners, communicating strategy, trade-offs, risks, and recommendations clearly.
• Develop customer-facing product documentation and presentations that explain Nscale's hardware platforms, capabilities, configurations, and roadmap.
• Translate customer feedback and market intelligence into product requirements and strategic direction.

Deployment Products & Building for Scale

• Bring a customer mindset to internal deployment software and tooling, treating deployment engineers and operations teams as users whose workflows, requirements, and experience matter.
• Partner with software engineering teams to define requirements, prioritize features, and improve the usability and effectiveness of deployment automation.
• Connect hardware roadmap decisions to downstream deployment software requirements, readiness, and launch planning.
• Convert deployment and fleet learnings into reusable hardware standards, product improvements, tooling requirements, and roadmap decisions.

Business Strategy & Decision Making

• Develop TCO models, business cases, and financial analyses to evaluate hardware platforms, supplier alternatives, and architecture trade-offs.
• Partner with Commercial and Finance on product pricing, packaging, cost optimization, and long-term infrastructure economics.
• Lead complex cross-functional decisions, balancing performance, cost, reliability, schedule, and customer requirements.
• Create high-quality roadmaps, strategy documents, business cases, and executive presentations that turn technical complexity into clear recommendations.
• Drive alignment and decisions across engineering, operations, supply chain, commercial teams, customers, and executive leadership.

Qualifications & Requirements

• Experience: 8+ years in technical product management, hardware product management, infrastructure engineering, systems engineering, or related roles, with demonstrated ownership of complex hardware or infrastructure products.
• Technical Depth: Strong understanding of server and data-center infrastructure, including compute, accelerators, networking, storage, hardware architecture, power, cooling, and platform lifecycle.
• Product & Strategic Judgment: Proven ability to define products, build roadmaps, evaluate technical alternatives, and drive strategic decisions with incomplete information.
• Business Acumen: Experience with TCO modeling, financial analysis, product economics, pricing, or cost/performance optimization.
• Customer & Partner Leadership: Demonstrated success building trusted relationships with technical customers and strategic partners, including leading executive-level discussions.
• Software Product Judgment: Ability to translate user needs into requirements, priorities, and improvements for internal software products and engineering tools.
• Communication: Exceptional written, verbal, and presentation skills, including the ability to communicate complex technical and business decisions to executive audiences.
• Cross-Functional Leadership: Ability to influence engineering, supply chain, operations, finance, commercial teams, and external partners without direct authority.
• Education: Bachelor's degree in Computer Science, Electrical Engineering, Computer Engineering, or related field, or equivalent practical experience.

Preferred Qualifications

• Experience with GPU infrastructure, accelerated computing, HPC, AI/ML systems, or rack-scale infrastructure.
• Experience at a hyperscaler, AI infrastructure provider, major hardware company, or large-scale cloud/data-center operator.
• Experience working with silicon partners, OEMs, ODMs, and hardware suppliers through NPI and production deployment.
• Familiarity with technologies such as NVLink, PCIe, CXL, InfiniBand/RoCE, NVMe, firmware/BMC, and high-density power and cooling.
• Experience working with AI/ML researchers or infrastructure teams supporting large-scale training and inference.
• Experience shaping internal infrastructure automation, deployment tooling, or fleet management products.

What Success Looks Like

Within the first year, you will independently own a meaningful portion of Nscale's hardware portfolio, build trusted relationships with customers and strategic partners, and drive major infrastructure decisions from concept through launch.

You will combine the technical depth to challenge engineering assumptions, the business judgment to evaluate complex trade-offs, and the communication skills to turn ambiguous problems into clear recommendations and decisions. Your work will directly influence Nscale's hardware strategy, infrastructure economics, customer experience, and ability to deploy AI infrastructure at scale.

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here. Nscale does not accept unsolicited candidate submissions from recruitment agencies.