Senior Director, AI Inference Compute

Tensordyne; Sunnyvale (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Tensordyne seeks an experienced Sr./Director of Technical Product Management to own AI inference compute in datacenters—from silicon to software. You will report to the VP of Product Management, guiding product efforts across hardware, software, and infrastructure to shape inference for enterprise customers.

You will work with partners and internal teams to craft strategy, roadmaps, and compelling value propositions.

Qualifications

• Deep knowledge of AI inference systems, MoE models, and world models.
• Ability to translate technical concepts into customer value propositions.
• Experience defining product roadmaps, requirements, and success metrics.
• Proven leadership in cross-functional teams and GTM collaboration.

Responsibilities

• Define Tensordyne's next-gen AI inference products and roadmap.
• Engage with partners, customers, researchers, and internal stakeholders.
• Drive competitive analysis, metrics, cost modeling, and product release plans.
• Oversee key customer projects and anticipate hardware and software needs.
• Collaborate with marketing to promote AI technology and thought leadership.
• Occasionally represent the company at conferences.

Skills

MoE models

AI inference

KV cache

Inference servers

Parallelization

System performance

Tech economics

Education

BS/MS in CS/CE

Tools

Model compilers

Runtime environments

Inference frameworks

Job description

Tensordyne seeks an experienced Sr./Director of Technical Product Management to own AI inference compute in datacenters—from silicon to software. You will report to the VP of Product Management, guiding product efforts across hardware, software, and infrastructure to shape inference for enterprise customers.

You will work with partners and internal teams to craft strategy, roadmaps, and compelling value propositions.