Senior Inference Technical Product Marketing Manager - Accelerated Computing

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 148,000 - 288,000; Full time

Job summary

NVIDIA Gruppe is seeking a Senior Technical Product Marketing Manager for its rapidly growing data center business. This pivotal role involves understanding the technical capabilities of NVIDIA's inference stack and influencing the company’s technical marketing strategy in AI inference.

You will collaborate closely with engineering and product management teams to craft clear messaging and assets that showcase NVIDIA’s leadership in this domain. The ideal candidate has substantial experience in AI/ML and technical marketing, with strong capabilities in narrative creation for both technical and business audiences.

Qualifications

• 6+ years of experience in LLM, AI/ML development in an engineering role.
• 5+ years of experience in product management or technical product marketing of AI/ML products.
• Deep understanding of modern data-center architectures and accelerated computing.

Responsibilities

• Drive NVIDIA’s inference platform technical go-to-market efforts.
• Develop positioning, messaging, and assets for NVIDIA’s leadership in inference.
• Follow competitive inference announcements and prepare appropriate responses.

Skills

LLM

AI/ML development

Technical product marketing

Deep learning frameworks (PyTorch, TensorFlow, JAX)

Communication skills

Education

BS Degree in Computer Science or Engineering

Master’s Degree preferred

Tools

Triton Inference Server

TensorRT-LLM

Job description

Senior Technical Product Marketing Manager

This role will be located in our rapidly growing data center business and will be pivotal in our inference marketing. You will work closely with engineering to understand the technical capabilities of our inference stack—including GPUs, CPUs, networking, CUDA libraries, model architectures and deployment techniques (parallelisms, configurations, etc.). Your work will influence NVIDIA’s entire technical marketing strategy to showcase our leadership position in AI inference.

What You’ll Be Doing

• Help drive NVIDIA’s inference platform technical go-to-market efforts.
• Work closely with engineering and product management teams to understand key technical capabilities of our inference stack from GPUs, CPUs, networking, CUDA libraries, model architectures and deployment techniques (e.g., parallelisms, configurations, etc.).
• Diligently review and stay up to date on model architectures, frameworks, arXiv papers, whitepapers, and deployment techniques (e.g., disaggregated serving, KV cache implementations), and identify intersection points between the latest AI models and NVIDIA’s platform to maximize performance and minimize TCO.
• Develop crisp, clear positioning, messaging and assets to highlight NVIDIA’s leadership position in inference—assets include blogs, whitepapers, presentations, analyst briefings and seminars at developer conferences.
• Closely follow competitive inference announcements and prepare appropriate responses for business and technical/developer audiences.
• Assist in building keynote slides for executives in areas where you are a subject matter expert.

What We Need to See

• A BS Degree in Computer Science or Engineering or related field, or equivalent experience in a technical product marketing role; Master’s Degree preferred.
• 6+ years of experience in LLM, AI/ML development in an engineering role followed by 5+ years of experience in product management or technical product marketing of AI/ML products.
• Deep understanding of modern data‑center architectures, accelerated computing, distributed inference, deep learning frameworks (PyTorch, TensorFlow, JAX), and inference‑specific frameworks & optimizations (Dynamo, Triton Inference Server, TensorRT‑LLM, vLLM, SGLang).
• Market awareness and experience conducting technical competitive analysis and synthesizing key insights.
• Collaboration & influence—proven ability to work cross‑functionally across engineering, product management, sales, and marketing teams.
• Strong communication, asset creation & storytelling—ability to translate sophisticated technical concepts into clear, compelling narratives for both technical and business audiences.
• Ability to present to executive audiences.

Ways to Stand Out from the Crowd

• Hands‑on experience with AI inferencing workflows using NVIDIA or open‑source serving frameworks running on accelerated computing in the data center.
• Experience developing LLM models.
• Experience working with hyperscale cloud providers.
• Hands‑on technical competence—background in software development, AI infrastructure, data‑center silicon.
• Demonstrated ability to engage with executive leadership and external partners.
• Published technical content or speaking experience at industry events.
• Portfolio of published marketing/launch assets.

Compensation & Benefits

The base salary is determined by location, experience, and market. The base salary range is $148,000 - $235,750 USD for Level4 and $184,000 - $287,500 USD for Level5. You will also be eligible for equity and additional benefits.

Equal Opportunity Employer

NVIDIA is committed to fostering a diverse work environment and proudly is an equal‑opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.