AI Hardware Product Manager - Benchmarking & Strategy

Artificial Analysis; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Equity

Job summary

Artificial Analysis in San Francisco is hiring a Product Manager for AI hardware benchmarks, designing and running performance tests across GPUs, TPUs, and custom silicon.

You will extend our hardware benchmarking stack, build cost and throughput models, and work directly with leading chipmakers to benchmark their latest silicon. This is a technical, hands-on role at the intersection of silicon and AI, reporting to the hardware pillar lead.

Qualifications

• 3+ years of professional experience, including at least 2 years at an AI chip company (e.g. NVIDIA, Cerebras, SambaNova, Groq or similar)
• Strong analytical and critical thinking skills
• Proficiency in Python and data analysis
• Deep familiarity with AI accelerators and the inference software stack (e.g. CUDA, TensorRT, vLLM or similar serving frameworks)
• Understanding of inference economics: cost-per-token, utilization, and the trade-offs that drive real deployment decisions
• Genuine, demonstrable interest and knowledge of Frontier AI.

Responsibilities

• Benchmark AI Accelerators: Design and execute performance benchmarking across GPUs, TPUs and custom inference silicon, measuring throughput, latency and price-performance the way the industry actually deploys
• Build Evaluation Methodology: Develop and maintain the frameworks that define how AI hardware performance and efficiency are measured, extending products like AA-AgentPerf, from tokens per second and time-to-first-token to total cost of ownership
• Analyze Inference Economics: Deeply understand how cost-per-token, utilization and hardware choice interact, and translate that into analysis the industry relies on for deployment and procurement decisions
• Partner with Chipmakers: Work with the top hardware companies in the world, from NVIDIA, AMD and Google to the leading new accelerator companies, at a deep technical level: benchmarking their latest silicon, shaping methodology together, and setting the standards the industry measures by
• Drive Strategic Analysis: Produce reports and data visualizations that communicate hardware performance and economics to technical and non-technical audiences
• Become AI-Native: Embrace an AI-native workflow, using cutting-edge AI tools to generate leverage in a fast-changing industry and maintain our competitive edge in AI benchmarking

Skills

Python

Data analysis

Analytical thinking

CUDA

TensorRT

vLLM

Frontier AI

Job description

Artificial Analysis in San Francisco is hiring a Product Manager for AI hardware benchmarks, designing and running performance tests across GPUs, TPUs, and custom silicon.

You will extend our hardware benchmarking stack, build cost and throughput models, and work directly with leading chipmakers to benchmark their latest silicon. This is a technical, hands-on role at the intersection of silicon and AI, reporting to the hardware pillar lead.