Tech Lead Manager, AI Inference Benchmarking

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 224,000 - 356,500; Full time

Benefits offered by this job

Equity options

Comprehensive benefits package

Flexible working environment

Job summary

NVIDIA Gruppe in Santa Clara is seeking a Technical Lead Manager to lead the AIPerf engineering team. In this role, you will be responsible for advancing the AIPerf platform as the leading benchmarking tool in AI performance measurement.

Candidates should have over 8 years of software engineering experience, including 3 years in leadership roles. The position offers a competitive salary ranging from $224,000 to $356,500.

Qualifications

• 8+ years of software engineering experience building performance-critical infrastructure.
• 3+ years of engineering leadership experience as a tech lead or engineering manager.
• Deep understanding of LLM inference mechanics.

Responsibilities

• Drive technical roadmap for AIPerf’s core infrastructure.
• Ensure accuracy and statistical soundness of benchmark results.
• Mentor and grow a team of senior engineers.

Skills

Leadership

Collaboration

Software Engineering

In-depth Knowledge of LLM Inference

Education

Bachelor's degree in Computer Science or related field

Tools

Kubernetes

ZMQ

Prometheus

Job description

NVIDIA Gruppe in Santa Clara is seeking a Technical Lead Manager to lead the AIPerf engineering team. In this role, you will be responsible for advancing the AIPerf platform as the leading benchmarking tool in AI performance measurement.

Candidates should have over 8 years of software engineering experience, including 3 years in leadership roles. The position offers a competitive salary ranging from $224,000 to $356,500.