Technical Lead: Inference Benchmarking & ML Infra

NVIDIA; California (MO); On-site; USD 224,000 - 356,500; Full time

Benefits offered by this job

Equity options

Comprehensive benefits package

Job summary

NVIDIA is seeking a Technical Lead Manager for AIPerf, their open-source benchmarking platform. This role involves driving the technical roadmap, ensuring the accuracy of benchmark results, and mentoring a high-impact engineering team.

The ideal candidate will have over 8 years of software engineering experience, at least 3 years in a leadership capacity, plus deep understanding of LLM inference mechanics and experience in Kubernetes-native infrastructure.

Competitive salary range for the position is $224,000 – $356,500 USD, along with equity and benefits.

Qualifications

• 8+ years of experience in software engineering, particularly in performance-critical infrastructure.
• 3+ years in an engineering leadership role like tech lead or manager.
• Deep understanding of LLM inference mechanics and their measurements.

Responsibilities

• Drive the technical roadmap for AIPerf’s core infrastructure.
• Ensure accuracy and statistical soundness of benchmark results.
• Hire, mentor, and grow a team of senior engineers.

Skills

Software engineering

Engineering leadership

LLM inference mechanics

Kubernetes-native infrastructure

Education

Bachelor’s degree in Computer Science or related field

Tools

Kubernetes

GPU telemetry tools

Job description

NVIDIA is seeking a Technical Lead Manager for AIPerf, their open-source benchmarking platform. This role involves driving the technical roadmap, ensuring the accuracy of benchmark results, and mentoring a high-impact engineering team.

The ideal candidate will have over 8 years of software engineering experience, at least 3 years in a leadership capacity, plus deep understanding of LLM inference mechanics and experience in Kubernetes-native infrastructure.

Competitive salary range for the position is $224,000 – $356,500 USD, along with equity and benefits.