Technical Lead: Inference Benchmarking & ML Infra

NVIDIA; United States; On-site; USD 224,000 - 356,500; Full time

Benefits offered by this job

Equity and benefits

Comprehensive benefits package

Competitive salaries

Job summary

NVIDIA is seeking a Technical Lead Manager for its AIPerf platform in the United States. You will drive technical roadmaps, ensuring performance accuracy and reliability while mentoring senior engineers in a dynamic, open-source environment.

The ideal candidate has extensive experience in performance-critical infrastructure and engineering leadership, with strong knowledge of LLM inference mechanics. Join NVIDIA for competitive pay and comprehensive benefits.

Qualifications

• 8+ years of software engineering experience building performance-critical infrastructure, ML tooling, or distributed systems.
• 3+ years of engineering leadership experience as a tech lead or engineering manager.
• Proven track record delivering production-quality output in high-visibility environments.

Responsibilities

• Drive the technical roadmap for AIPerf’s core infrastructure.
• Take ownership for the accuracy of benchmark results.
• Advise upstream engine integrations and grow a team of senior engineers.

Skills

LLM inference mechanics

Performance-critical infrastructure

Kubernetes-native infrastructure

Collaboration across groups

Education

Bachelor’s degree in Computer Science, Electrical Engineering, or related field

Tools

Kubernetes

Helm

DCGM

Job description

NVIDIA is seeking a Technical Lead Manager for its AIPerf platform in the United States. You will drive technical roadmaps, ensuring performance accuracy and reliability while mentoring senior engineers in a dynamic, open-source environment.

The ideal candidate has extensive experience in performance-critical infrastructure and engineering leadership, with strong knowledge of LLM inference mechanics. Join NVIDIA for competitive pay and comprehensive benefits.