Senior AI Engineer - AI Tooling & Evaluation

NVIDIA Corporation; Santa Clara (CA); Hybrid; USD 224,000 - 357,000; Full time

Job summary

NVIDIA Corporation in Santa Clara, CA is seeking a seasoned AI tools evaluator to advance our engineering workflows and tooling strategies. You will evaluate AI tools, agent harnesses, and models, comparing performance, latency, cost, and enterprise readiness within NVIDIA's engineering contexts.

You will design reference workflows, optimize for throughput and efficiency, collaborate with vendors, and provide practical guidance and training to engineers implementing AI across products and

Qualifications

• MS in EE/CS or equivalent experience.
• 12+ years of work experience in related roles.
• Strong understanding of LLMs, machine learning, and agentic AI.

Responsibilities

• Evaluate emerging and established AI tools, agent harnesses, and models in NVIDIA workflows, comparing performance, latency, and cost.
• Design, implement, and validate reference workflows for coding, testing, code review, and troubleshooting using relevant tools.
• Identify bottlenecks and optimize performance and cost across training, evaluation, and testing workflows.
• Collaborate with AI product vendors to gain deep insights and influence product roadmaps.
• Provide AI tool and model selection guidance, configurations, workflow examples, and onboarding materials.

Skills

Python

Java

Go

Scripting & automation

Experiment design

Benchmarking

REST APIs

Distributed systems

Education

MS in EE/CS or equivalent experience

Tools

Jenkins

Gitlab CI

Packer

Terraform

Artifactory

Ansible

Chef

Job description

NVIDIA Corporation in Santa Clara, CA is seeking a seasoned AI tools evaluator to advance our engineering workflows and tooling strategies. You will evaluate AI tools, agent harnesses, and models, comparing performance, latency, cost, and enterprise readiness within NVIDIA's engineering contexts.

You will design reference workflows, optimize for throughput and efficiency, collaborate with vendors, and provide practical guidance and training to engineers implementing AI across products and