Senior AI Engineer — AI Tooling & Evaluation Lead

NVIDIA Corporation; Santa Clara (CA); On-site; USD 224,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation is seeking a senior AI tools engineer to evaluate AI tools, models, and agent harnesses within engineering workflows. You will design reference workflows, benchmark performance, and provide practical guidance for tool adoption across teams.

The role emphasizes Python expertise, CI/CD practices, and scalable tooling. Base salary is a range with equity and benefits; location in Santa Clara, CA.

Qualifications

• MS in EE/CS or equivalent experience.
• 12+ years of work experience.
• Strong understanding of LLMs, ML, and agentic AI.
• Hands-on evaluating AI tools or models in software engineering workflows.
• Strong Python skills; Java or Go.
• Experience building evaluation pipelines and tooling.
• CI/CD tools like Jenkins or GitLab CI.
• Distributed systems and REST APIs.
• Translate evaluation results into actionable recommendations.

Responsibilities

• Evaluate emerging AI tools, agent harnesses, and models on NVIDIA workflows, comparing task success, output quality, reliability, latency, cost, and readiness.
• Identify opportunities where AI is the best tool.
• Uncover gaps and recommend AI-first approaches over traditional solutions.
• Design, implement, and validate reference workflows for coding, testing, and troubleshooting with AI tools.
• Collaborate with AI vendors to gain industry insights and share with leaders and developers.
• Provide AI tool and model selection guidance, configurations, and onboarding materials.

Skills

LLM & AI concepts

Python

Java or Go

Experiment design

Automation scripting

Cross-functional collaboration

REST APIs

Education

MS in EE/CS or equivalent

Tools

Jenkins

GitLab CI

Packer

Terraform

Artifactory

Ansible

Chef

Job description

NVIDIA Corporation is seeking a senior AI tools engineer to evaluate AI tools, models, and agent harnesses within engineering workflows. You will design reference workflows, benchmark performance, and provide practical guidance for tool adoption across teams.

The role emphasizes Python expertise, CI/CD practices, and scalable tooling. Base salary is a range with equity and benefits; location in Santa Clara, CA.