Senior AI Engineer — AI Tools & Evaluation Lead

NVIDIA; Santa Clara (CA); On-site; USD 224,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA seeks an expert to advance AI tool evaluation and engineering productivity. You will assess AI tools, design reference workflows, and collaborate across teams to improve performance, cost efficiency, and reliability in software engineering tasks.

You will build evaluation pipelines, mentor others, and help shape adoption of AI-native tooling across NVIDIA's engineering ecosystem. This role emphasizes practical results and scalable solutions.

Qualifications

• MS in EE/CS or equivalent experience; 12+ years of work experience.
• Strong understanding of LLMs, machine learning, and agentic AI, incl. models, agents, context, tool use.
• Hands-on experience evaluating AI tools and applying LLMs to software engineering workflows; experiment design and failure analysis.
• Strong software engineering in Python, with Java or Go and extensive scripting.
• Experience building evaluation pipelines, developer tooling, or full-stack apps with API integration and cloud deployment.
• Experience with CI/CD tools like Jenkins, Gitlab CI, Packer, Terraform, Artifactory, Ansible, Chef.
• Understanding distributed systems, microservices, REST APIs; translate results into actionable guidance.
• Ability to work across teams to align and boost productivity.

Responsibilities

• Evaluate AI tools, models, and workflows on NVIDIA engineering tasks, comparing outcomes by quality, latency, and cost.
• Spot opportunities for AI-first approaches and gap analysis against traditional solutions.
• Design and validate reference workflows for coding, testing, and troubleshooting using listed tools.
• Introduce technologies to accelerate massively parallel systems and improve turnaround times.
• Optimize performance and cost by identifying bottlenecks in training, evaluation, and testing pipelines.
• Collaborate with AI product vendors to gain industry insights and share internally.
• Evaluate capabilities with tool vendors and influence NVIDIA's AI ecosystem roadmaps.
• Provide guidance on tool configurations, workflows, and onboarding materials.

Skills

LLMs & AI

Python

Experiment design

CI/CD

Distributed systems

REST APIs

Automation scripting

Cross-team collaboration

Java/Go

Education

MS in EE/CS or equivalent

Tools

Codex

Claude

Cursor

Greptile

CodeRabbit

Job description

NVIDIA seeks an expert to advance AI tool evaluation and engineering productivity. You will assess AI tools, design reference workflows, and collaborate across teams to improve performance, cost efficiency, and reliability in software engineering tasks.

You will build evaluation pipelines, mentor others, and help shape adoption of AI-native tooling across NVIDIA's engineering ecosystem. This role emphasizes practical results and scalable solutions.