Senior AI Platform Engineer - Evaluator & Agentic Systems

NVIDIA Corporation

Santa Clara (CA)

On-site

USD 184,000 - 357,000

Full time

13 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

NVIDIA Corporation is seeking a Senior Software Engineer to help build NeMo Platform, focusing on NeMo Evaluator for evaluating AI agents at scale. You’ll design Python-first APIs, SDK workflows, and plugin interfaces across runtimes, building systems to observe behavior, measure progress, and drive product decisions.

You will lead with senior technical oversight, mentor teammates, and improve reliability and performance.

Qualifications

  • BS, MS in Computer Science, Computer Engineering, or a related field.
  • 5+ years of professional software engineering experience building production systems.
  • Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis.
  • Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces.
  • Experience with distributed systems, cloud-native services, containers, Kubernetes, or job orchestration.
  • Strong understanding of reliability, scalability, security, and performance tradeoffs in production infrastructure.
  • Experience with Pydantic, typed schemas, event/trace models, or SDK-generated types.
  • Ability to work independently, define technical scope, and collaborate across teams.

Responsibilities

  • Design and implement Python-first APIs, SDK workflows, and plugin interfaces.
  • Build reusable systems for observing behavior, measuring progress, and detecting regressions.
  • Ingest, normalize, validate, and analyze agent execution data and evaluation datasets.
  • Collaborate with research, product, platform, and infra teams to broaden capabilities.
  • Turn evaluation techniques into reliable, reusable product features.
  • Improve reliability, observability, debugging, and performance across NeMo Platform.
  • Develop strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows.
  • Drive fast iteration with ownership and pragmatic decisions under production constraints.
  • Provide senior technical leadership through design reviews and mentoring.

Skills

Python engineering
API design
Typing
Testing
Debugging
Performance analysis
Distributed systems
Cloud-native
Kubernetes
SDK design
Event models
Pydantic
Typed schemas
Independent work
Clear communication

Education

BS in CS/CE
MS in CS/EE

Tools

Docker
Kubernetes

Job description

NVIDIA Corporation is seeking a Senior Software Engineer to help build NeMo Platform, focusing on NeMo Evaluator for evaluating AI agents at scale. You’ll design Python-first APIs, SDK workflows, and plugin interfaces across runtimes, building systems to observe behavior, measure progress, and drive product decisions.

You will lead with senior technical oversight, mentor teammates, and improve reliability and performance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer: AI Agentic Platform Core
Senior Software Engineer: AI Agentic Platform Core

NVIDIA Corporation • Colorado

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior AI Platform Engineer — Agentic Core & Plugins
Senior AI Platform Engineer — Agentic Core & Plugins

NVIDIA Corporation • Washington

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Software Engineer – AI Agentic Core & Plugins
Senior Software Engineer – AI Agentic Core & Plugins

NVIDIA Corporation • United States

Remote
USD 200,000 - 320,000
Equity
Benefits package
Senior AI Platform Engineer: Core, Open Source, Kubernetes
Senior AI Platform Engineer: Core, Open Source, Kubernetes

NVIDIA Corporation • Texas

On-site
USD 224,000 - 357,000
Senior Software Engineer, Agentic Systems
Senior Software Engineer, Agentic Systems

2100 NVIDIA USA • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Senior Software Engineer, NeMo Helix Core Platform
Senior Software Engineer, NeMo Helix Core Platform

NVIDIA Corporation • California

On-site
USD 184,000 - 357,000
Senior Software Engineer, NeMo Helix Core — AI Agent Orchestration
Senior Software Engineer, NeMo Helix Core — AI Agent Orchestration

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Software Engineer, NeMo Helix Core Platform
Senior Software Engineer, NeMo Helix Core Platform

NVIDIA Corporation • Colorado

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Software Engineer, NeMo Helix Core Platform
Senior Software Engineer, NeMo Helix Core Platform

NVIDIA Corporation • California

On-site
USD 184,000 - 357,000
Senior AI Agent Evaluation Engineer
Senior AI Agent Evaluation Engineer

NVIDIA Corporation • Santa Clara (CA)

On-site
CAD 263,000 - 510,000
Equity
Comprehensive benefits