Performance Telemetry Engineer - Equity Eligible

NVIDIA Corporation; Santa Clara (CA); Vor Ort; USD 168.000 - 270.000; Vollzeit

Benefits dieser Stelle

Equity

Benefits

Zusammenfassung

NVIDIA is seeking a Software Engineer, Performance Instrumentation, to Santa Clara, CA. You will define data requirements, identify visibility gaps, and collaborate with teams to implement low-overhead instrumentation and ensure data quality across ML and systems workloads.

You will work with CUDA, PyTorch or JAX, NVTX, and Python/C++ to measure overhead and drive reliable instrumentation solutions while communicating findings to engineers and data users.

Qualifikationen

• Bachelor’s degree in Computer Science, Computer Engineering, or a related field, or equivalent experience.
• 8+ years of relevant software engineering experience, including hands-on instrumentation or tracing in production machine learning or systems software.
• Proficiency in CUDA, and working knowledge of machine learning frameworks like PyTorch or JAX, as well as annotation or tracing APIs such as NVTX.
• Demonstrated experience in maintaining data quality in a pipeline, including validation, checks, alerting, and provenance.
• Proven ability to measure instrumentation overhead and make trade-offs among overhead, fidelity, sampling, and aggregation.
• Proven history of implementing modifications in code managed by other groups by identifying requirements, reaching consensus on interfaces, and ensuring completion through to delivery.
• Strong debugging skills across component boundaries and the ability to validate changes through code review, tests, and independent measurements, including using automated development tools.
• Excellent communication skills, especially in conveying evidence, uncertainty, and next steps with engineers and data users.
• Proficiency in Python and C++.

Aufgaben

• Define and maintain the performance data requirements from various sources including profiling libraries, annotation APIs, frameworks, runtimes, communication libraries, schedulers, configurations, and infrastructure telemetry.
• Identify and prove visibility gaps with concrete evidence, demonstrating which diagnoses are not possible with current data.
• Collaborate with relevant teams to address these gaps or build solutions where necessary.
• Inform the build of low-overhead instrumentation and annotation APIs from the perspective of the consumer, ensuring the necessary information is conveyed efficiently and effectively.
• Ensure data quality at ingestion by implementing validation, sanitization, checks, and alerting mechanisms, so that any gaps or errors are detected before impacting users or automated analysis.
• Measure and manage the overhead and observer effects of instrumentation on real workloads, ensuring they remain within acceptable limits.
• Collaborate with multiple partner teams simultaneously, managing commitments and ensuring continuous progress.

Kenntnisse

Python

C++

CUDA

PyTorch

JAX

Ausbildung

Bachelor’s degree in Computer Science or related field

Tools

NVTX

Jobbeschreibung

NVIDIA is seeking a Software Engineer, Performance Instrumentation, to Santa Clara, CA. You will define data requirements, identify visibility gaps, and collaborate with teams to implement low-overhead instrumentation and ensure data quality across ML and systems workloads.

You will work with CUDA, PyTorch or JAX, NVTX, and Python/C++ to measure overhead and drive reliable instrumentation solutions while communicating findings to engineers and data users.