Engineering Manager, Agentic GenAI Observability

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 224,000 - 431,250; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking an Engineering Manager to lead the development of an agentic platform for observing, debugging, and optimizing GenAI models deployed at scale. You will guide a team to build visibility into model behavior, inference performance, reliability, and cost across large-scale workloads.

This role spans across the NVIDIA AI software stack, collaborating with teams in inference serving, model optimization, distributed systems, and production operations.

Qualifications

• BSc, MS, or PhD in Computer Science, Computer Engineering, or equivalent experience.
• 8+ years of relevant software engineering experience, including 3+ years in management.
• Experience leading software teams building large-scale distributed systems and observability platforms.
• Strong understanding of LLM/VLM inference and production performance challenges.
• Experience with logs, metrics, traces, profiling, alerting, dashboards, or incident workflows.
• Excellent communication and collaboration skills.

Responsibilities

• Lead, mentor, and grow a team building an agentic platform for monitoring and improving large-scale LLMs and VLMs in production.
• Build systems that collect, correlate, and analyze telemetry across inference servers, GPUs, schedulers, model runtimes, and customer-facing APIs.
• Develop agentic workflows that help engineers identify root causes, explain regressions, and recommend performance optimizations.
• Collaborate with internal customers and business units to align priorities and deliver production grade platform capabilities.

Skills

Team leadership

Distributed systems

Observability platforms

ML infrastructure

Performance analysis

Communication

Cross-functional collaboration

Education

BSc/MS/PhD in CS/CE

Tools

OpenTelemetry

Prometheus

Grafana

Jaeger

ClickHouse

Elastic

Job description

NVIDIA is seeking an Engineering Manager to lead the development of an agentic platform for observing, debugging, and optimizing GenAI models deployed at scale. You will guide a team to build visibility into model behavior, inference performance, reliability, and cost across large-scale workloads.

This role spans across the NVIDIA AI software stack, collaborating with teams in inference serving, model optimization, distributed systems, and production operations.