Engineering Manager — GenAI Observability Platform

Segment (Twilio); Santa Clara (CA); Hybrid; USD 224,000 - 431,250; Full time

Job summary

NVIDIA is seeking an Engineering Manager to lead a team building an agentic platform for observing, debugging, and optimizing GenAI models deployed at scale, with visibility into model behavior and performance across large-scale workloads.

You will guide development across logs, traces, metrics, and production AI systems, drive reliability, latency improvements, and cost optimization, and collaborate with stakeholders to align priorities.

Qualifications

• BS/MS/PhD in CS or CE or equivalent experience.
• 8+ years of software engineering experience with 3+ years in management or technical leadership.
• Experience leading teams building large-scale distributed systems and observability platforms.
• Strong knowledge of LLM/VLM inference, production performance challenges.
• Experience with logs, metrics, traces, profiling, alerting, dashboards, or debugging workflows.
• Strong programming, debugging, performance analysis, and test design skills.
• Ability to align technical work with product and business goals.
• Excellent communication and collaboration skills.

Responsibilities

• Lead, mentor, and grow a team building an agentic platform for monitoring and improving large-scale LLMs and VLMs in production.
• Build systems that collect, correlate, and analyze telemetry across inference servers, GPUs, schedulers, model runtimes, and customer-facing APIs.
• Develop agentic workflows to identify root causes, explain regressions, and suggest performance optimizations.
• Collaborate with internal customers and business units to align priorities and deliver production-grade capabilities.

Skills

Team leadership

Distributed systems

Observability platforms

LLM/VLM knowledge

Programming and debugging

Communication skills

Education

BSc, MS, or PhD in CS/CE

Tools

OpenTelemetry

Prometheus

Grafana

Jaeger

ClickHouse

Elastic

Job description

NVIDIA is seeking an Engineering Manager to lead a team building an agentic platform for observing, debugging, and optimizing GenAI models deployed at scale, with visibility into model behavior and performance across large-scale workloads.

You will guide development across logs, traces, metrics, and production AI systems, drive reliability, latency improvements, and cost optimization, and collaborate with stakeholders to align priorities.