AI Reliability Engineer - Agentic Observability & Equity

NVIDIA Corporation; Santa Clara (CA); On-site; USD 168,000 - 270,000; Full time

Job summary

NVIDIA is seeking a Software Engineer for the BizApps SRE team to guarantee reliable, efficient, and scalable AI-powered applications across the enterprise. You will craft tooling and instrumentation to enable BizApps teams to release AI-powered products faster.

Your base salary will be determined based on location and experience, with a base salary range of 168,000 USD - 270,250 USD and eligibility for equity and benefits.

Qualifications

• BS or MS in Computer Science, Software Engineering, or a related field.
• 8+ years of software engineering experience in production systems.
• Strong Python and modern CI/CD tooling experience.
• Hands-on container orchestration with Kubernetes and Docker and cloud infra.
• Experience with observability platforms like Datadog, OpenTelemetry, Grafana, or Prometheus.
• SRE/DevOps mindset with ownership of production systems.

Responsibilities

• Build and implement observability solutions for agentic AI applications in production, including metrics, tracing, logging, and alerting.
• Develop and sustain deployment pipelines and reliability tools for the Agentic AI Factory model.
• Partner with AI application teams to define SLOs/SLIs and ensure production readiness for new agent deployments.
• Instrument LLM-based workflows for performance, cost, and quality monitoring, covering multi-step reasoning chains, token usage, and tool orchestration.
• Drive incident response, root cause analysis, and reliability improvements for BizApps AI services.
• Identify and close observability gaps outstanding to agentic AI systems, such as hallucination detection and orchestration failure tracing.
• Work jointly with platform, data, and application engineering groups to integrate reliability throughout the development lifecycle.

Skills

Python

CI/CD

Distributed systems

SRE

Education

BS in Computer Science or related

MS in Computer Science or related

Tools

Kubernetes

Docker

Datadog

OpenTelemetry

Grafana

Prometheus

Job description

NVIDIA is seeking a Software Engineer for the BizApps SRE team to guarantee reliable, efficient, and scalable AI-powered applications across the enterprise. You will craft tooling and instrumentation to enable BizApps teams to release AI-powered products faster.

Your base salary will be determined based on location and experience, with a base salary range of 168,000 USD - 270,250 USD and eligibility for equity and benefits.