Senior Software Engineer, AIOps and Observability

Nvidia Corporation in; Santa Clara (CA); On-site; USD 200,000 - 322,000; Full time

Job summary

NVIDIA seeks a Senior Software Engineer to design and develop AIOps and Observability platforms for Finance. You will lead the architecture of observability across cloud, on-premises, data centers, and edge, collaborating with data scientists and engineers to drive ML-based anomaly detection and automated remediation.

The role requires senior-level full-stack expertise, mastery of observability stacks (Prometheus, Grafana, OpenTelemetry), Kubernetes, Docker, and languages such as Go, Python,

Qualifications

• Bachelor's degree in computer science, engineering or related field or equivalent experience.
• 12+ years in product development and full-stack engineering.
• 5+ years in developing/operating observability platforms, preferably cloud-native.
• Strong knowledge of observability tools (Prometheus, Victoria Metrics, Vector, Loki, Grafana, OpenTelemetry).
• Experience with AIOps tools (BigPanda, PagerDuty, Datadog).
• Experience with Kubernetes, Nomad, Docker and microservices; streaming with Kafka/NATS.

Responsibilities

• Lead design, development, and deployment of AIOps/Observability platforms (metrics, logs, traces, events, dashboards).
• Drive technical vision and roadmap for observability initiatives.
• Collaborate with teams and customers to meet requirements and expectations.
• Establish observability standards, guidelines, and processes; evaluate new technologies.
• Provide peer reviews on performance, scalability, security, and correctness.
• Work with data scientists to implement ML models for anomaly detection, forecasting, root cause analysis.
• Develop and operate scalable, reliable distributed systems; handle high traffic workloads.
• Develop AI agents/AI-native tools to detect issues and guide remediation.

Skills

Observability

Kubernetes

Go

Python

Java

C#

Prometheus

Grafana

OpenTelemetry

BigPanda

PagerDuty

Datadog

Education

Bachelor's degree in CS/engineering or related field

Tools

Nomad

Docker

Kafka

NATS

Job description

Senior Software Engineer, AIOps and Observability (Finance)

We are looking for a highly skilled Senior Software Engineer to design and develop AIOps & Observability platforms at NVIDIA. The platforms are used by internal teams to monitor, diagnose, and optimize the products, millions of assets and services in cloud, on-prem, data centers, supply chain, and edge. You will work with a team of engineers, product managers, and partners to define the observability strategy, roadmap, and standard methodologies for NVIDIA. You will also mentor and coach other engineers on observability, machine learning, tools and techniques.

What you will be doing:

• Lead the design, development, and deployment of AIOps & Observability platforms, including metrics, logs, traces, events, alerts, dashboards, and visualizations.
• Drive the technical vision and roadmap for AIOps and Observability initiatives, aligning with business goals and industry best practices.
• Collaborate with other teams and customers to understand their observability needs and provide solutions that meet their requirements and expectations.
• Establish and implement observability standards, guidelines, and processes across NVIDIA. Research, evaluate, and adopt new observability technologies and frameworks that can enhance user experience.
• Provide peer reviews to other engineers including feedback on performance, scalability, security and correctness.
• Work with Data scientists to implement machine learning models for anomaly detection, forecasting, and root cause analysis on logs, metrics, and events. Handle large volumes of data and ensure data quality, security, and compliance.
• Develop and operate scalable, reliable, and distributed systems that can handle high traffic and complex workloads.
• Develop AI agents and AI-native observability tools that help engineers detect, understand, and resolve production issues faster. Build agentic workflows that reason across logs, metrics, traces, events, alerts, topology, and incident history to support anomaly detection, forecasting, root cause analysis, automated debugging, and remediation recommendations.

What we need to see:

• Bachelor's degree in computer science and engineering, or related field, or equivalent experience.
• 12+ years of experience in product development and full stack engineering, with 5+ years of experience in developing and operating observability platforms and solutions, preferably in a cloud-native environment.
• Strong knowledge and experience with observability tools, such as Prometheus, Victoria Metrics, Vector, Loki, Grafana, Alert Manager, Clickhouse, OpenTelemetry, etc.
• Hands-on knowledge in AIOps tools such as BigPanda, PagerDuty, Datadog, etc.
• Experience with Kubernetes, Nomad, Docker, and microservices architectures as well as experience with streaming services to ingest billions of events using NATS, Kafka, etc
• Proficient in one or more programming languages, such as Go, Python, Java, C#, etc.
• Passionate about observability and delivering high-quality internal platforms.
• Experience with developing Observability solutions to monitor On-prem and Public Cloud environments.
• Experience with running large Observability platforms on BareMetal Infrastructure
• Establish scalable data pipelines and instrumentation for collecting, aggregating, and visualizing telemetry and operational metrics.

Ways To Stand Out From The Crowd:

• Deep understanding of implementing Observability solutions to large scale on-prem Infrastructure and Networking.
• Hands-on experience with managing large scale Observability Platforms with LLMs & ML Models and building custom services to ingest billions of metrics and logs from wide range of assets.
• Developed unified cloud observability platform to monitor Network, Compute, Power, Storage, Operating Systems, Security, Applications, SaaS Platforms.
• Demonstrated experience and expertise in using machine learning and Generative AI to develop solutions such as predictive monitoring, incident diagnosis, summarization and correlation.
• Demonstrate proficiency in AI/ML systems, generative AI, or agentic AI frameworks.

NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 200,000 USD - 322,000 USD.

You will also be eligible for equity and benefits .

Applications for this job will be accepted at least until August 4, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.