GPU Observability & Scale Engineer

1000 Kyndryl, Inc.

Dallas (TX)

On-site

USD 115,000 - 219,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Restaurant d'entreprise
Indemnités de travail à distance

Job summary

Kyndryl Inc. is seeking an experienced Observability/Monitoring Specialist to own NVIDIA AI infrastructure observability, capacity forecasting and scaling decisions.

You will build dashboards, define health metrics, and partner with platform operations and architecture teams to drive data-driven capacity planning. Responsibilities include implementing and maintaining monitoring with DCGM, Prometheus and Grafana, analyzing time-series data, and delivering evidence-based recommendations for

Qualifications

  • Experience in infrastructure monitoring, observability, performance analysis, or capacity management.
  • Hands-on experience with Prometheus, Grafana, or comparable monitoring platforms.
  • Experience analyzing time-series data and translating trends into operational recommendations.
  • Working knowledge of Linux, containers, GPU infrastructure, and distributed platforms.

Responsibilities

  • Implement and maintain monitoring using DCGM, Prometheus, Grafana, and related telemetry sources.
  • Define service health, GPU, fabric, storage, queue, workload, and utilization measures.
  • Build dashboards, alerts, thresholds, and operational views for platform teams and leaders.
  • Analyze utilization, queue depth, workload demand, bottlenecks, and capacity trends.
  • Develop forecasts, scaling triggers, and evidence-based capacity recommendations.
  • Partner with platform operations, FDE, architecture, finance, and customer teams on demand and growth planning.
  • Validate monitoring coverage during deployment and maintain baselines through the lifecycle.
  • Improve data quality and automate recurring performance and capacity reporting.

Skills

NVIDIA DCGM
Prometheus
Grafana
GPU Monitoring
Observability
Capacity Planning
Utilization Analysis
Performance Analysis
Forecasting
Scaling Triggers
Dashboard Development

Tools

Prometheus
Grafana
Run:ai Scheduler
Kubernetes scheduling

Job description

Kyndryl Inc. is seeking an experienced Observability/Monitoring Specialist to own NVIDIA AI infrastructure observability, capacity forecasting and scaling decisions.

You will build dashboards, define health metrics, and partner with platform operations and architecture teams to drive data-driven capacity planning. Responsibilities include implementing and maintaining monitoring with DCGM, Prometheus and Grafana, analyzing time-series data, and delivering evidence-based recommendations for

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GPU Infra Observability & Scale Engineer - Remote
GPU Infra Observability & Scale Engineer - Remote

Kyndryl Inc. • Frisco (TX)

Hybrid
USD 115,000 - 219,000
Annual bonus
Comprehensive benefits
Observability & Scale Engineer
Observability & Scale Engineer

Kyndryl Inc. • Frisco (TX)

Hybrid
USD 115,000 - 219,000
Annual bonus
Comprehensive benefits
Observability & Scale Engineer
Observability & Scale Engineer

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 115,000 - 219,000
Restaurant d'entreprise
Indemnités de travail à distance
AI Validation & Automation Engineer - Production Readiness
AI Validation & Automation Engineer - Production Readiness

Kyndryl Inc. • Frisco (TX)

Hybrid
USD 144,000 - 273,000
Medical insurance
Dental insurance
Disability insurance
+4
AI Platform Engineer, Kubernetes & NVIDIA Stack
AI Platform Engineer, Kubernetes & NVIDIA Stack

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 115,000 - 219,000
Discretionary annual bonus
Medical and dental coverage
Paid leave
AI Infra Engineer for High-Performance GPU Clusters
AI Infra Engineer for High-Performance GPU Clusters

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 144,000 - 273,000
Annual bonus
Medical & dental
Retirement plan
+1
Forward-Deployed AI Platform Engineer (NVIDIA & Kubernetes)
Forward-Deployed AI Platform Engineer (NVIDIA & Kubernetes)

Kyndryl Inc. • Frisco (TX)

Hybrid
USD 115,000 - 219,000
Discretionary annual bonus
Medical and dental coverage
Retirement benefits
+1
Senior AI/HPC Observability Engineer
Senior AI/HPC Observability Engineer

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits
AI Platform Reliability Engineer
AI Platform Reliability Engineer

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 144,000 - 273,000
Discretionary annual bonus
Comprehensive benefits package
AI Platform Reliability Engineer
AI Platform Reliability Engineer

Kyndryl Inc. • Frisco (TX)

Hybrid
USD 144,000 - 273,000
Medical coverage
Dental coverage
Disability benefits
+3