HPC & GPU SRE - Observability & Reliability

Technology Innovation Institute; Abu Dhabi; Vor Ort; AED 240.000 - 420.000; Vollzeit

Zusammenfassung

Technology Innovation Institute (TII) invites a Site Reliability Engineer to strengthen the AIDRC's HPC and observability capabilities in Abu Dhabi. You will design and maintain observability across large CPU/GPU clusters, build dashboards and alerts, and define SLIs with platform owners and researchers.

You will triage incidents, automate remediation, and collaborate with researchers, developers, and infrastructure teams to improve reliability and capacity planning.

Qualifikationen

• Proven experience in site reliability engineering, HPC operations, or infrastructure operations.
• Strong Linux administration and troubleshooting skills.
• Experience operating clustered CPU/GPU infrastructure and workload orchestration platforms such as Kubernetes or Slurm.
• Hands-on experience with observability tools such as Prometheus, VictoriaMetrics, Grafana, and centralized logging systems.
• Ability to write monitoring queries, investigate telemetry, and design alerts that support timely operational decisions.
• Experience investigating failures across compute, GPU, storage, and network systems.
• Proficiency in Python, Bash, Go, or Rust, or another language used for operational automation.
• Familiarity with infrastructure-as-code, configuration management, and GitOps practices.

Aufgaben

• Design, implement, and maintain observability systems covering infrastructure and workloads through metrics, logs, and traces.
• Develop actionable alerts, dashboards, and health checks for HPC clusters, Kubernetes platforms, GPU workloads, storage, and networking.
• Define service-level indicators and objectives in collaboration with platform owners and research teams.
• Detect, triage, and respond to incidents, coordinating investigation, escalation, mitigation, and service recovery.
• Participate in an on-call rotation and improve operational readiness through runbooks, escalation procedures, and incident exercises.
• Diagnose complex failures and performance degradation, including GPU errors, scheduling issues, storage bottlenecks, and network faults.

Kenntnisse

SRE operations

Linux administration

Kubernetes

Slurm

Observability

Python/Go/Bash

GitOps

Incident management

Ausbildung

Bachelor's or Master's degree in Computer Science or related field

Tools

Prometheus

VictoriaMetrics

Grafana

Jobbeschreibung

Technology Innovation Institute (TII) invites a Site Reliability Engineer to strengthen the AIDRC's HPC and observability capabilities in Abu Dhabi. You will design and maintain observability across large CPU/GPU clusters, build dashboards and alerts, and define SLIs with platform owners and researchers.

You will triage incidents, automate remediation, and collaborate with researchers, developers, and infrastructure teams to improve reliability and capacity planning.