AI Infrastructure Ops Lead – GPU/Kubernetes Performance

Malomatia; Doha; On-site; QAR 180,000 - 300,000; Full time

Job summary

Malomatia is seeking a Senior Consultant for Operations Oversight & Performance of AI infrastructure to ensure GPU runtimes, Kubernetes clusters, and autoscaling meet agreed performance standards.

You will define KPIs, monitor GPU workloads, integrate observability with Prometheus/Grafana, and coordinate with stakeholders to drive continuous improvement while ensuring compliance and security across multi-cluster environments.

Qualifications

• 10 years in GPU and HPC infrastructure operations, service management, or managed-service oversight roles.
• 7+ years Kubernetes experience with GPU workloads at scale.
• Strong knowledge of CNCF ecosystem, operators, CRDs, and GPU-specific features (NVIDIA GPU Operator, DRA).

Responsibilities

• Define, agree, and monitor operational KPIs and SLAs with 3rd party (availability, incident response, resolution times, change success rate, capacity utilization, etc.).
• Escort Operation and hardening of Kubernetes clusters with GPU Operator, device plugins, DRA, MIG/time-slicing, and advanced schedulers (Kueue or equivalents).
• Review GPU-aware scheduling, fair-share/quotas, priority classes, preemption, and multi-tenancy isolation.
• Supervise manages container runtime, AI workloads (training/inference), and autoscaling.
• Review integrate observability (Prometheus/Grafana + DCGM), logging, and GitOps for the runtime layer.
• Support multi-cluster federation and cluster lifecycle (in partnership with Rafay layer).
• Conduct regular operational reviews of Advanced NOC performance, incident trends, problem management, and change records.
• Drive service improvement plans and hold 3rd party accountable for operational performance.

Skills

GPU infrastructure

Kubernetes

Observability

Stakeholder management

Tools

NVIDIA GPU Operator

Prometheus

Grafana

Rafay

Kubernetes CRDs

Job description

Malomatia is seeking a Senior Consultant for Operations Oversight & Performance of AI infrastructure to ensure GPU runtimes, Kubernetes clusters, and autoscaling meet agreed performance standards.

You will define KPIs, monitor GPU workloads, integrate observability with Prometheus/Grafana, and coordinate with stakeholders to drive continuous improvement while ensuring compliance and security across multi-cluster environments.