AIOps Engineer: AI Infra, GPU & Observability

DCG; Województwo mazowieckie; On-site; PLN 180,000 - 240,000; Full time

Benefits offered by this job

Private medical care

Sports card subsidy

Training opportunities

Consultant support

Job summary

DCG is seeking an experienced DevOps/Platform Engineer to design, deploy, and manage vLLM-based AI inference services on OpenShift/Kubernetes with bare-metal GPUs. You will optimize GPU utilization, automate model lifecycle management, and build comprehensive observability across metrics, logs, and traces.

The role requires deep knowledge of NVIDIA GPUs, vLLM serving concepts, and strong Python/CI tooling. You will collaborate with multiple engineering teams to ensure secure, scalable AI

Qualifications

• 5+ years in DevOps, SRE, Platform Engineering, or Infrastructure Operations.
• At least 2 years hands-on experience supporting MLOps, AI Infra, or LLM platforms.
• Strong experience with Kubernetes and OpenShift administration in production.
• Proven experience deploying and operating vLLM-based inference platforms.
• Deep knowledge of NVIDIA GPU technologies, CUDA drivers, NVIDIA Container Toolkit, and GPU troubleshooting.
• Hands-on experience with Prometheus, Grafana, OpenTelemetry, and ELK Stack.
• Experience building observability solutions, including custom metrics, exporters, dashboards, and alerting.
• Strong Python programming skills with automation and tooling.
• Bash scripting and Linux systems administration.
• Familiarity with GitLab CI, Jenkins, ArgoCD, and Infrastructure-as-Code practices.
• Strong analytical and problem-solving skills; excellent communication and collaboration.

Responsibilities

• Design, deploy, and maintain vLLM inference services on OpenShift/Kubernetes on bare-metal GPU infrastructure.
• Manage NVIDIA GPU resources, including partitioning and allocation for multi-model use across tenants.
• Automate model lifecycle management: onboarding, versioning, deployment, hot-swapping, rollback from private registries.
• Implement and manage Horizontal Pod Autoscaling based on workload and GPU utilization.
• Build and maintain observability/monitoring for AI inference: metrics, logs, traces.
• Instrument vLLM endpoints to expose token, latency, throughput, and error-rate metrics.
• Develop usage tracking for token consumption by API key, user, team, or department (quotas, chargeback).
• Create Grafana dashboards for infrastructure health, GPU utilization, inference performance, and business metrics.
• Configure proactive monitoring/alerts with Prometheus and Alertmanager for failures and anomalies.
• Implement API Gateway for auth, rate limiting, and intelligent routing to inference services.
• Ensure secure operation via network segmentation, ingress/egress controls, and security best practices.
• Maintain audit logging for compliance, security investigations, and governance.
• Collaborate with AI Eng, Platform Eng, Security, and Infra teams to deliver reliable, scalable AI services.
• Participate in troubleshooting, incident response, root cause analysis, and platform improvements.

Skills

Kubernetes

OpenShift

vLLM

Python

Bash

Prometheus

Grafana

OpenTelemetry

ELK Stack

NVIDIA GPUs

GitLab CI

Jenkins

ArgoCD

IaC

Communication

Tools

GitLab CI

Jenkins

ArgoCD

Job description

DCG is seeking an experienced DevOps/Platform Engineer to design, deploy, and manage vLLM-based AI inference services on OpenShift/Kubernetes with bare-metal GPUs. You will optimize GPU utilization, automate model lifecycle management, and build comprehensive observability across metrics, logs, and traces.

The role requires deep knowledge of NVIDIA GPUs, vLLM serving concepts, and strong Python/CI tooling. You will collaborate with multiple engineering teams to ensure secure, scalable AI