AIOps Engineer

Diverse Consulting Group; Polska; Hybrid; PLN 260,000 - 380,000; Full time

Benefits offered by this job

Private medical care

Co-financing for sports card

Training & learning opportunities

Dedicated consultant support

Job summary

Diverse Consulting Group is hiring for a DevOps/SRE role focused on AI infrastructure and MLOps. You will design and operate vLLM inference services on OpenShift/Kubernetes running on bare-metal GPUs, manage NVIDIA resources, and automate model lifecycles from onboarding to rollback.

Strong observability, CI/CD, and security practices are essential. The role requires deep expertise in Kubernetes/OpenShift, GPU tooling, and scalable infrastructure.

Qualifications

• 5+ years in DevOps, SRE, Platform Engineering, or Infra Operations.
• 2+ years supporting MLOps, AI infra, or LLM platforms.
• Production experience with Kubernetes/OpenShift.
• Experience deploying vLLM-based inference platforms.

Responsibilities

• Design, deploy, and maintain vLLM inference services on OpenShift/Kubernetes on GPU hardware.
• Manage NVIDIA GPU resources including partitioning and allocation.
• Automate model lifecycle management and deployment processes.
• Implement and optimize HPA based on workload and GPU usage.
• Build observability using metrics, logging, and tracing.
• Instrument endpoints to expose token, latency, and throughput metrics.
• Develop usage tracking for API keys, users, teams, or departments.
• Create Grafana dashboards for infrastructure and consumption metrics.
• Configure Prometheus and Alertmanager for proactive monitoring and alerts.
• Implement API Gateway for auth, rate limiting, and routing.
• Ensure secure operation through network segmentation and secure practices.
• Maintain audit logging for compliance and governance.
• Collaborate with AI/Platform/Security/Infra teams for reliable services.
• Participate in troubleshooting, incident response, and platform improvements.

Skills

Kubernetes

OpenShift

GPU management

Python

Prometheus

Grafana

OpenTelemetry

ELK Stack

GitLab CI

Jenkins

ArgoCD

IaC

Linux admin

Bash scripting

MLOps

Tools

OpenShift

Kubernetes

NVIDIA GPU tech

Job description

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Responsibilities:

• Design, deploy, and maintain vLLM inference services on OpenShift/Kubernetes running on bare-metal GPU infrastructure
• Manage NVIDIA GPU resources, including GPU partitioning and allocation, to maximize utilization across multiple models and tenants
• Automate model lifecycle management, including model onboarding, versioning, deployment, hot-swapping, and rollback from private registries such as Hugging Face Enterprise and S3
• Implement and manage Horizontal Pod Autoscaling (HPA) based on workload demand, queue depth, and GPU resource utilization.Optimize vLLM configurations and serving parameters to maximize performance, throughput, and resource efficiency
• Build and maintain observability and monitoring solutions for AI inference services, including metrics collection, logging, and tracing
• Instrument vLLM endpoints to expose metrics related to token consumption, latency, throughput, and error rates
• Develop usage tracking mechanisms to monitor token consumption by API key, user, team, or department, supporting quota management and chargeback/showback requirements
• Create and maintain Grafana dashboards covering infrastructure health, GPU utilization, inference performance, service availability, and business consumption metrics
• Configure proactive monitoring and alerting using Prometheus and Alertmanager to detect infrastructure failures, performance degradation, and unusual consumption patterns
• Implement and maintain API Gateway solutions to provide authentication, authorization, rate limiting, and intelligent routing to inference services
• Ensure secure operation of AI services through network segmentation, ingress and egress controls, and adherence to security best practices
• Maintain audit logging capabilities to support compliance, security investigations, and operational governance
• Collaborate with AI Engineering, Platform Engineering, Security, and Infrastructure teams to deliver reliable, scalable, and secure AI services
• Participate in troubleshooting, incident response, root cause analysis, and continuous platform improvement initiatives

Requirements:

• 5+ years of experience in DevOps, Site Reliability Engineering (SRE), Platform Engineering, or Infrastructure Operations
• At least 2 years of hands-on experience supporting MLOps, AI Infrastructure, or Large Language Model (LLM) platforms
• Strong experience with Kubernetes and OpenShift administration in production environments
• Proven experience deploying and operating vLLM-based inference platforms in production
• Strong understanding of LLM serving concepts, including Paged Attention, continuous batching, and inference optimization techniques
• Deep knowledge of NVIDIA GPU technologies, CUDA drivers, NVIDIA Container Toolkit, and GPU troubleshooting.Hands-on experience with Prometheus, Grafana, OpenTelemetry, and ELK Stack
• Experience building observability solutions, including custom metrics, exporters, dashboards, and alerting mechanisms
• Strong Python programming skills with experience developing automation and operational tooling
• Experience with Bash scripting and Linux systems administration
• Familiarity with GitLab CI, Jenkins, ArgoCD, and Infrastructure-as-Code practices
• Strong analytical and problem-solving skills with the ability to work in complex, distributed environments
• Excellent communication and collaboration skills

Offer:

• Private medical care
• Co-financing for the sports card
• Training & learning opportunities
• Constant support of dedicated consultant