AIOps Engineer (m/f/d) AI Infrastructure & Orchestration

Telekom; Województwo mazowieckie; Hybrid; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Remote work options

Hybrid work model

Contract of Employment

Job summary

T-Hub Polska in Warsaw is seeking an AIOps Engineer to design, deploy, and maintain vLLM inference services on OpenShift/Kubernetes running on bare-metal GPU infrastructure. You will manage NVIDIA GPU resources to maximize usage across models and tenants.

The role focuses on automation, observability, and security, covering model lifecycle management, HPA, and monitoring dashboards in Grafana, with teams across AI and Platform collaborating. Remote/hybrid work options are available.

Qualifications

• 5+ years of experience in DevOps, SRE, Platform Engineering, or Infrastructure Operations.
• At least 2 years hands-on in supporting MLOps, AI infrastructure, or LLM platforms.
• Strong Kubernetes and OpenShift in production.
• Proven experience deploying vLLM-based inference platforms.
• Deep knowledge of NVIDIA GPU tech, CUDA drivers, NVIDIA Container Toolkit.
• Hands-on with Prometheus, Grafana, OpenTelemetry, and ELK Stack.
• Strong Python and automation tooling.
• Bash scripting and Linux systems administration.
• Familiarity with GitLab CI, Jenkins, ArgoCD, and Infrastructure-as-Code.
• Strong analytical and problem-solving skills.

Responsibilities

• Design, deploy, and maintain vLLM inference services on OpenShift/Kubernetes on bare-metal GPU.
• Manage NVIDIA GPU resources for multi-model/tenant workloads.
• Automate model lifecycle management with private registries.
• Implement and manage HPA based on workload and GPU usage.
• Optimize vLLM configurations for performance and resource efficiency.
• Build observability: metrics, logging, tracing.
• Instrument endpoints to expose token usage, latency, throughput, errors.
• Develop usage tracking for API keys, users, teams with quota management.
• Set up Prometheus/Alertmanager monitoring and dashboards.
• Implement API gateway with auth, rate limits, and intelligent routing.
• Ensure security, network segmentation, audit logging.
• Collaborate with AI, Platform, Security, and Infrastructure teams.
• Participate in troubleshooting, incident response, and continuous improvement.

Skills

Kubernetes

OpenShift

Python

Linux systems administration

Bash scripting

CI/CD automation

Observability

OpenTelemetry

Prometheus

Grafana

NVIDIA GPU tech

ELK Stack

ArgoCD

GitLab CI

Infrastructure as Code

Troubleshooting

Tools

NVIDIA Container Toolkit

CUDA drivers

OpenShift

Prometheus

Grafana

OpenTelemetry

ELK Stack

ArgoCD

GitLab CI

Job description

Job ID: 3571734AIOps Engineer (m/f/d) AI Infrastructure & OrchestrationWarsawProfessionalApplication deadline: 31.10.2026Regular (Part Time Possible)T-Hub PolskaYour TaskDesign, deploy, and maintain vLLM inference services on OpenShift/Kubernetes running on bare-metal GPU infrastructure.Manage NVIDIA GPU resources, including GPU partitioning and allocation, to maximize utilization across multiple models and tenants.Automate model lifecycle management, including model onboarding, versioning, deployment, hot-swapping, and rollback from private registries such as Hugging Face Enterprise and S3.Implement and manage Horizontal Pod Autoscaling (HPA) based on workload demand, queue depth, and GPU resource utilization.Optimize vLLM configurations and serving parameters to maximize performance, throughput, and resource efficiency.Build and maintain observability and monitoring solutions for AI inference services, including metrics collection, logging, and tracing.Instrument vLLM endpoints to expose metrics related to token consumption, latency, throughput, and error rates.Develop usage tracking mechanisms to monitor token consumption by API key, user, team, or department, supporting quota management and chargeback/showback requirements.Create and maintain Grafana dashboards covering infrastructure health, GPU utilization, inference performance, service availability, and business consumption metrics.Configure proactive monitoring and alerting using Prometheus and Alertmanager to detect infrastructure failures, performance degradation, and unusual consumption patterns.Implement and maintain API Gateway solutions to provide authentication, authorization, rate limiting, and intelligent routing to inference services.Ensure secure operation of AI services through network segmentation, ingress and egress controls, and adherence to security best practices.Maintain audit logging capabilities to support compliance, security investigations, and operational governance.Collaborate with AI Engineering, Platform Engineering, Security, and Infrastructure teams to deliver reliable, scalable, and secure AI services.Participate in troubleshooting, incident response, root cause analysis, and continuous platform improvement initiatives.Your Profile5+ years of experience in DevOps, Site Reliability Engineering (SRE), Platform Engineering, or Infrastructure Operations.At least 2 years of hands-on experience supporting MLOps, AI Infrastructure, or Large Language Model (LLM) platforms.Strong experience with Kubernetes and OpenShift administration in production environments.Proven experience deploying and operating vLLM-based inference platforms in production.Strong understanding of LLM serving concepts, including Paged Attention, continuous batching, and inference optimization techniques.Deep knowledge of NVIDIA GPU technologies, CUDA drivers, NVIDIA Container Toolkit, and GPU troubleshooting.Hands-on experience with Prometheus, Grafana, OpenTelemetry, and ELK Stack.Experience building observability solutions, including custom metrics, exporters, dashboards, and alerting mechanisms.Strong Python programming skills with experience developing automation and operational tooling.Experience with Bash scripting and Linux systems administration.Familiarity with GitLab CI, Jenkins, ArgoCD, and Infrastructure-as-Code practices.Strong analytical and problem-solving skills with the ability to work in complex, distributed environments.Excellent communication and collaboration skills.About UsWorking at T Hub will offer you an unique and highly rewarding experience on IT market. As a leader in the telecommunications industry, we do not only provide a platform to hone your technical skills but also empower you to be a catalyst for innovation.You'll have the opportunity to work at the forefront of modern technologies, from 5G to IoT and AI, shaping the future of connectivity.Form of Employment: Contract of EmploymentLocation: Warsaw/Remote/Hybrid work modelHave you ever asked yourself whether you'd rather work in a big-tech, software house or startup? At home or in the office? In international teams or polish? At T Hub, there's one answer - YES!T Hub Poland is a dynamic, forward-thinking division in T-Mobile Poland, where technology matters! It’s a place where best talents converge to ideate, prototype, and implement cutting-edge solutions in international projects held in Deutsche Telekom Group.Job BenefitsWork-Life BalanceRemote work optionsHybrid work modelFinancialContract of Employment