Senior AI DevOps & LLMOps Engineer (Hybrid Cloud)

TechBiz Global GmbH; Kraków; On-site; PLN 260,000 - 520,000; Full time

Job summary

TechBiz Global is seeking a Senior AI DevOps / LLMOps specialist to join one of our client teams in Kraków. You will design and implement AI-focused CI/CD, IaC, and MLOps pipelines to enable safe, scalable deployment of models and agents.

Responsibilities include building canary and blue-green strategies, policy-as-code, monitoring of inference endpoints, and ensuring security and compliance across hybrid cloud environments. The role demands 10+ years in DevOps and 2+ years in MLOps/LLMOps.

Qualifications

• 10+ years in DevOps, SRE, or Cloud Engineering.
• 2+ years in MLOps or LLMOps, moving LLMs to production.
• Proven experience managing Hybrid Cloud environments (AWS/Azure + Private Data Center).

Responsibilities

• Automate Build-to-Production for AI, including model weights, dataset versioning, and code.
• Develop PromptOps workflows with version-controlled system prompts.
• Automate deployment of Agentic workflows with stateful AI interactions and multi-agent handoffs.
• Provide AI Infrastructure as Code with GPU clusters and Terraform/Pulumi/Ansible.
• Define Policy-as-Code for endpoints ensuring security, cost usage limits, and data residency.
• Maintain parity between On-Premises and Cloud environments.
• Architect Progressive Delivery strategies (Canary, Blue-Green, Shadowing).
• Build Evaluation-in-the-Loop gates to test bias, hallucination, and performance.
• Implement A/B testing for LLM outputs and agentic behavior.
• Establish deep observability into Inference Endpoints with latency, tokens/second, and drift.

Skills

Kubernetes

CI/CD

IaC

AI Tooling

GPU virtualization

Security & secret management

Hybrid cloud

Tools

Terraform

Pulumi

Ansible

GitHub Actions

GitLab CI

KubeFlow

Ray

NVIDIA Triton

Job description

TechBiz Global is seeking a Senior AI DevOps / LLMOps specialist to join one of our client teams in Kraków. You will design and implement AI-focused CI/CD, IaC, and MLOps pipelines to enable safe, scalable deployment of models and agents.

Responsibilities include building canary and blue-green strategies, policy-as-code, monitoring of inference endpoints, and ensuring security and compliance across hybrid cloud environments. The role demands 10+ years in DevOps and 2+ years in MLOps/LLMOps.