AI/ML DevOps Engineer: LLM Deployments & Kubernetes

Luxoft Singapore; Singapore; On-site; SGD 180,000 - 240,000; Full time

Job summary

Luxoft Singapore is seeking an experienced AI DevOps Engineer to design and operate scalable AI/ML deployment pipelines. You will work with AI engineers, data scientists, and platform teams to automate model packaging, testing, and releases on cloud and container platforms.

The role focuses on securing, governing, and optimizing AI workloads in a regulated banking environment, with emphasis on CI/CD, container orchestration, and monitoring in production.

Qualifications

• 6–10 years of experience in DevOps, Platform Engineering, or Cloud Engineering.
• Strong hands-on experience with Jenkins and CI/CD tooling.
• Deep knowledge of GitHub, GitHub Actions, GitLab, or Bitbucket.
• Experience deploying AI/ML models from Hugging Face or similar repositories.
• Solid Docker and Kubernetes/OpenShift experience.
• Experience with Linux system administration.
• Scripting in Bash, Python, or Shell.
• Terraform/Ansible for IaC.
• Familiarity with container registries (Artifactory/Nexus).
• Experience with AWS/Azure/GCP cloud platforms.
• Understanding of GPU-enabled environments and NVIDIA CUDA.

Responsibilities

• Design, build, and maintain CI/CD pipelines for AI/ML deployments.
• Deploy LLMs from repositories into dev/uat/prod environments.
• Automate packaging, versioning, testing, and release processes.
• Manage Kubernetes/OpenShift platforms for model hosting and inference.
• Create deployment pipelines with Jenkins, GitHub Actions, GitLab CI, or similar.
• Containerise AI apps with Docker and deploy to Kubernetes clusters.
• Integrate AI with enterprise apps via REST APIs and microservices.
• Monitor, support, and manage model lifecycle and performance.

Skills

CI/CD orchestration

Linux system administration

Scripting (Bash/Python)

REST APIs & Microservices

Stakeholder management

Agile/Scrum

Tools

Jenkins

GitHub Actions

GitLab

Bitbucket

Docker

Kubernetes

OpenShift

Terraform

Ansible

Artifactory/Nexus

AWS/Azure/GCP

Prometheus/Grafana/ELK/Dynatrace

Job description

Luxoft Singapore is seeking an experienced AI DevOps Engineer to design and operate scalable AI/ML deployment pipelines. You will work with AI engineers, data scientists, and platform teams to automate model packaging, testing, and releases on cloud and container platforms.

The role focuses on securing, governing, and optimizing AI workloads in a regulated banking environment, with emphasis on CI/CD, container orchestration, and monitoring in production.