AI/ML DevOps Engineer — LLM Deployments & CI/CD

Luxoft; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Luxoft is recruiting for an experienced AI DevOps Engineer / MLOps Engineer to build, automate, and manage AI model deployment pipelines for a leading Singapore-based bank.

You will enable secure, scalable delivery of AI solutions across development, UAT and production environments, collaborating with AI Engineers, Data Scientists, security teams and application development teams on modern cloud and container platforms.

Qualifications

• 3–5 years of experience in DevOps, Platform Engineering or Cloud Engineering.
• Strong hands-on experience with Jenkins.
• Strong knowledge of GitHub, GitHub Actions, GitLab, or Bitbucket.
• Experience deploying AI/ML models from Hugging Face or similar model repositories.
• Strong Docker and Kubernetes/OpenShift experience.
• Experience with Linux system administration.
• Hands‑on scripting with Bash, Python, or Shell.
• Experience with CI/CD pipeline automation.
• Infrastructure as Code using Terraform or Ansible.
• Knowledge of container registries (Artifactory, Nexus, Docker Registry).
• Experience with cloud platforms (AWS, Azure, GCP).
• Understanding of GPU-enabled environments and NVIDIA CUDA.

Responsibilities

• Design, build, and maintain CI/CD pipelines for AI/ML model deployment.
• Deploy LLMs from Hugging Face into dev, UAT, and production environments.
• Automate model packaging, versioning, testing, and release using DevOps best practices.
• Manage Kubernetes/OpenShift based AI platforms for model hosting and inference.
• Build deployment pipelines using Jenkins, GitHub Actions, GitLab CI, or similar CI/CD tools.
• Containerise AI applications using Docker and deploy them into Kubernetes clusters.
• Integrate AI solutions with enterprise applications using REST APIs and microservices.
• Manage model lifecycle, rollback strategies, monitoring, and production support.
• Implement IaC (Terraform/Ansible) for AI platform provisioning.
• Configure model serving platforms such as vLLM, Ollama, Triton, or similar.
• Monitor health using Prometheus, Grafana, ELK, Dynatrace, or Splunk.
• Optimise GPU resource utilisation and troubleshoot model performance issues.
• Collaborate with AI Engineers to productionise new models and inference pipelines.
• Ensure security, governance and compliance within the banking environment.
• Participate in production releases, incident management and continuous platform improvements.

Skills

DevOps

CI/CD

Kubernetes

Docker

GitHub Actions

GitLab CI

Jenkins

Linux

Scripting

Terraform

Ansible

REST APIs

Tools

Jenkins

GitHub

GitLab

Bitbucket

Kubernetes

Docker

Job description

Luxoft is recruiting for an experienced AI DevOps Engineer / MLOps Engineer to build, automate, and manage AI model deployment pipelines for a leading Singapore-based bank.

You will enable secure, scalable delivery of AI solutions across development, UAT and production environments, collaborating with AI Engineers, Data Scientists, security teams and application development teams on modern cloud and container platforms.