Senior AI/ML DevOps Engineer - LLMs & MLOps

BGC GROUP PTE. LTD.; Singapore; On-site; SGD 80,000 - 100,000; Full time

Job summary

A technology specialist firm in Singapore is seeking an experienced AI/ML Engineer to develop and deploy AI products while managing AI infrastructure. Responsibilities include design and implementation of backend services, inference optimization, and ensuring compliance with security standards. Ideal candidates should have significant experience in DevOps and MLOps, with expertise in deploying LLMs and a solid understanding of security practices. The role offers a salary of 5000-7000 SGD plus bonuses.

Qualifications

• 5+ years in DevOps, MLOps, with 2+ years in AI/ML systems.
• Hands-on experience deploying and optimizing LLMs in production.
• Strong understanding of AI/MLOps practices and tools.

Responsibilities

• Design and develop backend API services for AI functionalities.
• Deploy and manage large-scale LLMs in containerized environments.
• Tune inference performance using model optimization techniques.
• Design and manage scalable GPU infrastructure for AI workloads.

Skills

DevOps practices

MLOps tools

Container technologies

Scripting skills

Inference optimization techniques

GPU infrastructure

Secure software development practices

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Redhat OCP

MLflow

Kubeflow

TensorRT

ONNX Runtime

DeepSpeed

Python

Bash

Job description

A technology specialist firm in Singapore is seeking an experienced AI/ML Engineer to develop and deploy AI products while managing AI infrastructure. Responsibilities include design and implementation of backend services, inference optimization, and ensuring compliance with security standards. Ideal candidates should have significant experience in DevOps and MLOps, with expertise in deploying LLMs and a solid understanding of security practices. The role offers a salary of 5000-7000 SGD plus bonuses.