Cloud ML Ops Engineer: Deploy, Scale & Monitor Models

Always Marketing (M) Sdn Bhd; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Job summary

Always Marketing (M) Sdn Bhd is hiring a Machine Learning Operation Engineer to design and maintain cloud, API and deployment infrastructure for ML solutions. You will collaborate with data scientists, ML engineers, software engineers and DevOps teams to deploy reliable models across cloud, mobile and edge environments.

The role combines strong software engineering with hands‑on cloud infrastructure, Kubernetes, MLOps and ML deployment experience, involving container orchestration, CI/CD

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 1+ years of hands-on cloud infrastructure experience in production.
• Strong Python and API development skills (FastAPI/Flask).

Responsibilities

• Design, deploy and maintain cloud and Kubernetes infra for ML workloads.
• Build RESTful APIs and messaging services for ML inference.
• Develop ML deployment and MLOps pipelines with CI/CD and model versioning.
• Work with vector databases and embedding retrieval (FAISS/LanceDB/Qdrant).
• Collaborate with data scientists and software teams to optimize models for cloud, mobile and edge.

Skills

Kubernetes

Docker/Podman

Python

CI/CD

REST APIs

MLOps

Model deployment

Education

Bachelor's degree in CS/Engineering

Tools

FAISS

LanceDB

Qdrant

MLflow

Kubeflow

Prometheus

Grafana

Job description

About The Role

We are looking for a

About The Role

We are looking for a Machine Learning Operation Engineer to design, build and maintain the cloud, API and deployment infrastructure that powers ML solutions. You will work closely with data scientists, ML engineers, software engineers and DevOps teams to deploy reliable ML models across cloud, mobile and edge environments. The ideal candidate combines strong software engineering skills with hands-on experience in cloud infrastructure, Kubernetes, MLOps and ML deployment.

Key Responsibilities

• Design, deploy and maintain scalable cloud and Kubernetes infrastructure for ML workloads, including container orchestration, autoscaling and production deployments
• Build and maintain RESTful/gRPC APIs and messaging services to support ML inference, data processing and real-time or asynchronous workloads
• Develop reliable ML deployment and MLOps pipelines, including Docker/Podman, CI/CD, model versioning, monitoring, logging and automated deployment/retraining workflows
• Support vector search, database and ML infrastructure, including PostgreSQL/SQL Server, embedding-based retrieval, FAISS/LanceDB/Qdrant and performance optimization
• Collaborate with data scientists, ML engineers and software teams to deploy and optimize models across cloud, mobile and edge devices, including model optimization and inference performance
  
  

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience
• Minimum 1 years of hands-on experience in cloud infrastructure (AWS, GCP or Azure) within a production environment
• Strong experience with Kubernetes, Helm, Docker/Podman and CI/CD
• Proficiency in Python and frameworks such as FastAPI, Flask or Litestar; experience with RESTful/gRPC APIs
• Strong knowledge of PostgreSQL/SQL Server, database design, query optimization and software architecture
• Experience with vector databases/search, embeddings and technologies such as FAISS, LanceDB or Qdrant
• Experience with MLOps tools such as MLflow, Airflow or Kubeflow is an advantage
• Experience with edge/mobile ML deployment, ONNX Runtime Mobile, NCNN or MNN is an advantage
• Familiarity with monitoring and logging tools such as Prometheus, Grafana, ELK or Loki
• Strong analytical, troubleshooting, communication and collaboration skills
• Experience with Go, C++ or Rust is a strong advantage, particularly for performance-critical applications
• Excellent communication and documentation habits
  
  

Powered by JazzHR

wubBG3sS8g