AI / ML Ops Engineer

Zoho; India; Remote; INR 1,800,000 - 2,800,000; Full time

Job summary

Zoho in India seeks an experienced AI / ML Ops Engineer to bridge research and cloud infrastructure. You will build automated pipelines to train, test, deploy, and monitor ML models and generative AI systems securely at scale within enterprise container environments.

Responsibilities include orchestrating containerized deployments on Kubernetes, implementing data/versioning with Feast and DVC, optimizing inference performance with ONNX/TensorRT, and establishing LLM Ops with LLM frameworks.

Qualifications

• 4–8 years in software, DevOps or data engineering with 3+ years in MLOps automation.
• Proficiency in Python, container orchestration, ML frameworks, and SQL.
• Experience with Retrieval-Augmented Generation (RAG) pipelines or fine-tuning open-source LLMs in production.
• Familiarity with infrastructure-as-code scripting tools like Terraform to provision ML cluster topologies.

Responsibilities

• Build automated pipelines to train, test, deploy and monitor ML models.
• Configure scalable containerized inference endpoints on Kubernetes.
• Track data and model versions with Feast, DVC, and registries.
• Implement monitoring for model accuracy, data drift, and latency in real time.

Skills

Python

MLOps

Distributed systems

SQL

Tools

Docker

Kubernetes

PyTorch

TensorFlow

ONNX

TensorRT

KServe

Triton

Feast

DVC

Pinecone

Milvus

Terraform

Job description

• Relevant Experience Required: 3+ years of dedicated MLOps or DevOps experience deploying and managing machine learning models in production
• Mandatory Certification: AWS Certified Machine Learning - Specialty, Google Cloud Certified Professional Machine Learning Engineer, or Databricks Certified Machine Learning Professional

Job Summary

We are seeking an experienced AI / ML Ops Engineer to bridge the gap between data science research and cloud infrastructure execution. The ideal candidate will build automated pipelines to train, test, deploy, and monitor machine learning models and generative AI systems securely and at scale within enterprise container environments.

• Orchestrate containerized model deployments, configuring low-latency inference endpoints, auto-scaling GPU/CPU clusters, and model serving runtimes on Kubernetes (KServe, Triton Inference Server).
• Implement robust model tracking and data versioning foundations, managing feature stores (e.g., Feast), model registries, and version controls for massive datasets using DVC.
• Build automated AI performance and data monitoring gates, tracking model accuracy decay, data drift indicators, concept drift parameters, and system processing latencies in real time.
• Optimize inference execution environments , leveraging model compilation engines (e.g., ONNX , TensorRT ) and quantization strategies to shorten response times and minimize cloud compute costs.
• Integrate generative AI and LLM operational frameworks (LLMOps), configuring semantic caching layers, vector database scaling parameters (e.g., Pinecone, Milvus), and prompt validation pipelines.
• Govern machine learning access controls and security profiles, configuring strict data separation barriers, model access tokens, and encryption protocols to safeguard sensitive inference logs.

Requirements

• 4 to 8 years of core software engineering, DevOps, or data engineering experience, with 3+ dedicated years actively building and maintaining MLOps automation infrastructures.
• Strong technical mastery of Python programming, container orchestration (Docker, Kubernetes), ML frameworks (PyTorch, TensorFlow, Hugging Face), and advanced SQL.
• Deep structural understanding of distributed system mechanics, GPU resource management limits, model deployment patterns (Shadow, Canary, A/B), and cloud provider API governance.
• Prior experience implementing RAG (Retrieval-Augmented Generation) pipelines or fine-tuning open-source LLM layers in production.
• Familiarity with infrastructure-as-code scripting tools like Terraform to provision ML cluster topologies.