Sr. MLOps Engineer

UST; Bengaluru; On-site; INR 1,500,000 - 2,200,000; Full time

Job summary

UST is seeking a hands-on AI Deployment Engineer specializing in ML Engineering, Model Deployment, Governance, and Observability. You will own the complete lifecycle of Deep Learning models, LLMs, and SLMs across cloud, on-premises, hybrid, and air-gapped environments.

You will build and manage MLOps/LLMOps pipelines, deploy and host models on Databricks, Kubernetes, and GPU-based infra, and implement monitoring, governance, and cost optimization.

Qualifications

• 3–5 years in MLOps, LLMOps, ML/AI engineering.
• Strong Python development skills.
• Hands-on with Databricks and/or Azure ML.
• Experience deploying PyTorch and TensorFlow models.
• Experience deploying models on Kubernetes and GPU infrastructure.

Responsibilities

• Build and manage MLOps/LLMOps pipelines.
• Deploy, host, and scale Deep Learning models, LLMs, and SLMs across environments.
• Manage end-to-end model lifecycle including versioning, deployment, rollout, rollback, and retirement.
• Host models on Databricks, Kubernetes, OpenShift, and GPU-based infrastructure.
• Implement model governance, lineage, approval workflows, and compliance controls.
• Build model monitoring, observability, tracing, logging, and drift detection capabilities.
• Optimize model performance, latency, throughput, GPU utilization, and cost.
• Support cloud, on-premises, hybrid, and air-gapped environments.

Skills

MLOps

Python development

ML deployment

GPU optimization

Tools

Databricks

Azure ML

Kubernetes

GPU infrastructure

PyTorch

TensorFlow

Job description

Who We Are

At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact—touching billions of lives in the process. Visit us at .

Role Description

ML Engineer I

Who We Are

At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact—touching billions of lives in the process. Visit us at .

Job Description

We are seeking a hands-on AI Deployment Engineer specializing in ML Engineering, Model Deployment, Model Governance, and Model Observability. The engineer will own the complete lifecycle of Deep Learning models, LLMs, and SLMs across cloud, on-premises, hybrid, and air-gapped environments.

Scope of Work

• Build and manage MLOps and LLMOps pipelines.
• Deploy, host, and scale Deep Learning models, LLMs, and SLMs and Inference optimisation
• Manage end-to-end model lifecycle including versioning, deployment, rollout, rollback, and retirement.
• Host models on Databricks, Kubernetes, OpenShift, and GPU-based infrastructure.
• Implement model governance, lineage, approval workflows, and compliance controls.
• Build model monitoring, observability, tracing, logging, and drift detection capabilities.
• Optimize model performance, latency, throughput, GPU utilization, and cost.
• Support cloud, on-premises, hybrid, and air-gapped environments.

Must-Have Skills

• 3–5 years in MLOps, LLMOps, ML Engineering, or AI Engineering.
• Strong Python development skills.
• Hands-on experience with Databricks and/or Azure ML.
• Experience with Deep Learning, LLMs, SLMs, RAG, and Hugging Face.
• Experience deploying models built using PyTorch and TensorFlow.
• Strong expertise in model deployment on:
• Kubernetes
• Databricks
• GPU Infrastructure

Experience With

• vLLM
• Triton Inference Server
• Ray Serve
• SGLang
• Databricks Model Serving
• Strong GPU knowledge including NVIDIA GPUs, CUDA, multi-GPU deployments, and inference optimization.
• Experience in Model Registry, Model Governance, Model Monitoring, Drift Detection, and AI Observability.
• Strong database knowledge (SQL Server, PostgreSQL, Oracle, MySQL, MongoDB).
• Experience with Vector Databases (Pinecone, Chroma, FAISS, Milvus, Azure AI Search).
• REST APIs, WebSockets, Streaming HTTP.
• Experience with MLflow, OpenTelemetry, LangFuse, Splunk, and Grafana/ELK.
• CI/CD using Jenkins, Azure DevOps.
• Experience across Cloud, On-Premises, Hybrid, and Air-Gapped environments.
• Experience with Auth setup like Keycloak

Good-to-Have Skills

• Kafka, RabbitMQ, Event Hub
• Fine-tuning and model optimization
• Model Governance & Security
• Experience with Llama, Mistral, DeepSeek, Qwen, Phi, and Gemma models

What We Believe

We’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.

Humility

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

Humanity

Through business, we will better the lives of those less fortunate than ourselves.

Integrity

We honour our commitments and act with responsibility in all our relationships.

Equal Employment Opportunity Statement

UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.

All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.

• To support and promote the values of UST.
• Comply with all Company policies and procedures

Skills

AI Governance, Apache Kafka, CI/CD, Grafana