ML Operations Lead

Umanist NA; Pune District; On-site; INR 3,500,000 - 6,500,000; Full time

Job summary

Umanist NA seeks an experienced ML Operations Lead to guide a two-person India-based ML Ops team, ensuring reliable production workflows for traditional ML models. You will drive drift monitoring, validation gates, and robust rollback processes while collaborating with global stakeholders and Data Engineering teams.

The role emphasizes strong leadership, delivery of model changes on time, and maintaining high operational standards in a 5-day office-based Pune setup.

Qualifications

• 8+ years in ML, MLOps, or Data Science Engineering including team leadership.
• Hands-on experience deploying and operating traditional ML models in production.
• Strong understanding of customer churn prediction models and related analytics.

Responsibilities

• Lead and mentor the ML Operations team, setting standards and priorities.
• Manage deployment, monitoring, retraining, validation, and maintenance of traditional ML models in production.
• Define and manage rollback procedures to restore previous stable model versions.
• Monitor data/feature/concept drift and model performance degradation across the portfolio.
• Coordinate with international stakeholders on deployment schedules and incidents.
• Report health, deployment success, retraining outcomes and portfolio performance.

Skills

MLOps

Production ML operations

Team leadership

Customer churn prediction

Model deployment

CI/CD pipelines

Drift detection

Model monitoring

Stakeholder management

Communication

Education

Bachelors or higher in Computer Science/Engineering/Data Science/Statistics

Tools

CI/CD pipelines

Model registries

Model lineage

Job description

• Relevant Experience:** 8+ years in ML, MLOps, or Data Science Engineering, including team leadership
• Work Mode:** 5 Days Work from Office
• Working Hours:** 9 AM – 6 PM IST(870)
• Notice Period:** Immediate Joiners to Serving Notice Period Candidates(only upto 30days)

Job Title: ML Operations Lead

• Experience:** 18–25 Years overall
• Relevant Experience:** 8+ years in ML, MLOps, or Data Science Engineering, including team leadership
• Location:** Hinjewadi Phase 1, Pune
• Work Mode:** 5 Days Work from Office
• Working Hours:** 9 AM – 6 PM IST(870)
• Notice Period:** Immediate Joiners to Serving Notice Period Candidates(only upto 30days)

Role Overview

We are seeking an experienced ML Operations Lead to lead a team responsible for operating and maintaining traditional Machine Learning models in production. The role focuses on ensuring model accuracy, reliability, stability, auditability, and continuous performance through effective monitoring, drift detection, retraining, validation, deployment, and rollback practices.

The successful candidate will manage a team of two ML Operations Engineers in India and collaborate with international stakeholders, Data Engineering teams, and business teams to ensure timely and reliable model operations.

• Note:** This is a classical MLOps role focused on traditional predictive ML models, not LLM/GenAI operations.

Key Responsibilities

• Lead, mentor, and develop the ML Operations team, establishing operational standards, priorities, and best practices.
• Manage the deployment, monitoring, retraining, validation, and maintenance of traditional ML models in production.
• Establish model validation gates, including backtesting and champion-challenger approaches, before promoting models to production.
• Define and manage rollback procedures to restore previous stable model versions when required.
• Monitor data drift, feature drift, concept drift, and model performance degradation across the model portfolio.
• Define retraining triggers, thresholds, and processes to maintain model accuracy and reliability.
• Maintain model registries, version history, training data lineage, baseline metrics, and last-known-good model records.
• Track model performance using relevant metrics such as AUC, precision, recall, and other business-aligned KPIs.
• Monitor model bias and fairness, ensuring appropriate controls and human oversight for sensitive decision-making use cases.
• Collaborate with Data Engineering teams to manage data quality, data freshness, data contracts, and upstream data changes.
• Implement business-requested model changes within agreed timelines while maintaining operational and validation standards.
• Coordinate with international stakeholders on deployment schedules, production incidents, change management, and operational standards.
• Report model health, deployment success rates, retraining outcomes, and overall portfolio performance.
• Support predictive ML use cases such as customer churn prediction, fraud detection, revenue assurance, and network capacity forecasting.

Must-Have Skills

• Strong experience in **MLOps and production ML operations**.
• Hands‑on experience deploying and operating traditional Machine Learning models in production.
• Strong understanding of **customer churn prediction models** and related predictive analytics use cases.
• Expertise in model deployment, model monitoring, drift detection, and model retraining.
• Experience implementing ML CI/CD pipelines, model registries, and model lineage.
• Practical experience with data drift, feature drift, concept drift, and model decay management.
• Experience with model validation, backtesting, and champion‑challenger methodologies.
• Knowledge of model performance metrics, including AUC, precision, recall, and precision‑recall evaluation.
• Experience leading teams, mentoring engineers, and managing operational priorities.
• Strong communication and stakeholder‑management skills, including cross‑border collaboration.
• Ability to translate business requirements into operational priorities and deliver model changes within agreed timelines.
• Degree in Computer Science, Data Science, Engineering, Statistics, or a related discipline.

Nice-to-Have Skills

• Experience in telecommunications (telco) or large‑scale data environments.
• Exposure to fraud detection, revenue assurance, and network capacity forecasting models.
• Experience with cloud‑based Machine Learning platforms.
• Postgraduate qualification in Machine Learning, AI, Statistics, or another quantitative discipline.
• Experience with model governance, auditability, responsible AI, bias monitoring, and model‑risk management.

Leadership Expectations

• Ability to lead a lean ML Operations team and establish scalable operating practices.
• Strong operational judgment and ownership of production model health.
• Effective coordination with business, data, and platform stakeholders.
• Excellent verbal and written communication skills.

Candidate Requirements

• Minimum 2 years of stability in an organization.
• Immediate joiners and candidates currently serving notice are preferred.
• Candidates based in Pune are preferred.
• Willingness to work from the office five days a week in Hinjewadi Phase 1, Pune.
• Excellent communication skills are essential due to regular stakeholder and client interaction.

Interview Process

• 2 Technical Rounds
• 1 Client Round
• HR Round

Skills: feature drift,model deployment,drift detection,metrics,auc,machine learning models,model monitoring,model validation,mlops,production ml operations,backtesting,ml ci/cd pipelines,model registries,stakeholder-management,concept drift,data drift,customer churn prediction models