MLOPS Senior Lead Engineer

guardianlife; Chennai District; On-site; INR 3,500,000 - 5,200,000; Full time

Job summary

Guardian Life is seeking a senior MLOPS Lead Engineer in India (Chennai or Gurgaon). You will design and maintain data pipelines, leverage Databricks, and lead ML lifecycle tooling across teams. Strong Python, SQL, and Spark experience required.

Collaboration with data scientists and software engineers is essential, with CI/CD and container orchestration skills. This on-site role offers challenging projects and cross-functional impact.

Qualifications

• 8+ years of experience in CS/DS/Engineering or related field.
• 3+ years building robust data pipelines for ML use.
• 4+ years with Python, SQL, PySpark and bash scripting.

Skills

Python

SQL

PySpark

Bash scripting

SDLC

Data pipelines

Cloud DW

Delta Lake

Databricks

REST APIs

APIs (Flask/FastAPI)

Docker

Kubernetes

CI/CD

Jenkins

GitHub

Airflow

Orchestration

Communication

Education

Bachelor's degree

Master's degree

Tools

Databricks

Delta Lake

Databricks CLI

Databricks Workspace

Docker

Kubernetes

Jenkins

GitHub

Airflow

Prefect

Job description

MLOPS Senior Lead Engineer

• Bachelor's or master's degree with 8+ years of experience in Computer Science, Data Science, Engineering, or a related field.
• 4+ years of experience in working with Python, SQL, PySpark and bash scripts. Proficient in software development lifecycle and software engineering practices.
• 3+ years of experience in developing and maintaining robust data pipelines for both structured and unstructured data to be used by Data Scientists to build ML Models.
• 3+ years of experience working with Cloud Data Warehousing (Redshift, Snowflake, Databricks SQL or equivalent) platforms and experience in working with distributed frameworks like Spark.
• 2+ years of hands-on experience in using Databricks platform for data engineering. Detailed knowledge of Delta Lake, Databricks Workflow, Job Clusters, Databricks CLI, Databricks Workspace etc.
• Solid understanding of machine learning life cycle, data mining, and ETL techniques.
• Familiarity with commonly used machine learning libraries (like scikit-learn, xgboost) in terms of exposure and handling of code base which makes use of these libraries for model training & scoring.
• Proficiency in understanding of REST APIs, experience in using different types of APIs to either extract data or perform a functionality exposed by APIs.
• Familiarity in Pythonic API development frameworks like Flask / FastAPI. Experience in using containerization frameworks like Docker / Kubernetes.
• Hands-on experience in building and maintaining tools and libraries which have been used by multiple teams across organization. e.g. Creating Data Engineering common utility libraries, DQ Libraries etc.
• Proficient in understanding and incorporating software engineering principles in design & development process.
• Hands on experience with using CI/CD tools (e.g., Jenkins or equivalent), version control (Github, Bitbucket), Orchestration (Airflow, Prefect or equivalent)
• Excellent communication skills and ability to work and collaborate with cross functional teams across technology and business

Location:

This position can be based in any of the following locations:

Chennai, Gurgaon

Current Guardian Colleagues: