DevOps/MLOps Specialist

Bosch

Bengaluru

On-site

INR 3,500,000 - 7,000,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Bosch Global Software Technologies Private Limited seeks an experienced MLOps/LLMOps lead to design, deploy, and govern scalable AI systems in production across cloud environments. You will build end-to-end pipelines, automate deployments, and collaborate with data scientists and software teams to ensure robust, secure, and efficient AI solutions.

The role emphasizes model serving, monitoring, governance, and continuous improvement of ML/LLM workflows with GPUs/TPUs, aiming for production-grade,

Qualifications

  • 5+ years of experience in MLOps with a focus on LLMOps pipelines for large language models.
  • Experience deploying, managing, and optimizing ML models in cloud environments at scale.
  • Experience with AI and Generative AI technologies is a plus.

Responsibilities

  • Lead the design and implementation of end-to-end MLOps and LLMOps pipelines from development to deployment.
  • Develop automation for model deployment and management ensuring scalability and cost-effectiveness for LLMs in cloud environments.
  • Implement and manage CI/CD for ML and LLM models and integrate into production
  • Collaborate with data scientists, ML engineers, and software developers to integrate LLMs into production systems
  • Build data pipelines and orchestration for training/serving using Kubeflow, Airflow, or MLflow
  • Create robust monitoring systems for model performance and reliability using Prometheus/Grafana
  • Optimize model performance focusing on speed, cost, and accuracy with GPUs/TPUs
  • Maintain version control, governance and lifecycle management for ML/LLM models
  • Stay updated with latest MLOps/LLMOps practices and apply them in deployment workflows

Skills

MLOps & LLMOps
Cloud platforms
CI/CD
Model serving & monitoring
ML frameworks
Data pipelines
Python
Performance optimization
Security & governance

Education

Bachelor's or Master's in CS/Engineering/Data Science

Tools

Kubeflow
Airflow
MLflow
TensorFlow Serving
TorchServe
Docker
Kubernetes
Prometheus
Grafana
Kafka

Job description

  • Legal Entity: Bosch Global Software Technologies Private Limited
Company Description

Bosch Global Software Technologies Private Limited is a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 27,000+ associates, it’s the largest software development center of Bosch, outside Germany, indicating that it is the Technology Powerhouse of Bosch in India with a global footprint and presence in the US, Europe and the Asia Pacific region.

Job Description
Education and Work Experience Requirements

Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field. 5+ years of experience in MLOps with at least 2 years working specifically with LLMOps pipelines for large language models. Proven experience in deploying, managing, and optimizing machine learning models in cloud environments at scale. Experience with AI and Generative AI technologies is a plus.

  • Strong problem-solving abilities and a passion for building scalable, production-grade AI systems.
  • Lead the design and implementation of end-to-end MLOps and LLMOps pipelines, from model development and training to deployment and continuous monitoring in production environments.
  • Develop automation for model deployment and management, ensuring scalability, efficiency, and cost-effectiveness, particularly for large language models (LLMs) in cloud environments.
  • Implement and manage CI/CD pipelines for both ML and LLM models, integrating them seamlessly into the production environment.
  • Collaborate with data scientists, ML engineers, and software developers to ensure the integration of LLMs and ML models into scalable, production-ready systems.
  • Build data pipelines and workflows for training and serving models, ensuring efficient data processing and pipeline orchestration using tools like Kubeflow, Airflow, or MLflow.
  • Create robust monitoring systems for tracking model performance, diagnosing issues, and ensuring the reliability and health of both traditional ML and LLM-based systems.
  • Optimize the performance of deployed models, focusing on cost optimization, speed, and accuracy, including hardware acceleration (GPUs, TPUs).
  • Maintain version control, governance, and model lifecycle management for both ML and LLM models using industry-standard tools.
  • Stay up-to-date with the latest advancements in MLOps, LLMOps, and Generative AI, implementing best practices and innovative approaches to improve the deployment lifecycle.
Mandatory Skills
  • MLOps & LLMOps Expertise: Solid understanding of MLOps best practices and LLMOps workflows for large language models, ensuring seamless integration of AI systems into production environments.
  • Cloud Infrastructure & Deployment: Extensive experience with cloud platforms (AWS, GCP, Azure) for deploying and scaling ML/LLM solutions. Expertise in containerization (Docker, Kubernetes) for model deployment and orchestration.
  • CI/CD Pipelines & Automation: Proficiency in developing and managing CI/CD pipelines for machine learning models using tools like Jenkins, GitLab CI, or CircleCI, and automation tools like Terraform or Ansible.
  • Model Serving & Monitoring: Hands‑on experience deploying models using frameworks such as TensorFlow Serving, TorchServe, Kubeflow, or MLflow. Strong understanding of model monitoring and alerting (e.g., Prometheus, Grafana).
  • Machine Learning Frameworks: Strong knowledge of popular machine learning frameworks like TensorFlow, PyTorch, Hugging Face, and others, with a particular focus on deploying and fine‑tuning large language models (e.g., GPT, BERT).
  • Data Engineering & Pipelines: Expertise in building and managing robust data pipelines using tools like Apache Kafka, Apache Airflow, or Apache Beam to support ML and LLM workflows.
  • Performance Optimization: Ability to optimize the performance of AI models, including working with distributed systems, model compression, and hardware acceleration (GPUs, TPUs).
  • Security & Governance: Deep understanding of security and governance best practices for AI systems, including model versioning, compliance with privacy regulations (GDPR), and ethical AI frameworks.
  • Programming & Scripting: Strong programming skills in Pyth
Additional Information

6+

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Consultant - MLOps
Senior Consultant - MLOps

SiriusAI • Gurugram District

On-site
INR 1,200,000 - 2,400,000
Gen AI Specialist
Gen AI Specialist

Bosch • Karnataka

On-site
INR 3,000,000 - 5,000,000
LLMOps Engineer
LLMOps Engineer

Aventra.AI • Bengaluru

On-site
INR 1,800,000 - 3,200,000
Senior MLOps Engineer
Senior MLOps Engineer

Aligned Automation • Pune District

On-site
INR 1,200,000 - 2,400,000
Senior MLOps Engineer
Senior MLOps Engineer

Yotta Data Services Private Limited • Mumbai

On-site
INR 4,500,000 - 7,500,000
MLOps Engineer / Developer
MLOps Engineer / Developer

SASS INNOVATIONS • Bengaluru

On-site
INR 3,000,000 - 5,500,000
ML Ops Lead
ML Ops Lead

CoRover • Delhi

Hybrid
INR 1,500,000 - 2,500,000
DevOps+MLOps+PythonML Developer
DevOps+MLOps+PythonML Developer

Infosys • Bengaluru

On-site
INR 1,500,000 - 2,300,000
MLOps Engineer - Bangalore Location - Hybrid
MLOps Engineer - Bangalore Location - Hybrid

Genpact Ltd. • Bengaluru, Delhi, New Delhi

On-site
INR 3,000,000 - 6,000,000
Senior MLOps Engineer
Senior MLOps Engineer

Aligned Automation • Indore

On-site
INR 1,200,000 - 1,900,000