DevOps MLOps Specialist

Bosch; Bengaluru; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

Bosch Global Software Technologies Private Limited in Bengaluru, India, is hiring an experienced MLOps/LLMOps engineer to design and implement scalable AI systems. You will lead end-to-end pipelines, collaborate with data scientists, and optimize deployments for performance and cost in cloud environments.

Candidates should have 5+ years in MLOps and strong cloud/CI/CD skills; BE/MTech/related degrees preferred. The role requires working on-site in Bengaluru with Bosch’s global teams.

Qualifications

• Bachelor’s or Master’s degree in CS/Engineering or related field.
• 5+ years in MLOps with 2+ years in LLMOps.
• Experience deploying ML models in cloud at scale.
• Familiarity with Generative AI.
• Strong problem-solving; scalable AI systems.
• Team collaboration with data scientists and engineers.

Responsibilities

• Lead end-to-end MLOps and LLMOps pipelines from development to deployment.
• Develop automation for model deployment and management in cloud.
• Implement and manage CI/CD for ML and LLM models.
• Collaborate with data scientists and software engineers to integrate LLMs.
• Build data pipelines and workflows for training and serving models (Kubeflow/Airflow/MLflow).
• Create monitoring for model performance and health.
• Optimize model performance, including GPUs/TPUs and cost.
• Maintain model versioning, governance, and lifecycle.
• Stay updated with MLOps/LLMOps trends and best practices.

Skills

MLOps

LLMOps

Cloud Deployment

CI/CD

Model Serving

ML Frameworks

Data Pipelines

Performance Optimization

Security & Governance

Python

Education

BE MCA MTech BTech

Tools

Kubeflow

Airflow

MLflow

TensorFlow Serving

TorchServe

Job description

Job Description:

Company Description

Bosch Global Software Technologies Private Limitedis a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 27,000+ associates, it’s the largest software development center of Bosch, outside Germany, indicating that it is the Technology Powerhouse of Bosch in India with a global footprint and presence in the US, Europe and the Asia Pacific region.

Job Description

Education and Work Experience Requirements: Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field.5+ years of experience in MLOps with at least 2 years working specifically with LLMOps pipelines for large language models.Proven experience in deploying, managing, and optimizing machine learning models in cloud environments at scale.Experience with AI and Generative AI technologies is a plus.

• Strong problem-solving abilities and a passion for building scalable, production-grade AI systems.
• Lead the design and implementation of end-to-end MLOps and LLMOps pipelines, from model development and training to deployment and continuous monitoring in production environments.
• Develop automation for model deployment and management, ensuring scalability, efficiency, and cost-effectiveness, particularly for large language models (LLMs) in cloud environments.
• Implement and manage CI/CD pipelines for both ML and LLM models, integrating them seamlessly into the production environment.
• Collaborate with data scientists, ML engineers, and software developers to ensure the integration of LLMs and ML models into scalable, production-ready systems.
• Build data pipelines and workflows for training and serving models, ensuring efficient data processing and pipeline orchestration using tools like Kubeflow, Airflow, or MLflow.
• Create robust monitoring systems for tracking model performance, diagnosing issues, and ensuring the reliability and health of both traditional ML and LLM-based systems.
• Optimize the performance of deployed models, focusing on cost optimization, speed, and accuracy, including hardware acceleration (GPUs, TPUs).
• Maintain version control, governance, and model lifecycle management for both ML and LLM models using industry-standard tools.
• Stay up-to-date with the latest advancements in MLOps, LLMOps, and Generative AI, implementing best practices and innovative approaches to improve the deployment lifecycle.

Mandatory Skills

• MLOps & LLMOps Expertise: Solid understanding of MLOps best practices and LLMOps workflows for large language models, ensuring seamless integration of AI systems into production environments.
• Cloud Infrastructure & Deployment: Extensive experience with cloud platforms (AWS, GCP, Azure) for deploying and scaling ML/LLM solutions. Expertise in containerization (Docker, Kubernetes) for model deployment and orchestration.
• CI/CD Pipelines & Automation: Proficiency in developing and managing CI/CD pipelines for machine learning models using tools like Jenkins, GitLab CI, or CircleCI, and automation tools like Terraform or Ansible.
• Model Serving & Monitoring: Hands‑on experience deploying models using frameworks such as TensorFlow Serving, TorchServe, Kubeflow, or MLflow. Strong understanding of model monitoring and alerting (e.g., Prometheus, Grafana).
• Machine Learning Frameworks: Strong knowledge of popular machine learning frameworks like TensorFlow, PyTorch, Hugging Face, and others, with a particular focus on deploying and fine‑tuning large language models (e.g., GPT, BERT).
• Data Engineering & Pipelines: Expertise in building and managing robust data pipelines using tools like Apache Kafka, Apache Airflow, or Apache Beam to support ML and LLM workflows.
• Performance Optimization: Ability to optimize the performance of AI models, including working with distributed systems, model compression, and hardware acceleration (GPUs, TPUs).
• Security & Governance: Deep understanding of security and governance best practices for AI systems, including model versioning, compliance with privacy regulations (GDPR), and ethical AI frameworks.
• Programming & Scripting: Strong programming skills in Pyth

Qualifications

BE, MCA, MTech , BTech

Additional Information

6+

Legal Entity

Legal Entity: Bosch Global Software Technologies Private Limited

Requirements