Software Engineer/Platform Engineer - Kubernetes + Golang/Python + AI (5+ Years)

123 Cisco Systems (India) Private Limited; Bengaluru; On-site; INR 3,000,000 - 5,200,000; Full time

Job summary

Cisco Systems (India) Private Limited in Bengaluru seeks an experienced software engineer to lead the design and development of scalable Kubernetes-based infrastructure for AI/ML platforms. You will shape the technical direction, ensuring reliability, performance and multi-tenant support while collaborating with data scientists and other engineering teams.

You will architect platform components using Golang or Python, drive CI/CD for ML workflows, and mentor junior engineers to strengthen the

Qualifications

• 5-7 years of software engineering experience.
• Expertise in Golang or Python, with hands-on Kubernetes platform experience.
• Experience with ML frameworks TensorFlow and PyTorch.
• Design, implementation, and operation of a Kubernetes platform supporting microservices.
• Experience building CI/CD pipelines for ML workflows and model monitoring.

Responsibilities

• Design and develop scalable Kubernetes-based platform components for reliability and multi-tenancy.
• Build platform capabilities to support Kubernetes workloads and GenAI with GPU deployments.
• Develop backend services using Golang and/or Python with solid software practices.
• Contribute to AIOps and collaborate with SREs and software engineers to optimize AI workflows.
• Implement observability (metrics, logs, traces) and IaC automation to improve visibility and consistency.
• Mentor junior engineers; conduct code reviews and establish standard processes.
• Stay updated on AI/ML trends to drive platform enhancements.
• Participate in on-call rotations and incident response to maintain reliability.

Skills

Golang

Python

Kubernetes

TensorFlow

PyTorch

CI/CD

ML workflows

Distributed systems

Tools

Kubeflow

KServe

Airflow

MLflow

Job description

Meet the Team

You will be pivotal in contributing to the team responsible for designing and developing the next generation of scalable Kubernetes infrastructure with Foundational Model and GPU Platforms. This is a position for experienced engineers where you will lead the technical direction, ensuring the performance, reliability, and scalability of AI systems while collaborating closely with data scientists, researchers, and other engineering teams.

Your Impact

You will architect scalable infrastructure, and implement standard methodologies for Infrastructure as a Code with Golang along with developing platforms which offers LLMs and GPUs as service. Your leadership will influence the adoption of modern technologies and processes while mentoring junior engineers to strengthen the team's technical foundation. This role is perfect for someone with a deep passion for solving engineering challenges in the fast-paced AI/ML space, with a focus on delivering high-impact solutions at scale.

Core Responsibilities

• Design and develop scalable Kubernetes-based platform components, focusing on reliability, multi-tenancy, and efficient workload orchestration.
• Build and enhance platform capabilities to support Kubernetes workloads and emerging GenAI workloads (including GPU-based deployments), ensuring performance and cost efficiency.
• Develop backend services and platform tooling using Golang and/or Python, following strong software engineering practices.
• Contribute to AIOps initiative across platforms by collaborating with multi-functional teams, including SREs, Software Engineers to operationalize and optimize AI workflows effectively.
• Implement and improve observability frameworks (metrics, logs, traces) to enhance platform visibility and debugging.
• Build and maintain automation frameworks and Infrastructure as Code (IaC) to improve platform consistency and operational efficiency.
• Ensure platform reliability, scalability, and performance through meticulous engineering practices with operational rigor.
• Participate in on-call rotations, contributing to round the clock support, incident response, troubleshooting, and continuous reliability improvements.
• Conduct code reviews, establish standard processes, and mentor junior engineers.
• Stay updated on the latest trends in AI/ML to influence platform enhancements.

Minimum Qualifications / Requirements

• Experience: 5-7 years of software engineering experience
• Expertise in Golang or Python, with hands-on experience with Kubernetes platform
• Along with ML frameworks (TensorFlow, PyTorch)
• Assist in the design, implementation, and day-to-day operation of a Kubernetes platform supporting microservices architecture
• Support and help improve the existing platform that hosts a large number of business applications
• Help automate legacy platforms to enable infrastructure as code, increasing efficiency and consistency in platform management
• Consistent track record in designing and deploying scalable machine learning systems in production
• Experience building CI/CD pipelines for ML workflows, including model monitoring and retraining
• Proficiency in cloud platforms and orchestration tools for distributed systems
• Strong problem-solving and debugging skills for complex, large-scale systems
• Experience in mentoring engineers and driving technical decision-making

Preferred Qualifications / Requirements

• Sophisticated understanding in Kubernetes for managing production-grade systems and ensuring scalability
• Sophisticated experience with Docker and orchestration of complex services
• Expertise in Golang or Python
• Develop & enforce secure software development lifecycle
• Experience with architecting and optimizing workflows using Kubeflow pipelines, KServe, Airflow, and MLflow
• Ability to design and implement efficient CI/CD workflows for LLM/GPU provisioning
• Understanding of LangChain and experience designing RAG systems
• Knowledge of integrating and scaling vector databases for real-world applications
• Consistent record of designing and leading the development of distributed systems
• Experience with implementing robust inter-service communication patterns and solving scalability issues

Why Cisco?

At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era - and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint. Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere. We are Cisco, and our power starts with you. Cisconians power the future. We make impact as a team, innovating fast and fearlessly to create meaningful solutions on a large scale. The depth and breadth of our technology doesn’t just benefit our customers - it also means limitless opportunities for us to experiment and learn. We understand the power each of our unique backgrounds bring when we work together. Because of that, we have a global network of thinkers, doers, experts, and curious creators who help one another do their life’s best work.