Machine Learning Engineer

123 Cisco Systems (India) Private Limited

Hyderabad

Hybrid

INR 4,500,000 - 6,000,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Cisco's Splunk AI Platform and Services team builds and operates core runtime and developer infrastructure powering AI across Splunk and Cisco. We run multi-tenant LLM inference, model serving, VectorDB/RAG, and MCP platforms across hybrid multi-cloud environments.

Join a team at the intersection of SRE, distributed systems, and ML infrastructure to ensure AI workloads stay highly available, scalable, secure, and cost-efficient in production.

Qualifications

  • Bachelor’s degree in CS/Engineering with 5+ years of relevant experience, or Master’s with 3+ years.
  • 3+ years of programming experience in Python, Go, or Java building automation, tooling, or production backend services.
  • Solid experience running distributed, containerized systems in production using Kubernetes, microservices, and CI/CD.
  • Proven background in production operations, distributed troubleshooting, and monitoring stacks (Prometheus, Grafana, Splunk, or OpenTelemetry).
  • Hands-on knowledge of AWS, Azure, or GCP.

Responsibilities

  • Operate and optimize multi-tenant LLM inference, model serving, VectorDB/RAG, and MCP platforms across global cloud and GPU clusters.
  • Establish and monitor SLOs, SLIs, automated health checks, and observability dashboards (Prometheus, Grafana, Splunk, OpenTelemetry).
  • Build automation for seamless rollouts, autoscaling, canary deployments, self-healing, and disaster recovery.
  • Tune throughput, latency, model scheduling, batching, caching, and resource allocation using Kubernetes, vLLM, and Ray.
  • Lead complex production incident response, conduct 5-Why root-cause analyses, and implement systemic remediations to eliminate repeat outages.
  • Partner with AI researchers, product developers, and platform teams on production readiness reviews (PRRs) and participate in a sustainable on-call rotation.

Skills

Python/Go/Java
Kubernetes
CI/CD
Observability
Cloud platforms (AWS/Azure/GCP)

Education

Bachelor’s degree in CS/Engineering
Master’s degree in CS/Engineering

Tools

Prometheus
Grafana
OpenTelemetry
Splunk
Kubernetes

Job description

Meet the Team

The Splunk AI Platform and Services team builds and operates the core runtime and developer infrastructure powering AI across Splunk and Cisco. We run multi-tenant, large-scale LLM inference, VectorDB/RAG, Model Context Protocol (MCP), and AI DevX services across hybrid multi-cloud environments. Sitting at the intersection of Site Reliability Engineering, Distributed Systems, and ML Infrastructure, our mission is to ensure these mission-critical AI workloads remain highly available, scalable, secure, and cost-efficient in production.

Your Impact
  • Scale Core AI Services: Operate and optimize multi-tenant LLM inference, model serving, VectorDB/RAG, and MCP platforms across global cloud and GPU clusters.
  • Drive Platform Resiliency: Establish and monitor SLOs, SLIs, automated health checks, and observability dashboards (Prometheus, Grafana, Splunk, OpenTelemetry).
  • Automate Operations & Toil Reduction: Build automation for seamless rollouts, autoscaling, canary deployments, self-healing, and disaster recovery.
  • Optimize GPU & Inference Performance: Tune throughput, latency, model scheduling, batching, caching, and resource allocation using Kubernetes, vLLM, and Ray.
  • Incident Command & Prevention: Lead complex production incident response, conduct 5-Why root-cause analyses, and implement systemic remediations to eliminate repeat outages.
  • Cross-Functional Enablement: Partner with AI researchers, product developers, and platform teams on production readiness reviews (PRRs) and participate in a sustainable on-call rotation.
Minimum Qualifications
  • Education & Experience: Bachelor’s degree in CS/Engineering with 5+ years of relevant experience, or Master’s with 3+ years.
  • Software Development: 3+ years of programming experience in Python, Go, or Java building automation, tooling, or production backend services.
  • Cloud-Native Operations: Solid experience running distributed, containerized systems in production using Kubernetes, microservices, and CI/CD.
  • SRE & Observability: Proven background in production operations, distributed troubleshooting, and monitoring stacks (Prometheus, Grafana, Splunk, or OpenTelemetry).
  • Cloud Platforms: Hands-on working knowledge of AWS, Azure, or GCP.
Preferred Qualifications
  • LLM & Inference Frameworks: Hands-on experience with vLLM, TensorRT-LLM, Ray Serve, or KServe.
  • GPU Orchestration: Experience managing GPU scheduling, capacity planning, model parallelism, and performance profiling.
  • Stateful & Retrieval Data Stores: Experience operating Vector databases, search engines, or distributed cache layers (e.g., Milvus, Pinecone, Redis).
  • GenAI Architectures: Familiarity with RAG pipelines, model routing, Model Context Protocol (MCP), and agent runtimes.
  • Advanced SRE Design: Track record designing multi-region high-availability systems, automated remediation, and chaos engineering practices.
Why Cisco?

At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era – and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint. Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere. We are Cisco, and our power starts with you.

Cisconians power the future. We make impact as a team, innovating fast and fearlessly to create meaningful solutions on a large scale. The depth and breadth of our technology doesn't just benefit our customers – it also means limitless opportunities for us to experiment and learn. We understand the power each of our unique backgrounds bring when we work together. Because of that, we have a global network of thinkers, doers, experts, and curious creators who help one another do their life’s best work.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, Data & Scalability Platform (4-8 Yrs)
Software Engineer, Data & Scalability Platform (4-8 Yrs)

123 Cisco Systems (India) Private Limited • Bengaluru

On-site
INR 2,100,000 - 4,200,000
AI Operations Engineer
AI Operations Engineer

Cisco • Hyderabad

On-site
INR 900,000 - 1,500,000
AI Operations Engineer
AI Operations Engineer

Cisco Systems, Inc • Hyderabad

On-site
INR 4,000,000 - 7,500,000
Software Engineer/Platform Engineer - Kubernetes + Golang/Python + AI (5+ Years)
Software Engineer/Platform Engineer - Kubernetes + Golang/Python + AI (5+ Years)

123 Cisco Systems (India) Private Limited • Bengaluru

On-site
INR 3,000,000 - 5,200,000
Forward Deployed Engineer
Forward Deployed Engineer

123 Cisco Systems (India) Private Limited • Bengaluru

On-site
INR 2,500,000 - 4,500,000
Software Engineering Technical Leader | Enterprise AI Platforms, Infrastructure & Automation
Software Engineering Technical Leader | Enterprise AI Platforms, Infrastructure & Automation

Cisco • Bengaluru

On-site
INR 4,500,000 - 7,000,000
Software Engineer | Distributed System + Fullstack (Python,Go, Java) + AI - 7+ years
Software Engineer | Distributed System + Fullstack (Python,Go, Java) + AI - 7+ years

Cisco Systems, Inc • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Machine Learning Engineering Technical Leader
Machine Learning Engineering Technical Leader

123 Cisco Systems (India) Private Limited • Hyderabad

On-site
INR 4,500,000 - 7,500,000
Software Engineer | Distributed System + Fullstack (Python,Go, Java) + AI - 7+ years
Software Engineer | Distributed System + Fullstack (Python,Go, Java) + AI - 7+ years

Cisco • Bengaluru

On-site
INR 3,000,000 - 6,000,000
Software Engineer
Software Engineer

Cisco Systems, Inc • Bengaluru

On-site
INR 1,800,000 - 3,000,000