ML Platform Engineer — Scalable AI Infra & SRE

Cisco Systems, Inc

Hyderabad City Taluka

À distance

PKR 2 400 000 - 3 600 000

Plein temps

Il y a 8 jours

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Résumé du poste

Cisco Systems, Inc. is hiring for a senior SRE/Platform Engineer to scale the AI services stack powering Splunk AI Platform and Services. You will manage multi-tenant LLM inference, model serving, and MCP across global cloud and GPU clusters, while ensuring reliability and cost efficiency.

You’ll build automation for seamless rollouts, autoscaling, canary deployments, and self-healing. Strong emphasis on observability, incident response, and collaboration with AI researchers and product teams.

Qualifications

  • Bachelor’s degree in CS/Engineering with 5+ years of relevant experience, or Master’s with 3+ years.
  • 3+ years of programming in Python, Go, or Java building automation, tooling, or production backend services.
  • Solid experience running distributed, containerized systems in production using Kubernetes, microservices, and CI/CD.
  • Proven background in production operations, distributed troubleshooting, and monitoring stacks (Prometheus, Grafana, Splunk, or OpenTelemetry).
  • Hands-on working knowledge of AWS, Azure, or GCP.

Responsabilités

  • Scale Core AI Services: Operate and optimize multi-tenant LLM inference, model serving, VectorDB/RAG, and MCP platforms across cloud and GPU clusters.
  • Drive Platform Resiliency: Establish and monitor SLOs/SLIs, automated health checks, and observability dashboards.
  • Automate Operations & Toil Reduction: Build automation for rollouts, autoscaling, canary deployments, self-healing, and DR.
  • Optimize GPU & Inference Performance: Tune throughput, latency, scheduling, batching, caching, and resource allocation using Kubernetes, vLLM, and Ray.
  • Incident Command & Prevention: Lead complex production incident response and root-cause analyses, implement systemic remediations.
  • Cross-Functional Enablement: Partner with AI researchers and platform teams on PRRs and on-call rotation.

Connaissances

Python
Go
Java
SRE
Observability

Formation

Bachelor’s degree in CS/Engineering
Master’s degree (optional)

Outils

Kubernetes
CI/CD
Prometheus
Grafana
Splunk
OpenTelemetry
vLLM
Ray
TensorRT-LLM
KServe

Description du poste

Cisco Systems, Inc. is hiring for a senior SRE/Platform Engineer to scale the AI services stack powering Splunk AI Platform and Services. You will manage multi-tenant LLM inference, model serving, and MCP across global cloud and GPU clusters, while ensuring reliability and cost efficiency.

You’ll build automation for seamless rollouts, autoscaling, canary deployments, and self-healing. Strong emphasis on observability, incident response, and collaboration with AI researchers and product teams.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Machine Learning Engineer
Machine Learning Engineer

Cisco Systems, Inc • Hyderabad City Taluka

À distance
PKR 2 400 000 - 3 600 000
Senior AI Platform Engineer: Scalable MLOps
Senior AI Platform Engineer: Scalable MLOps

Convo • Islamabad

Sur place
PKR 4 200 000 - 9 000 000
Medical benefits for you and family
Free lunch
Annual performance increments
+1
Senior AI/ML Ops Engineer: Scale, Deploy & Govern
Senior AI/ML Ops Engineer: Scale, Deploy & Govern

Infosys • Hyderabad City Taluka

Sur place
PKR 1 800 000 - 2 800 000
ML Engineering Lead: Generative AI & Production Systems
ML Engineering Lead: Generative AI & Production Systems

Cisco Systems, Inc • Hyderabad City Taluka

Sur place
PKR 1 800 000 - 2 400 000
Senior ML Engineer, Enterprise AI Platform
Senior ML Engineer, Enterprise AI Platform

Lseg • Hyderabad City Taluka

Sur place
PKR 29 208 000 - 40 161 000
Senior AI Platform Engineer - Kubernetes & GitOps
Senior AI Platform Engineer - Kubernetes & GitOps

Convo • Islamabad Capital Territory

Sur place
PKR 3 500 000 - 6 000 000
Medical benefits
Free lunch
Annual increments
+3
Senior MLOps Engineer - AI Inference Platform
Senior MLOps Engineer - AI Inference Platform

Dynmsol • Lahore

Sur place
PKR 1 800 000 - 3 200 000
Senior Platform & SRE Engineer: Kubernetes & Resilience
Senior Platform & SRE Engineer: Kubernetes & Resilience

Bridge Intelligence • Lahore

Sur place
PKR 2 500 000 - 5 000 000
High-spec equipment
Training budget
AI Platform Quality Engineer – MCP & Agentic Systems
AI Platform Quality Engineer – MCP & Agentic Systems

Lseg • Hyderabad City Taluka

Sur place
PKR 1 800 000 - 3 200 000
AI Platform Engineering Lead (Infra, Tools & AI Workflows)
AI Platform Engineering Lead (Infra, Tools & AI Workflows)

Creative Chaos • Karachi Division

Sur place
PKR 2 400 000 - 4 200 000
Lieux principaux