Software Engineer (Agentic AI, LLM, Python | 5 to 8 Years)

Cisco Systems, Inc.; Bengaluru; On-site; INR 4,000,000 - 7,500,000; Full time

Job summary

Cisco Systems, Inc. in Bengaluru is seeking an experienced ML engineering lead to design scalable Python backends and data pipelines, and to drive Agentic AI/LLM systems using LangGraph.

You will optimize LLM performance, latency, and cost, define AI/RAG architectures, and guide cloud-native AWS infrastructure with Docker and Kubernetes while mentoring teams toward robust, scalable software aligned with business goals.

Qualifications

• 5–10 years hands-on ML engineering, backend development, and applied AI.
• Deep experience with Agentic AI, LLM apps, LangGraph, and RAG architectures.
• Operationalizing deep learning and LLM models in production.
• Deploy LangGraph and multi-agent workloads with versioned prompts, runtime safeguards, and rollback strategy.
• Strong experience defining token, latency, throughput, and cost optimization strategies for LLM systems.
• Experience with LLM evaluation and observability tooling (LangSmith or equivalent).
• ETL optimization, including workload-aware scheduling, partition pruning, caching, and storage-format tuning.
• Strong expertise in Python, backend engineering, and distributed systems

Responsibilities

• Lead the design of scalable Python backend systems and data pipelines.
• Drive architecture and development of complex Agentic AI/LLM systems using LangGraph.
• Define strategies for LLM performance, token, latency, and cost optimization.
• Establish standards for AI/RAG architecture, APIs, databases, and distributed systems.
• Drive AWS and cloud-native architecture using S3, SQS, SNS, Lambda, Docker, and Kubernetes.
• Lead complex technical and production issues across teams.
• Mentor engineers and influence engineering standards and technical direction.
• Partner with stakeholders to align technical strategy with business goals.

Skills

Python

LangGraph

LLM systems

Agentic AI

AWS

Docker

Kubernetes

Distributed systems

ETL optimization

Observability tooling

Mentoring

Tools

LangSmith

S3

SQS

SNS

Lambda

Job description

Develops software consistent with Cisco ‘Design Thinking Principles’ with a focus on simplification and UX (User Experience) at its core, using secure coding practices, ensuring user privacy, and following software development best practices. Partners with other teams including design and product management to create the right solution for the customers. Creates technical design documentation to be used by the team as well as contributing to user documentation to be used by end users. Debugs and addresses software issues during development and in production systems to support customers. Brings new ideas for product innovation and helps improve software development processes.
What You’ll Do:

• Lead the design of scalable Python backend systems and data pipelines.
• Drive architecture and development of complex Agentic AI/LLM systems using LangGraph.
• Define strategies for LLM performance, token, latency, and cost optimization.
• Establish standards for AI/RAG architecture, APIs, databases, and distributed systems.
• Drive AWS and cloud-native architecture using S3, SQS, SNS, Lambda, Docker, and Kubernetes.
• Lead complex technical and production issues across teams.
• Mentor engineers and influence engineering standards and technical direction.
• Partner with stakeholders to align technical strategy with business goals.

Minimum Qualifications:

• Minimum 5 to 10 years of hands‑on experience in machine learning engineering, backend development, and applied AI.
• Deep experience with Agentic AI, LLM applications, LangGraph, and RAG architectures.
• Proven experience operationalizing deep learning and LLM models in production.
• Proven experience deploying LangGraph and multi‑agent workloads with versioned prompts, runtime safeguards, and rollback strategy.
• Strong experience defining and implementing token, latency, throughput, and cost optimization strategies for LLM systems.
• Experience with LLM evaluation and observability tooling (for example, LangSmith or equivalent).
• Expertise in ETL optimization, including workload‑aware scheduling, partition pruning, caching, and storage‑format tuning.
• Strong expertise in Python, backend engineering, and distributed systems

Preferred Qualifications

• Demonstrated ability to mentor engineers and lead large‑scale, cross‑functional initiatives.
• Proven ability to align technical strategy with business goals and stakeholder priorities.
• Strategic thinker with ability to translate complex requirements into scalable technical solutions.
• Knowledge of network technologies and enterprise platform integration patterns.
• Strong written and verbal communication, including executive‑ready technical storytelling.
• Experience integrating Model Context Protocol and related AI tool ecosystems.

Why Cisco?

At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era – and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint.

Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere.

We are Cisco, and our power starts with you.