Software Engineer (Agentic AI, LLM, Python | 5 to 8 Years)

123 Cisco Systems (India) Private Limited; Bengaluru; On-site; INR 1,000,000 - 1,800,000; Full time

Benefits offered by this job

Restaurant d'entreprise

Indemnités de stage/alternance

Job summary

123 Cisco Systems (India) Private Limited is seeking an experienced machine learning engineer to lead backend design and AI/LLM initiatives in Bengaluru. You will align architecture for data, cloud, and AI platforms and drive scalable Python backends and data pipelines.

You will mentor engineers, advance LangGraph-based multi-agent workloads, and optimize token, latency, and cost for production LLM systems while collaborating with product and design teams to achieve business goals.

Qualifications

• 5–10 years of hands-on experience in machine learning engineering, backend development and applied AI.
• Deep experience with Agentic AI, LLM applications, LangGraph, and RAG architectures.
• Proven experience operationalizing deep learning and LLM models in production.
• Proven experience deploying LangGraph and multi-agent workloads with versioned prompts, runtime safeguards, and rollback strategy.
• Strong experience defining and implementing token, latency, throughput, and cost optimization strategies for LLM systems.
• Experience with LLM evaluation and observability tooling (e.g., LangSmith or equivalent).
• Expertise in ETL optimization, including workload-aware scheduling, partition pruning, caching, and storage-format tuning.
• Strong expertise in Python, backend engineering, and distributed systems.

Responsibilities

• Align to overall architecture and technical design for backend, data, cloud, and AI platforms.
• Lead the design of scalable Python backend systems and data pipelines.
• Drive architecture and development of complex Agentic AI/LLM systems using LangGraph.
• Define strategies for LLM performance, token, latency, and cost optimization.
• Establish standards for AI/RAG architecture, APIs, databases, and distributed systems.
• Drive AWS and cloud-native architecture using S3, SQS, SNS, Lambda, Docker, and Kubernetes.
• Lead complex technical and production issues across teams.
• Mentor engineers and influence engineering standards and technical direction.
• Partner with stakeholders to align technical strategy with business goals.

Skills

Python

Backend engineering

Distributed systems

Machine learning engineering

LangGraph

LLM applications

Observability tooling

Tools

AWS

Docker

Kubernetes

LangSmith

S3

SQS

SNS

Lambda

Job description

Develops software consistent with Cisco ‘Design Thinking Principles’ with a focus on simplification and UX (User Experience) at its core, using secure coding practices, ensuring user privacy, and following software development best practices. Partners with other teams including design and product management to create the right solution for the customers. Creates technical design documentation to be used by the team as well as contributing to user documentation to be used by end users. Debugs and addresses software issues during development and in production systems to support customers. Brings new ideas for product innovation and helps improve software development processes.

What You’ll Do:

• Align to overall architecture and technical design for backend, data, cloud, and AI platforms.
• Lead the design of scalable Python backend systems and data pipelines.
• Drive architecture and development of complex Agentic AI/LLM systems using LangGraph.
• Define strategies for LLM performance, token, latency, and cost optimization.
• Establish standards for AI/RAG architecture, APIs, databases, and distributed systems.
• Drive AWS and cloud-native architecture using S3, SQS, SNS, Lambda, Docker, and Kubernetes.
• Lead complex technical and production issues across teams.
• Mentor engineers and influence engineering standards and technical direction.
• Partner with stakeholders to align technical strategy with business goals.

Minimum Qualifications:

• Minimum 5 to 10 years of hands-on experience in machine learning engineering, backend development, and applied AI.
• Deep experience with Agentic AI, LLM applications, LangGraph, and RAG architectures.
• Proven experience operationalizing deep learning and LLM models in production.
• Proven experience deploying LangGraph and multi-agent workloads with versioned prompts, runtime safeguards, and rollback strategy.
• Strong experience defining and implementing token, latency, throughput, and cost optimization strategies for LLM systems.
• Experience with LLM evaluation and observability tooling (for example, LangSmith or equivalent).
• Expertise in ETL optimization, including workload-aware scheduling, partition pruning, caching, and storage-format tuning.
• Strong expertise in Python, backend engineering, and distributed systems.

Preferred Qualifications:

• Demonstrated ability to mentor engineers and lead large-scale, cross-functional initiatives.
• Proven ability to align technical strategy with business goals and stakeholder priorities.
• Strategic thinker with ability to translate complex requirements into scalable technical solutions.
• Knowledge of network technologies and enterprise platform integration patterns.
• Strong written and verbal communication, including executive-ready technical storytelling.
• Experience integrating Model Context Protocol and related AI tool ecosystems.

Why Cisco?

At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era – and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint. Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere. We are Cisco, and our power starts with you. Cisconians power the future. We make impact as a team, innovating fast and fearlessly to create meaningful solutions on a large scale. The depth and breadth of our technology doesn't just benefit our customers – it also means limitless opportunities for us to experiment and learn. We understand the power each of our unique backgrounds bring when we work together. Because of that, we have a global network of thinkers, doers, experts, and curious creators who help one another do their life’s best work.