Gen AI Senior Software Engineer: RAG & Agentic AI Lead

Cisco Systems, Inc; Durham (NC); On-site; USD 170,000 - 215,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) with Cisco matching

Paid parental leave

Short and long-term disability

Basic life insurance

Restricted stock units (RSUs)

Paid time off

Volunteer days

Job summary

Cisco Systems, Inc. is seeking a Senior Software Engineer with Gen AI expertise to lead the development, deployment, and management of Gen AI based applications, focusing on Retrieval Augmented Generation (RAG) and Agentic AI across on-premise and cloud environments.

The role demands experience with responsible AI practices, toxicity screening, regulatory compliance, and building scalable, secure AI infrastructure in production, with collaboration across legal, governance, and engineering teams.

Qualifications

• Bachelor's in Computer Science, Computer Engineering, Electrical Engineering, or related STEM field with 10 years experience OR Master's + 7 years experience.
• 3+ years hands-on Gen AI engineering on production use cases.
• Proficiency in software engineering best practices, containerized distributed apps, and DevOps/CI-CD tools.
• Proficiency in Python programming language or similar.
• Hands-on experience with Gen AI frameworks such as LangChain, LlamaIndex, LangSmith, AI operators, with proficiency in Python for AI operations.
• Experience with vector databases such as Weaviate, Pinecone, Milvus or similar.

Responsibilities

• Design, develop, deploy, and optimize high-performance, scalable Generative AI frameworks for on-premise and cloud environments.
• Architect secure workflows for end-to-end document processing, including ingestion, classification, retrieval, and automated fine-tuning pipelines.
• Implement robust data security, encryption, and access control protocols to ensure compliance with organizational and regulatory standards.
• Optimizes model architecture and hyperparameters, exploring advanced techniques and fine-tuning strategies, to achieve superior performance and address scalability challenges.
• Integrate responsible AI practices, including toxicity screening, bias detection, and ethical auditing, to ensure safe and compliant model deployment.
• Collaborate with cross-functional, legal, and governance teams to maintain alignment with evolving privacy and security frameworks.
• Monitor and maintain AI infrastructure with real-time alerting to ensure system stability and performance.
• Stay current with advancements in Generative AI, document security, and ethical AI development to drive continuous infrastructure improvement.

Skills

Gen AI engineering

Containerized apps

DevOps/CI/CD

Python

LangChain

LlamaIndex

LangSmith

AI operators

Weaviate

Pinecone

Milvus

Agentic AI workflows

Education

Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related STEM field

Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related STEM field

Tools

LangChain (tool)

Weaviate

Job description

Cisco Systems, Inc. is seeking a Senior Software Engineer with Gen AI expertise to lead the development, deployment, and management of Gen AI based applications, focusing on Retrieval Augmented Generation (RAG) and Agentic AI across on-premise and cloud environments.

The role demands experience with responsible AI practices, toxicity screening, regulatory compliance, and building scalable, secure AI infrastructure in production, with collaboration across legal, governance, and engineering teams.