Gen AI Senior Software Engineer - RAG & Agentic AI

Cisco Systems, Inc; North Carolina; On-site; USD 170,000 - 215,000; Full time

Job summary

Cisco Systems, Inc is seeking a Senior Software Engineer with Gen AI expertise to lead the development, deployment, and management of Gen AI applications, emphasizing Retrieval Augmented Generation (RAG) and Agentic AI. The role covers on‑prem and cloud pipelines with a strong focus on AI-first engineering and responsible AI practices.

You will build scalable Gen AI frameworks, optimize model performance, and ensure data security and regulatory compliance.

Qualifications

• Bachelor's in CS/Engineering/related STEM field with 10 years of related experience or Master's with 7 years of related experience.
• 3+ years hands-on Gen AI engineering on production use cases.
• Proficiency in containerized distributed applications and DevOps/CI/CD practices.
• Proficiency in Python and experience with Gen AI frameworks and vector databases.

Responsibilities

• Design, develop, deploy, and optimize Gen AI frameworks for on-premise and cloud environments.
• Architect secure end-to-end document processing workflows (ingestion, classification, retrieval, fine-tuning).
• Implement data security, encryption, and access control to ensure compliance.
• Tune models and architectures, explore advanced techniques for performance and scalability.
• Incorporate responsible AI practices, bias detection, toxicity screening, and ethical auditing.
• Collaborate with legal and governance teams to align with privacy and security standards.
• Monitor AI infrastructure with real-time alerts and maintain system reliability.
• Stay current with Gen AI advancements to drive infrastructure improvements.

Skills

Gen AI engineering

Python

DevOps

CI/CD

Education

Bachelor's degree in CS/Engineering

Master's degree in CS/Engineering

Tools

LangChain

LlamaIndex

LangSmith

Weaviate

Pinecone

Milvus

Job description

Cisco Systems, Inc is seeking a Senior Software Engineer with Gen AI expertise to lead the development, deployment, and management of Gen AI applications, emphasizing Retrieval Augmented Generation (RAG) and Agentic AI. The role covers on‑prem and cloud pipelines with a strong focus on AI-first engineering and responsible AI practices.

You will build scalable Gen AI frameworks, optimize model performance, and ensure data security and regulatory compliance.