Gen AI Senior Software Engineer

Cisco Systems, Inc; North Carolina; On-site; USD 170,000 - 215,000; Full time

Job summary

Cisco Systems, Inc is seeking a Senior Software Engineer with Gen AI expertise to lead the development, deployment, and management of Gen AI applications, emphasizing Retrieval Augmented Generation (RAG) and Agentic AI. The role covers on‑prem and cloud pipelines with a strong focus on AI-first engineering and responsible AI practices.

You will build scalable Gen AI frameworks, optimize model performance, and ensure data security and regulatory compliance.

Qualifications

• Bachelor's in CS/Engineering/related STEM field with 10 years of related experience or Master's with 7 years of related experience.
• 3+ years hands-on Gen AI engineering on production use cases.
• Proficiency in containerized distributed applications and DevOps/CI/CD practices.
• Proficiency in Python and experience with Gen AI frameworks and vector databases.

Responsibilities

• Design, develop, deploy, and optimize Gen AI frameworks for on-premise and cloud environments.
• Architect secure end-to-end document processing workflows (ingestion, classification, retrieval, fine-tuning).
• Implement data security, encryption, and access control to ensure compliance.
• Tune models and architectures, explore advanced techniques for performance and scalability.
• Incorporate responsible AI practices, bias detection, toxicity screening, and ethical auditing.
• Collaborate with legal and governance teams to align with privacy and security standards.
• Monitor AI infrastructure with real-time alerts and maintain system reliability.
• Stay current with Gen AI advancements to drive infrastructure improvements.

Skills

Gen AI engineering

Python

DevOps

CI/CD

Education

Bachelor's degree in CS/Engineering

Master's degree in CS/Engineering

Tools

LangChain

LlamaIndex

LangSmith

Weaviate

Pinecone

Milvus

Job description

The application window is expected to close on: 12/30/2026

Who We Are

The Cisco IT team is changing the way we run Cisco's operations by leveraging the power of technology, the best of business processes, and utilizing outstanding data insights. We are redefining how Cisco designs and delivers the employee, partner, and customer experience based on a culture that values customer service. We strive for speed and agility in all that we do. Above all else, we are kind to each other. We aspire to be an industry-leading IT team, with a strong focus on AI and security to differentiate us and foster innovation. To achieve simplicity and the best employee and customer experience, we need excellent talent and the right abilities to succeed.

Who You'll Work With

You will work with our amazing Enterprise Data & Platforms team as part of Cisco IT organization. You will build solutions and support them across our portfolio of capabilities, primarily focusing on enabling AI/ML and Generative AI capabilities in a multi-functional team setup. You will collaborate with other engineers, architects, and organization leadership.

Who You Are

We are looking for a highly skilled Senior Software Engineer with Gen AI skills to lead the development, deployment and management of Gen AI based applications and services, with a focus on Retrieval Augmented Generation (RAG) and Agentic AI. This role requires expertise in developing and supporting large-scale GenAI applications, with a strong emphasis on AI-first engineering. The successful candidate will have extensive experience in responsible AI practices, including toxicity screening and ensuring regulatory compliance across AI solutions.

What You’ll Do

Design, develop, deploy, and optimize high-performance, scalable Generative AI frameworks for on-premise and cloud environments. Architect secure workflows for end-to-end document processing, including ingestion, classification, retrieval, and automated fine-tuning pipelines. Implement robust data security, encryption, and access control protocols to ensure compliance with organizational and regulatory standards. Optimizes model architecture and hyperparameters, exploring advanced techniques and fine-tuning strategies, to achieve superior performance and address scalability challenges. Integrate responsible AI practices, including toxicity screening, bias detection, and ethical auditing, to ensure safe and compliant model deployment. Collaborate with cross-functional, legal, and governance teams to maintain alignment with evolving privacy and security frameworks. Monitor and maintain AI infrastructure with real-time alerting to ensure system stability and performance. Stay current with advancements in Generative AI, document security, and ethical AI development to drive continuous infrastructure improvement.

Minimum Qualifications

Bachelor's in Computer Science, Computer Engineering, Electrical Engineering, or a related STEM field with 10 years of related experience OR Master's + 7 years of related experience. 3+ years hands-on experience in Gen AI engineering on production use cases. Proficiency in software engineering best practices, design and development of containerized large-scale distributed applications, and use of DevOps and CI/CD tools, Proficiency in Python programming language or similar. Hands-on experience with Gen AI frameworks such as LangChain, LlamaIndex, LangSmith, AI operators, with proficiency in Python for AI operations. Experience with vector databases, such as Weaviate, Pinecone, Milvus or similar.

Preferred Qualifications

Master’s Degree in Computer Science, Computer Engineering, Electrical Engineering, or a related STEM field. Experience with design and development of advanced Agentic AI workflows orchestration.

Why Cisco?

At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era – and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint. Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere. We are Cisco, and our power starts with you.

Message to applicants applying to work in the U.S. and/or Canada:

The starting salary range posted for this position is $169,800.00 to $214,800.00 and reflects the projected salary range for new hires in this position in U.S. and/or Canada locations, not including incentive compensation*, equity, or benefits. Individual pay is determined by the candidate's hiring location, market conditions, job-related skillset, experience, qualifications, education, certifications, and/or training. The full salary range for certain locations is listed below. For locations not listed below, the recruiter can share more details about compensation for the role in your location during the hiring process. U.S. employees are offered benefits, subject to Cisco’s plan eligibility rules, which include medical, dental and vision insurance, a 401(k) plan with a Cisco matching contribution, paid parental leave, short and long-term disability coverage, and basic life insurance. Please see the Cisco careers site to discover more benefits and perks. Employees may be eligible to receive grants of Cisco restricted stock units, which vest following continued employment with Cisco for defined periods of time. U.S. employees are eligible for paid time away as described below, subject to Cisco’s policies: 10 paid holidays per full calendar year, plus 1 floating holiday for non-exempt empl