Senior Gen AI Engineer - RAG & Responsible AI

Cisco Systems, Inc.

Clegg (NC)

On-site

USD 170,000 - 215,000

Full time

2 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Cisco Systems, Inc. is seeking a Senior Software Engineer with Gen AI expertise to lead development, deployment, and management of Gen AI-based applications and services, focusing on Retrieval Augmented Generation (RAG) and Agentic AI in a scalable environment.

You will design and implement end-to-end AI pipelines across on-premises and cloud platforms, ensuring security, compliance, and performance while collaborating with cross‑functional teams and governance stakeholders.

Qualifications

Bachelor's in Computer Science, Computer Engineering, Electrical Engineering or related STEM field with 10 years of experience or Master's with 7 years of experience.
3+ years hands-on Gen AI engineering on production use cases.
Proficiency in software engineering best practices, design and development of containerized large-scale distributed applications, and use of DevOps and CI/CD tools.
Proficiency in Python programming language.
Hands-on experience with Gen AI frameworks such as LangChain, LlamaIndex, LangSmith, AI operators, with proficiency in Python for AI operations.
Experience with vector databases such as Weaviate, Pinecone, Milvus or similar.

Responsibilities

Design, develop, deploy, and optimize high-performance, scalable Generative AI frameworks for on-premise and cloud environments.
Architect secure workflows for end-to-end document processing, including ingestion, classification, retrieval, and automated fine-tuning pipelines.
Implement robust data security, encryption, and access control protocols to ensure compliance with organizational and regulatory standards.
Optimizes model architecture and hyperparameters, exploring advanced techniques and fine-tuning strategies, to achieve superior performance and address scalability challenges.
Integrate responsible AI practices, including toxicity screening, bias detection, and ethical auditing, to ensure safe and compliant model deployment.
Collaborate with cross-functional, legal, and governance teams to maintain alignment with evolving privacy and security frameworks.
Monitor and maintain AI infrastructure with real-time alerting to ensure system stability and performance.
Stay current with advancements in Generative AI, document security, and ethical AI development to drive continuous infrastructure improvement.