Principal AI Platform Engineer - Hybrid (San Jose)

020 Cisco Systems, Inc.

San Jose (CA)

Hybrid

USD 296,000 - 375,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cisco Systems, Inc. is seeking a Principal Machine Learning Engineer to architect and build scalable AI foundations for CX IQ. You will own multi-tenant AI services, optimize inference at scale, and guide platform governance across cloud, on‑prem, and air‑gapped environments.

You will lead and collaborate with teams to improve latency, memory, and compute efficiency while mentoring engineers and shaping strategic directions for AI infrastructure in a dynamic, security‑conscious setting.

Qualifications

  • Production-grade, multi-tenant distributed systems experience.
  • Deployment of production LLM/SLM runtimes with batching/decay controls.
  • Experience with production RAG systems and vector databases.
  • Ability to lead architecture reviews and mentor engineers.

Responsibilities

  • Design and scale the foundational AI platform powering Cisco IQ across cloud, on‑prem, and air‑gapped environments.
  • Lead architecture and trade‑off discussions; drive governance and best practices.
  • Mentor senior engineers and influence platform direction through hands‑on leadership.
  • Collaborate with cross‑functional teams to ensure reliability and performance at scale.

Skills

Go
Python
Distributed systems
LLM inference
RAG workflows
CI/CD
Observability
Edge deployment

Education

PhD in related field

Tools

vLLM
SGLang
Triton
LangGraph

Job description

Cisco Systems, Inc. is seeking a Principal Machine Learning Engineer to architect and build scalable AI foundations for CX IQ. You will own multi-tenant AI services, optimize inference at scale, and guide platform governance across cloud, on‑prem, and air‑gapped environments.

You will lead and collaborate with teams to improve latency, memory, and compute efficiency while mentoring engineers and shaping strategic directions for AI infrastructure in a dynamic, security‑conscious setting.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal ML Engineer — AI Platform Architect (Hybrid)
Principal ML Engineer — AI Platform Architect (Hybrid)

Cisco Systems, Inc. • San Jose (CA)

Hybrid
USD 296,000 - 375,000
401(k) matching
Medical, dental, vision insurance
Paid parental leave
Principal ML Engineer: AI Platform Architect (Hybrid, San Jose)
Principal ML Engineer: AI Platform Architect (Hybrid, San Jose)

Cisco Systems, Inc. • San Jose (CA)

Hybrid
USD 296,000 - 375,000
Senior AI Infra Systems Architect & Lead Engineer
Senior AI Infra Systems Architect & Lead Engineer

Cisco Systems, Inc • North Carolina

On-site
USD 150,000 - 230,000
Senior ML Platform Lead — Enterprise CX AI
Senior ML Platform Lead — Enterprise CX AI

Cisco Systems, Inc • San Jose (CA)

Hybrid
USD 257,000 - 333,000
Medical, dental and vision insurance
401(k) with Cisco matching
Paid parental leave
+2
Senior ML Platform Architect - Foundational AI & Inference
Senior ML Platform Architect - Foundational AI & Inference

Cisco Systems, Inc. • San Jose (CA)

Hybrid
USD 260,000 - 380,000
Medical, Dental, Vision
401(k) matching
Paid parental leave
+1
Principal AI Platform Engineer
Principal AI Platform Engineer

Cisco • Milpitas (CA)

On-site
USD 296,000 - 375,000
Medical, dental, vision insurance
401(k) with Cisco matching
Parental leave
+1
Lead ML Engineer — AI Security & Scalable Platforms
Lead ML Engineer — AI Security & Scalable Platforms

Cisco Systems • Milpitas (CA)

Hybrid
USD 198,000 - 323,000
Medical insurance
Dental insurance
Vision insurance
+3
Senior AI Infrastructure Solutions Engineer (Hybrid)
Senior AI Infrastructure Solutions Engineer (Hybrid)

Cisco Systems, Inc. • San Francisco (CA)

Hybrid
USD 229,000 - 300,000
Health insurance
401(k) plan
Paid time off
Lead AI Platform Architect
Lead AI Platform Architect

Cisco Systems, Inc. • Milpitas (CA)

On-site
USD 296,000 - 375,000
Senior Backend Architect - AI Studio Platform
Senior Backend Architect - AI Studio Platform

Cisco Systems, Inc • Milpitas (CA)

Hybrid
USD 187,000 - 268,000
Health benefits