Lead AI Search Engineer — Data Pipelines & LLM Infra

Cisco Systems, Inc

San Jose (CA)

On-site

USD 168,000 - 245,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cisco Systems, Inc is seeking a Technical Leader to drive the design and implementation of scalable data ingestion pipelines using Dataflow (Apache Beam) and Elasticsearch. You will own the search core, refine relevancy metrics, and lead the development of AI Agents with multi-step reasoning and tool-calling in production.

You will ensure production-grade AI capabilities through Kubernetes deployments on GCP, robust monitoring, and collaboration with stakeholders to evaluate models and integrate

Qualifications

  • Minimum qualifications include a Bachelors + 7 years, or Masters + 4 years, or PhD + 1 year of related experience.
  • 7+ years in software engineering with at least 2 years in a lead or high-level IC role.
  • 3+ years designing and operating Elasticsearch in production.
  • Proven experience in high-scale data engineering, search infrastructure, and robust ingestion pipelines with Dataflow (Apache Beam).
  • Experience leading technical projects from inception to production, including GCP and Kubernetes.

Responsibilities

  • Design and implement high-scale data ingestion pipelines using Dataflow and Elasticsearch.
  • Own the search core, refine relevancy metrics and re-ranking for accurate AI agent results.
  • Oversee development of AI Agents with multi-step reasoning, tool-calling, and stable state management.

Skills

Data engineering leadership
High-scale data ingestion
Search relevance engineering
Cross-functional leadership
Production-grade ML/AI deployment

Education

Bachelor's degree or higher in CS/ENG
7+ years related experience / Masters 4 / PhD 1

Tools

Elasticsearch
Dataflow Apache Beam
Kubernetes
GCP
REST APIs

Job description

Cisco Systems, Inc is seeking a Technical Leader to drive the design and implementation of scalable data ingestion pipelines using Dataflow (Apache Beam) and Elasticsearch. You will own the search core, refine relevancy metrics, and lead the development of AI Agents with multi-step reasoning and tool-calling in production.

You will ensure production-grade AI capabilities through Kubernetes deployments on GCP, robust monitoring, and collaboration with stakeholders to evaluate models and integrate

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead AI Search Engineer — Data Pipelines & LLM Infra
Lead AI Search Engineer — Data Pipelines & LLM Infra

Cisco Systems, Inc. • San Jose (CA)

On-site
USD 168,000 - 245,000
Senior AI Search & Data Pipeline Engineer
Senior AI Search & Data Pipeline Engineer

Cisco Systems, Inc. • Clegg (NC)

On-site
USD 129,000 - 185,000
Senior AI Search Engineer - Data Pipelines & Elastic
Senior AI Search Engineer - Data Pipelines & Elastic

Cisco Systems, Inc • Durham (NC)

On-site
USD 129,000 - 185,000
Health insurance
401(k) with company matching
Paid parental leave
+3
AI Search Engineer — Data Pipelines & Elasticsearch
AI Search Engineer — Data Pipelines & Elasticsearch

020 Cisco Systems, Inc. • North Carolina

On-site
USD 129,000 - 185,000
Lead Data Engineer — Build Scalable Data Platform
Lead Data Engineer — Build Scalable Data Platform

Elastic • United States

Hybrid
USD 113,000 - 179,000
Stock program
401k with match
Health coverage
+4
Data & AI Engineer II: Scalable ML Pipelines
Data & AI Engineer II: Scalable ML Pipelines

Cisco Systems, Inc. • San Jose (CA)

On-site
USD 112,000 - 203,000
AI-Driven Data Analyst & Platform Engineer
AI-Driven Data Analyst & Platform Engineer

Cisco Systems, Inc • United States

Remote
USD 116,000 - 151,000
Medical insurance
Dental insurance
Vision insurance
+5
Senior Data & AI Software Engineer
Senior Data & AI Software Engineer

Cisco Systems, Inc • Seattle (WA)

On-site
USD 112,000 - 203,000
Data Engineer: AI-Driven Lakehouse & Pipelines Expert
Data Engineer: AI-Driven Lakehouse & Pipelines Expert

TriSearch • Denver (CO)

Hybrid
USD 160,000 - 190,000
Health, dental, vision coverage
Hybrid/Remote work options
401(k) with company match
+5
AI Data Engineer: Build Scalable LLM Pipelines
AI Data Engineer: Build Scalable LLM Pipelines

Ethereum Technologies LLC • Scottsdale (AZ)

On-site
USD 140,000 - 190,000