Senior Data Engineer – Large-Scale Telemetry Pipelines

JobCubby; San Francisco, Northern (CA, KY); Hybrid; USD 168,000 - 245,000; Full time

Job summary

Cisco is seeking a Data Engineer to design and operate large-scale data pipelines that transform telemetry from millions of network devices into reliable data products. You will work on high-throughput ingestion, processing, and storage within Kubernetes environments, shaping systems used across the platform.

Collaborating with product and engineering teams, you will build resilient distributed services, implement robust observability with ELK and Grafana, and drive automation using IaC tools to

Qualifications

• Experience building, operating, or debugging distributed systems or backend services that process at least 1TB of telemetry data daily.
• Programming experience using Scala, C++, or Java within a production environment.
• Experience designing and managing data pipelines applying streaming or batch processing frameworks such as Kafka, Spark, or Flink.
• Experience deploying and maintaining containerized workloads on Kubernetes clusters in a production environment.
• Experience with Terraform, Ansible, Elasticsearch, or Grafana for automating infrastructure and monitoring workflows.

Responsibilities

• Architect and operate scalable data pipelines capable of ingesting petabyte-scale telemetry from over 25 million network devices to drive global operational insights.
• Engineer resilient, high-performance distributed systems within Kubernetes environments.
• Establish robust observability standards using ELK and Grafana to proactively identify issues and streamline system recovery.
• Accelerate development lifecycle by integrating AI-assisted engineering tools to ensure secure, validated deployments.

Skills

Distributed systems

Scala

C++

Java

Kubernetes

Kafka

Spark

Flink

Grafana

Elasticsearch

Terraform

Ansible

Tools

Terraform

Ansible

Elasticsearch

Grafana

Job description

Cisco is seeking a Data Engineer to design and operate large-scale data pipelines that transform telemetry from millions of network devices into reliable data products. You will work on high-throughput ingestion, processing, and storage within Kubernetes environments, shaping systems used across the platform.

Collaborating with product and engineering teams, you will build resilient distributed services, implement robust observability with ELK and Grafana, and drive automation using IaC tools to