Senior Principal Data Engineer — Real-Time Telemetry Pipelines

Palo Alto Networks; Santa Clara (CA); On-site; USD 184,000 - 297,000; Full time

Job summary

Palo Alto Networks seeks a Data Pipeline Engineer to architect and scale high-volume data pipelines ingesting logs and telemetry from our security engines. You will transform massive data streams into actionable intelligence powering threat detection and analytics in real time.

Ideal candidates have strong backend streaming experience, cloud infrastructure on GCP, proficiency in Go, Python, or Java, and hands-on work with OTEL, time-series databases, and modern data warehouses.

Qualifications

• BS/MS in Computer Science, Data Engineering, or related field (or equivalent practical experience).
• 14+ years of software or data engineering experience with distributed, high-throughput streaming data pipelines.

Responsibilities

• Design, build, and scale high-throughput log and telemetry ingest pipelines with ultra-low latency.
• Implement observability frameworks using OpenTelemetry to capture traces, metrics, and logs across microservices.
• Architect and manage a performant trace lake to store, index, and query network forensics for threat hunting and ML training.
• Develop and maintain benchmark infrastructure to validate pipeline performance, latency, reliability, and data integrity.

Skills

Go

Python

Java

GCP

Education

BS/MS in Computer Science or related field

Tools

Terraform

Kubernetes

ClickHouse

Elasticsearch

OpenTelemetry

Job description

Palo Alto Networks seeks a Data Pipeline Engineer to architect and scale high-volume data pipelines ingesting logs and telemetry from our security engines. You will transform massive data streams into actionable intelligence powering threat detection and analytics in real time.

Ideal candidates have strong backend streaming experience, cloud infrastructure on GCP, proficiency in Go, Python, or Java, and hands-on work with OTEL, time-series databases, and modern data warehouses.