Principal Data Platform Engineer — Streaming & Scale

Palo Alto Networks; California; On-site; USD 147,000 - 238,000; Full time

Job summary

Palo Alto Networks is seeking an experienced data platform engineer to design and deliver high-throughput streaming services and multi-source batch engines. You will work with product, SRE, ML, and security teams to drive scalable analytics.

You’ll profile and tune distributed pipelines and promote best practices across the engineering org. The ideal candidate has deep Golang/Python skills, cloud-native data stacks, and a track record of reducing latency while improving throughput.

Qualifications

• Bachelor's degree in Computer Science or a related field.
• Experience in designing, building, and operating scalable distributed systems.
• Proficiency in Golang and Python for backend data platforms.

Responsibilities

• Partner with Product Management, SRE, ML Engineering, Security Researchers, and Quality Engineering to design and deliver high-throughput data platform capabilities and streaming services.
• Architect and build resilient, multi-source batch and streaming engines to power analytical workflows and insights.
• Profile, benchmark, and tune distributed execution DAGs, state storage, and compute resources to maximize throughput and minimize latency.
• Mentor senior and junior engineers, conduct architectural reviews, and promote technical excellence.

Skills

Golang

Python

Distributed systems

Apache Beam

Apache Spark

GCP/Dataflow

Kubernetes

Terraform

Pub/Sub

Kafka

Education

Bachelor's degree in Computer Science or related field

Job description

Palo Alto Networks is seeking an experienced data platform engineer to design and deliver high-throughput streaming services and multi-source batch engines. You will work with product, SRE, ML, and security teams to drive scalable analytics.

You’ll profile and tune distributed pipelines and promote best practices across the engineering org. The ideal candidate has deep Golang/Python skills, cloud-native data stacks, and a track record of reducing latency while improving throughput.