Senior Production Engineer: AI-Driven Reliability

Zscaler; San Jose (CA); Hybrid; USD 152,000 - 190,000; Full time

Benefits offered by this job

Health plans

Time off plans

Parental leave options

Retirement options

Education reimbursement

In-office perks

Job summary

Zscaler, a leading cloud security company, is seeking a Sr. Production Engineer for a hybrid role in San Jose, CA or Remote, reporting to Production Engineering in Cloud Infrastructure & Operations.

You will drive an automation-first culture to improve MTTR and scale of our globally distributed infrastructure, processing 200+ billion transactions daily for millions of users. You’ll implement highly available infra across AWS, GCP, and bare-metal, write code (Python/Go), and enhance observability

Qualifications

• 3–5+ years of experience managing reliability, scalability, and availability for large-scale production services.
• Deep expertise in programming languages (Python, Go, C/C++).
• Strong background in networking protocols, Linux/RHEL systems, and distributed architecture.
• Experience in high-stakes incident management and 24/7 on-call rotation.
• Proficiency with ITIL frameworks and incident data to drive service maturity.

Responsibilities

• Implement highly available, scalable infrastructure across AWS, GCP, and bare-metal environments.
• Automate toil by writing code (Python/Go) to build self-healing systems.
• Implement and maintain observability (Prometheus, Grafana, OpenTelemetry), define SLIs/SLOs, and establish error budgets.
• Act as a lead Incident Commander (TDO on-call), develop response playbooks, and perform post-incident analyses.
• Partner with Engineering to conduct operability reviews.

Skills

Reliability engineering

Python

Go

C/C++

Networking

Linux/RHEL

Incident management

ITIL

AI tools exploration

Tools

Ansible

Terraform

Helm

Temporal

Prometheus

Grafana

OpenTelemetry

Job description

Zscaler, a leading cloud security company, is seeking a Sr. Production Engineer for a hybrid role in San Jose, CA or Remote, reporting to Production Engineering in Cloud Infrastructure & Operations.

You will drive an automation-first culture to improve MTTR and scale of our globally distributed infrastructure, processing 200+ billion transactions daily for millions of users. You’ll implement highly available infra across AWS, GCP, and bare-metal, write code (Python/Go), and enhance observability