Staff Site Reliability Engineer - Observability GCP

Okta; Bellevue (WA); On-site; USD 174,000 - 239,000; Full time

Benefits offered by this job

Health insurance

401(k)

Paid leave

Parental leave

Job summary

Okta in Bellevue, WA, seeks a highly technical Observability Site Reliability Engineer to enhance its Observability ecosystem on Google Cloud. This role involves designing a scalable Observability Platform and automating processes using Terraform and coding in Go or Python.

The ideal candidate will have extensive experience with GCP, Splunk, Grafana, and a strong understanding of distributed systems. Compensation ranges from $174,000 to $239,000 depending on the location, and includes health benefits and bonuses.

Qualifications

• 5+ years of experience scaling observability on GCP.
• 3+ years in an SRE, DevOps, or Systems Engineering role.
• Strong coding skills in Python and Go.

Responsibilities

• Design and maintain scalable observability infrastructure.
• Optimize collection and processing of observability data.
• Lead post-incident reviews for systemic improvements.

Skills

GCP Observability

Terraform

Python

Go

Grafana

Splunk

Kubernetes

Job description

Secure Every Identity, from AI to Human

Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence.

This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk.

We are seeking a highly technical Observability Site Reliability Engineer with a specialty in Google Cloud, to own and expand our Observability ecosystem into GCP. In this role, you will move beyond simple monitoring to delivering a world‑class, comprehensive, scalable Observability Platform that enables our SRE teams and business partners. You will treat infrastructure as code—utilizing Terraform and strong coding proficiency in Go, Python, or Ruby—to automate the deployment of agents and collectors across complex distributed systems.

Key Responsibilities

• Automated Infrastructure: Design, build, and maintain scalable observability infrastructure using tools like Terraform.
• GCP Observability Engineering: Optimize the collection, processing, and storage of Observability data to ensure high reliability and low latency of our Splunk and Grafana services.
• Incident Response: Participate in on-call rotations and lead post-incident reviews to drive systemic improvements and observability‑driven development.
• Automation: Eliminate toil by automating the deployment and scaling of observability agents and collectors.

Required Skills & Experience (The Essentials)

GKE: Minimum 5+ years of experience scaling and managing observability in a Google Cloud platform.

Visualization: Expertise in creating intuitive, actionable Splunk or Grafana dashboards that correlate data across multiple sources.

SRE Mindset: Minimum 3+ years of experience in an SRE, DevOps, or Systems Engineering role with a focus on high‑availability systems.

• Programming Proficiency: Strong coding skills in Python, Go for building internal tools and automating workflows.
• Distributed Systems: Deep understanding of Linux internals, networking (TCP/IP, DNS, Load Balancing), and container orchestration (Kubernetes/GKE).
• Problem Solving: A data‑driven approach to debugging complex, cross-service performance bottlenecks.

Bonus Skills (Nice-to-Haves)

• Telemetry Standards: Hands‑on experience with OpenTelemetry (OTel), Vector, or similar frameworks for instrumenting applications.
• Grafana Loki: Experience in migrating Splunk to Grafana Loki.

Other Cloud Platforms

Experience managing observability native tools within AWS.

Additional Requirements

• This position requires the ability to access federal environments and/or have access to protected federal data. As a condition of employment for this position, the successful candidate must be able to submit documentation establishing U.S. Person status (e.g., a U.S. Citizen, National, Lawful Permanent Resident, Refugee, or Asylee) upon hire.

Compensation

The annual base salary range for candidates located in the San Francisco Bay area is $194,000—$267,000 USD. For candidates located in California (excluding the San Francisco Bay Area), Colorado, Illinois, New York, and Washington, the range is $174,000—$239,000 USD. Compensation includes base salary, equity (where applicable), bonus, and benefits such as health, dental, vision insurance, 401(k), paid leave, and parental leave.

Equal Opportunity Employer

Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. Okta also considers for employment qualified applicants with arrest and convictions records, consistent with applicable laws.

If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding, use this form to request an accommodation.

Notice for New York City Applicants & Employees: Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, click here to view our full NYC AEDT Notice.