Principal Observability Engineer

ISG Search Inc; Toronto; On-site; CAD 160,000 - 230,000; Full time

Job summary

ISG Search Inc is seeking a Principal Observability Engineer in Toronto to lead the architecture and implementation of enterprise observability solutions.

You will develop dashboards and monitoring with Splunk, Grafana, OpenTelemetry, Prometheus, and AWS CloudWatch, across cloud and Kubernetes environments, and mentor teams.

Candidates should have 10+ years in Platform/SRE, strong AWS/Kubernetes skills, and experience with Terraform, Ansible, Python or Bash.

Qualifications

• 10+ years of experience in Platform Engineering, SRE, or related infrastructure discipline.
• Hands-on experience with Splunk and modern observability platforms (Splunk Observability, OpenTelemetry, Grafana, Prometheus, AWS CloudWatch).
• Deep expertise with AWS, Kubernetes/OpenShift, and infrastructure automation tools (Terraform, Ansible, Python, Bash).

Responsibilities

• Lead architecture, design, and implementation of enterprise observability solutions and monitoring frameworks.
• Develop dashboards, alerting, and monitoring capabilities across cloud/Kubernetes environments.
• Provide technical leadership, establish observability best practices, and mentor engineering teams.

Skills

Observability leadership

SRE/Platform engineering

Cloud architecture

Kubernetes

IaC (Terraform/Ansible)

Scripting (Python/Bash)

Stakeholder communication

Tools

Splunk

Splunk Observability

OpenTelemetry

Grafana

Prometheus

AWS CloudWatch

Terraform

Ansible

Python

Bash

Kubernetes/OpenShift

Job description

Principal Observability Engineer (BBBH11976) Toronto, Canada

Job title:

Principal Observability Engineer

Duration:

12-month contract (extension possible)

Principal tasks and responsibilities include:

• Lead the architecture, design, and implementation of enterprise observability solutions and monitoring frameworks.
• Develop and enhance dashboards, alerting, and monitoring capabilities using Splunk, Splunk Observability, OpenTelemetry, Grafana, Prometheus, and AWS CloudWatch.
• Design and support observability across cloud and Kubernetes-based environments, driving platform performance and reliability.
• Develop infrastructure automation using Infrastructure as Code (IaC), scripting, and configuration management tools.
• Provide technical leadership, establish observability best practices, and mentor engineering teams.

Our client:

A large global enterprise organization

Qualifications and pre-requisites:

• 10+ years of experience in Platform Engineering, Site Reliability Engineering (SRE), Systems Engineering, or a related infrastructure discipline.
• Strong hands-on experience with Splunk and modern observability platforms, including Splunk Observability, OpenTelemetry, Grafana, Prometheus, and AWS CloudWatch.
• Deep expertise with AWS, Kubernetes/OpenShift, and infrastructure automation tools such as Terraform, Ansible, Python, or Bash.
• Proven experience designing scalable monitoring and observability solutions within large enterprise environments.
• Strong communication and leadership skills with the ability to collaborate across technical and business teams.

Additional information or perks:

• Experience with additional cloud platforms (Azure or GCP), Red Hat technologies, virtualization, storage, backup, or identity management is considered an asset.
• Relevant certifications such as Splunk, AWS, or Kubernetes are highly desirable.

isgSearch does not use artificial intelligence throughout the hiring process.