SRE: Observability & Reliability Lead (DataDog)

PCI Pal

Greater London

On-site

GBP 70,000 - 90,000

Full time

38 hours ago

Be an early applicant

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

PCI Pal is seeking a Site Reliability Engineer to join our UK-based DevOps team. You will own the observability and reliability framework, primarily DataDog, and partner with development teams to improve monitoring, alerting and resilience across infrastructure and telephony.

This role involves reducing toil, managing capacity and DR readiness, mentoring the team, and guiding progressive delivery practices such as canary deployments and controlled rollouts to protect availability as the system

Qualifications

Hands-on experience with DataDog (or equivalent like New Relic, Grafana/Prometheus, Dynatrace).
Experience defining SLIs/SLOs and alerting.
Experience monitoring networking infrastructure and telemetry.
Experience with capacity planning and redundancy design.
Strong incident response and automation skills.

Responsibilities

Own the observability framework across infrastructure, networking and telephony, and define standards.
Control observability costs and optimize usage of metrics, logs, and APM.
Reduce alert noise while ensuring incidents are surfaced.
Mentor the DevOps team on reliability and observability practices.
Automate incident response workflows and release processes.
Drive resiliency improvements including redundancy and DR readiness.
Lead on incident response and postmortems for lasting fixes.
Collaborate with development teams to embed resiliency into releases (canary deployments, staged rollouts, rollback).
Engage with teams to influence monitoring maturity across the engineering function.