Lead Observability Engineer

Tria; Greater London; On-site; GBP 92,000 - 148,000; Full time

Job summary

Tria is seeking a Senior Observability Engineer / SRE Lead to assess a complex hybrid estate and design consolidated telemetry across services, platforms, infrastructure and networks. You will work with internal teams, partners and suppliers to build telemetry ownership and dashboards that reflect system health.

The role covers short-term tactical delivery and longer-term strategic roadmapping, including SLIs, SLOs and burn-rate alerting, with a focus on centralised telemetry and OpenTelemetry

Qualifications

• Proven experience leading enterprise-scale observability initiatives.
• Strong hands-on expertise with Grafana and OpenTelemetry.
• Deep understanding of metrics, logs, traces, SLIs and SLOs.
• Experience across cloud and on-prem platforms.
• Knowledge of Azure monitoring tooling.

Responsibilities

• Discover and document existing telemetry sources, monitoring tools, dashboards and ownership.
• Work with technical teams and suppliers to gain access to telemetry.
• Deliver meaningful dashboards and service health views.
• Identify gaps in telemetry, monitoring and alerting coverage and implement pragmatic improvements.
• Define health indicators for critical business journeys.
• Introduce modern observability practices where practical, including SLIs, SLOs and the roadmap towards burn-rate alerting.
• Develop a roadmap for OpenTelemetry adoption.
• Assess options for a centralised telemetry platform, including Grafana Cloud.
• Evaluate tooling rationalisation opportunities, operating costs and telemetry economics.
• Define an observability target architecture, standards and implementation roadmap.

Skills

Grafana

OpenTelemetry

Observability

Leadership

SRE

Tools

Azure Monitor

Grafana Cloud

Job description

Location: London, onsite 3 days per week (Sheffield as an alternative)

Rate: £tbd/day inside IR35

Duration: 6 months+

Are you a Senior Observability Engineer / SRE Lead, with demonstrable experience of assessing and defining observability and monitoring roadmaps within enterprise scale environments?

The Lead Observability Engineer / SRE Lead will be required to assess a complex hybrid estate, understand how services, platforms, infrastructure and networks should be monitored, and work across multiple internal teams, partners and suppliers to build a consolidated view of existing telemetry, monitoring and alerting capabilities.

As well as short term tactical objectives, the role will also be focussed on longer term strategic ones.

Responsibilities of the Lead Observability Engineer / SRE Lead will be to:

• Discover and document existing telemetry sources, monitoring tools, dashboards and ownership
• Work with technical teams and suppliers to gain access to telemetry
• Deliver meaningful dashboards and service health views
• Identify gaps in telemetry, monitoring and alerting coverage and implement pragmatic improvementsDefine health indicators for critical business journeys
• Introduce modern observability practices where practical, including SLIs, SLOs and the roadmap towards burn-rate alerting
• Develop a roadmap for OpenTelemetry adoption
• Assess options for a centralised telemetry platform, including Grafana Cloud
• Evaluate tooling rationalisation opportunities, operating costs and telemetry economics
• Define an observability target architecture, standards and implementation roadmap

The successful Lead Observability Engineer / SRE Lead will demonstrate the following:

• Proven experience leading enterprise-scale observability initiatives
• Strong hands‑on expertise with Grafana, Grafana Cloud, OpenTelemetry and modern telemetry pipelines
• Deep understanding of metrics, logs, traces, distributed tracing, alerting, SLIs, SLOs and error‑budget concepts
• Experience designing observability solutions across cloud PaaS, IaaS, on‑premises, legacy and third‑party hosted platforms
• Strong knowledge of Azure observability tooling, including Azure Monitor, Log Analytics and Application Insights

Lead Observability Engineer / SRE Lead / Lead Site Reliability Engineer