Lead Observability Engineer: Cloud, Datadog & OpenTelemetry

Trekrecruit

United States

Remote

USD 120,000 - 170,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Trekrecruit is seeking a senior Observability Engineer to design and maintain end-to-end monitoring platforms across cloud-native environments.

You will instrument applications, dashboards, and alerts using OpenTelemetry, Prometheus, Grafana, and Datadog, collaborating with SRE and DevOps teams to enable proactive reliability and performance insights. This role emphasizes security, incident response, and scalable instrumentation across AWS, Azure, and GCP.

Qualifications

  • Experience designing and operating observability platforms across complex systems.
  • Proficient in instrumenting applications and infrastructure to collect telemetry data.
  • Knowledge of logs, metrics, and traces concepts and related tooling.

Responsibilities

  • Design and implement solutions to provide deep insights through logs, metrics, and traces.
  • Instrument applications, infrastructure, and services to collect telemetry data using OpenTelemetry.
  • Develop dashboards, reports, and alerts with Prometheus, Grafana, and Splunk to visualize performance and detect issues.
  • Collaborate with development, SRE, and DevOps to align monitoring with business goals.
  • Automate monitoring configurations using IaC tools like Ansible and Terraform.
  • Implement end-to-end observability with Datadog across infrastructure, apps, and services.
  • Instrument agents for on-premise, cloud, and hybrid environments.
  • Design dashboards, monitors, SLAs/SLOs, and anomaly detection with alerting.
  • Integrate Datadog with third-party tools like ServiceNow and SSO.ITSM workflows.

Skills

Observability tools
Programming languages
Cloud platforms
IaC
CI/CD
System & software engineering
Observability concepts

Tools

Prometheus
Grafana
ELK Stack
Splunk
Datadog
New Relic
AWS CloudWatch
OpenTelemetry
Terraform
Ansible
Jenkins

Job description

Trekrecruit is seeking a senior Observability Engineer to design and maintain end-to-end monitoring platforms across cloud-native environments.

You will instrument applications, dashboards, and alerts using OpenTelemetry, Prometheus, Grafana, and Datadog, collaborating with SRE and DevOps teams to enable proactive reliability and performance insights. This role emphasizes security, incident response, and scalable instrumentation across AWS, Azure, and GCP.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Observability Engineer: Build Scalable Telemetry
Senior Observability Engineer: Build Scalable Telemetry

Evolutyz Corp • Brea (CA)

On-site
USD 150,000 - 190,000
Senior Observability Engineer – Dynatrace & Cloud Monitoring
Senior Observability Engineer – Dynatrace & Cloud Monitoring

VMC Soft Technologies • Allen (TX)

On-site
USD 90,000 - 120,000
Senior Observability Engineer — Remote Cloud Monitoring
Senior Observability Engineer — Remote Cloud Monitoring

Prestige Staffing • Oak Hill (WV)

Remote
USD 100,000 - 130,000
Observability & SRE Engineer: Cloud, Automation & Reliability
Observability & SRE Engineer: Cloud, Automation & Reliability

Ontrac Solutions LLC. • Chicago (IL)

Hybrid
USD 124,000 - 138,000
Platform Reliability Engineer – Observability & FinOps
Platform Reliability Engineer – Observability & FinOps

Appnovation • Dallas (TX)

On-site
USD 120,000 - 160,000
Lead DevOps Engineer
Lead DevOps Engineer

Trekrecruit • United States

Remote
USD 120,000 - 170,000
Senior Cloud Engineer - Observability Platform
Senior Cloud Engineer - Observability Platform

CVS Health • Missouri

Hybrid
USD 107,000 - 284,000
Observability & Infra Lead (Multi-Region)
Observability & Infra Lead (Multi-Region)

EPAM Systems Inc • New York (NY)

Remote
USD 145,000 - 160,000
Medical, Dental and Vision Insurance (
Health Savings Account
Flexible Spending Accounts (Healthcare
+7
Senior Observability Engineer - Remote
Senior Observability Engineer - Remote

Bright Vision Technologies • Sunnyvale (CA)

Remote
USD 115,000 - 165,000
Senior Observability Engineer - Cloud Telemetry & Metrics
Senior Observability Engineer - Cloud Telemetry & Metrics

Etsy, Inc. • New York (NY)

Hybrid
USD 159,000 - 215,000
Equity package
Annual performance bonus
Benefits