Senior AI Observability Engineer - Remote & SRE

Tealium; United States; Remote; USD 160,000 - 230,000; Full time

Benefits offered by this job

Remote-first working

New hire equity grants

Home office stipend

Paid time off & holidays

Job summary

Tealium seeks a Senior or Staff Observability/SRE Engineer to drive the observability strategy for customer-facing products, AI features, and platform services. You will own telemetry pipelines, SRE practices, and cost controls across AI-powered systems.

You will collaborate with SRE, MLOps, data engineering, security, and product teams to implement scalable reliability solutions, with emphasis on AI observability and model performance.

Qualifications

• 6+ years in SRE/Observability for 24x7 production systems.
• Experience with OpenTelemetry and telemetry platforms (Datadog, Prometheus, etc.).
• Hands-on with AI/ML observability, GenAI workflows, and cost attribution.

Responsibilities

• Lead end-to-end observability design and OpenTelemetry pipelines across Tealium products and services.
• Define SLOs, error budgets, and production-readiness requirements with cross-functional teams.
• Architect AI observability solutions for model usage, latency, retries, and cost attribution.
• Ensure end-to-end traceability across user requests, prompts, model calls, and downstream services while protecting data privacy.
• Build automated dashboards, alerts, runbooks, and incident response views.
• Define signals for response quality, groundedness, guardrails, and task completion in AI systems.
• Participate in on-call rotation (≈20% of time) and drive proactive failure testing.

Skills

Observability

SRE

Platform Engineering

OpenTelemetry

AWS

Java

Python

Go

Tools

Datadog

Sumo Logic

Prometheus

Grafana

Terraform

Kubernetes

Argo CD

Jenkins

GitHub Actions

Job description

Tealium seeks a Senior or Staff Observability/SRE Engineer to drive the observability strategy for customer-facing products, AI features, and platform services. You will own telemetry pipelines, SRE practices, and cost controls across AI-powered systems.

You will collaborate with SRE, MLOps, data engineering, security, and product teams to implement scalable reliability solutions, with emphasis on AI observability and model performance.