AI Reliability Engineer II — Observability & Insights

Kardow

New York (NY)

On-site

USD 123,000 - 165,000

Full time

14 days+

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Disney Entertainment and ESPN Product & Technology seeks a Software Engineer II to design data and reporting pipelines that evaluate AI observability tooling and reliability for Disney streaming platforms. You will transform telemetry into clear metrics on AI reliability, model drift, and incident mitigation.

You will build ground‑truth pipelines, evaluate model performance, and craft dashboards for engineering and leadership.

Qualifications

3+ years of backend and data pipeline engineering experience.
Experience with data platform engineering and distributed processing tools to process telemetry data.
Understanding of model evaluation concepts (precision, recall, drift).
Experience with GitHub, Docker, and cloud deployments (AWS/EKS).
Proficiency with AI-assisted development tools to speed engineering velocity.
Strong ability to translate telemetry into reliability metrics and insights.
Excellent cross-functional collaboration with SRE, DevOps and product teams.

Responsibilities

Design, build, and maintain automated data pipelines and AI‑driven quality signals.
Develop evaluation frameworks to track model precision, recall, and drift.
Build end-to-end pipelines linking AI outputs to incident lifecycles and MTTR.
Create scalable APIs and dashboards for leadership on AI ROI and reliability.
Capture structured user feedback to feed real‑world usage signals into improvements.