AI Reliability Engineer II - Observability & Insights

5014 Disney Entertainment & Sports LLC; New York (NY); On-site; USD 123,000 - 165,000; Full time

Job summary

Disney Entertainment and ESPN Product & Technology is seeking a Software Engineer II on the Reliability Insights team to design and build data and reporting pipelines that evaluate the real-world performance and business impact of Disney’s AI observability tools.

You will bridge backend engineering and data-driven insights, transform telemetry and logs into clear metrics, and partner with SRE, product, and platform teams to deliver dashboards and drive reliability across Disney+ and ESPN.

Qualifications

• 3+ years of backend and data pipeline engineering experience.
• Experience building scalable APIs (FastAPI, Flask).
• Experience with data platforms and distributed processing tools.

Responsibilities

• Design, build, and maintain automated feedback pipelines that capture operational outcomes and correlate them to AI model predictions.
• Develop programmatic evaluation frameworks to track model precision, recall, and drift over time.
• Build end-to-end data pipelines linking AI outputs to incident lifecycles and business impact metrics.
• Design and deploy scalable APIs, metrics layers, and dashboards for leadership and technical stakeholders.
• Capture structured feedback from end users to feed real-world usage signals back into model improvements.

Skills

Backend API development

Data pipeline engineering

Cross-functional collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

FastAPI

Flask

PySpark

SQL

Pandas

Databricks

Snowflake

GitHub

Docker

AWS/EKS

Job description

Disney Entertainment and ESPN Product & Technology is seeking a Software Engineer II on the Reliability Insights team to design and build data and reporting pipelines that evaluate the real-world performance and business impact of Disney’s AI observability tools.

You will bridge backend engineering and data-driven insights, transform telemetry and logs into clear metrics, and partner with SRE, product, and platform teams to deliver dashboards and drive reliability across Disney+ and ESPN.