AI Performance & Reliability Engineer

Disney Entertainment and ESPN Product & Technology Careers; New York (NY); On-site; USD 125,000 - 167,000; Full time

Job summary

Disney Entertainment and ESPN Product & Technology Careers in New York, NY seeks a Software Engineer II to design data pipelines and reporting dashboards that measure AI reliability and incident mitigation for Disney Streaming platforms.

You will bridge backend engineering with data-driven insights, turning telemetry, agent interactions, and logs into clear metrics and actionable guidance for leadership and engineers. This role emphasizes collaboration across SRE, product, and platform teams.

Qualifications

• 3+ years of backend and data pipeline experience.
• Experience building scalable APIs and metrics platforms.
• Strong data processing using Spark, SQL, and Python.
• Knowledge of AI model evaluation concepts and drift.

Responsibilities

• Design, build, and maintain automated data pipelines for AI observability.
• Develop evaluation frameworks tracking precision, recall, and drift over time.
• Create dashboards linking AI outputs to incident lifecycles and business impact.
• Collaborate with SRE, product, and platform teams to reduce alert fatigue.
• Deploy scalable APIs and metrics layers for leadership visibility.

Skills

Backend data pipelines

APIs (FastAPI/Flask)

Data platform engineering

PySpark

SQL

Pandas

Databricks

Snowflake

GitHub

Docker

AWS/EKS

AI model evaluation

Observability tooling

Education

Bachelor’s degree in Computer Science, Engineering, or equivalent experience

Tools

FastAPI

Flask

Datadog

Grafana

Conviva

Cursor

Claude Code

Job description

Disney Entertainment and ESPN Product & Technology Careers in New York, NY seeks a Software Engineer II to design data pipelines and reporting dashboards that measure AI reliability and incident mitigation for Disney Streaming platforms.

You will bridge backend engineering with data-driven insights, turning telemetry, agent interactions, and logs into clear metrics and actionable guidance for leadership and engineers. This role emphasizes collaboration across SRE, product, and platform teams.