Software Engineer II — AI Performance & Reliability

Disney Cruise Line - The Walt Disney Company; New York (NY); On-site; Confidential; Full time

Job summary

Disney Entertainment and ESPN Product & Technology is seeking a Software Engineer II to design data and reporting pipelines that evaluate AI reliability and observability. You will bridge backend engineering with data-driven insights, transforming telemetry and logs into clear metrics for AI performance and incident mitigation.

You will build automated ground-truth pipelines, model evaluation frameworks, and dashboards, partnering with SRE, product, and platform teams to reduce alert noise and

Qualifications

• 3+ years of backend and data pipeline engineering experience building scalable APIs.
• Strong experience with data platforms and distributed processing tools for telemetry data.
• Understanding of precision, recall, drift, and ground-truth labeling concepts.
• Hands-on with version control, containers, and cloud deployments (GitHub, Docker, AWS/EKS).
• Proficiency with AI-assisted development tools to accelerate velocity.
• Analytical mindset to translate telemetry into reliable metrics and insights.
• Excellent cross-functional collaboration with SRE, DevOps, and product teams.

Responsibilities

• Design, build, and maintain automated pipelines linking AI outputs to incidents.
• Develop evaluation frameworks tracking model precision, recall, and drift.
• Create end-to-end data pipelines quantifying business impact and MTTR-related metrics.
• Build scalable APIs and dashboards to showcase AI ROI and system health.
• Capture and incorporate end-user feedback into model improvement cycles.

Skills

Backend API design

Data pipeline engineering

PySpark

SQL

Pandas

Databricks

Snowflake

GitHub

Docker

AWS/EKS

AI-assisted development

Education

Bachelor’s degree in Computer Science or Engineering

Tools

FastAPI

Flask

Datadog

Grafana

Conviva

Job description

Disney Entertainment and ESPN Product & Technology is seeking a Software Engineer II to design data and reporting pipelines that evaluate AI reliability and observability. You will bridge backend engineering with data-driven insights, transforming telemetry and logs into clear metrics for AI performance and incident mitigation.

You will build automated ground-truth pipelines, model evaluation frameworks, and dashboards, partnering with SRE, product, and platform teams to reduce alert noise and