AI-Driven Observability Lead for Streaming

The Walt Disney Company; New York (NY); On-site; USD 163,000 - 219,000; Full time

Job summary

Disney Entertainment and ESPN Product & Technology in New York, NY is seeking a Lead Software Engineer to design and build AI-driven, production-grade systems for a large-scale streaming ecosystem. You will work with engineering, product, and platform teams to embed intelligence into operations and improve reliability.

You’ll develop agentic models, real-time pipelines, and scalable APIs using modern frameworks, contribute to code reviews, and mentor junior engineers in a fast-paced,

Qualifications

• 7+ years of backend development with AI/data-driven apps and scalable APIs.
• Proficiency in Spark, PySpark, Python.
• Experience at scale in distributed environments.
• AI/ML with foundation models using LangChain/LangGraph.
• Familiar with PyTorch or TensorFlow.
• Experience with AI-assisted tooling (Claude Code).
• Proficient in GitHub, Docker, AWS/EKS.
• Strong API design, microservices, SDLC workflows.
• Analytical mindset and clear communication for cross‑functional work.

Responsibilities

• Architect and build distributed, AI-powered systems using real-time telemetry.
• Define patterns for agentic AI systems with foundation models.
• Develop data pipelines transforming telemetry into actionable insights.
• Create scalable APIs and services for engineering teams and stakeholders.
• Collaborate cross-functionally to embed intelligence into workflows.
• Drive observability, reliability, and developer productivity with AI.
• Set engineering standards and mentor junior engineers.

Skills

Backend development

AI/ML engineering

Python programming

API design

Cross-functional collaboration

Education

Bachelor's degree in CS/Engineering

Tools

Spark / PySpark

Python

LangChain

LangGraph

PyTorch / TensorFlow

GitHub

Docker

AWS / EKS

Job description

Disney Entertainment and ESPN Product & Technology in New York, NY is seeking a Lead Software Engineer to design and build AI-driven, production-grade systems for a large-scale streaming ecosystem. You will work with engineering, product, and platform teams to embed intelligence into operations and improve reliability.

You’ll develop agentic models, real-time pipelines, and scalable APIs using modern frameworks, contribute to code reviews, and mentor junior engineers in a fast-paced,