Senior Data Engineer: Real-Time Personalization at Scale

Disney Entertainment & Sports

Glendale (CA)

On-site

USD 144,000 - 193,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Disney Entertainment & Sports LLC in Glendale, CA is seeking a Senior Big Data Engineer to build and optimize large-scale data pipelines for the News & Entertainment ML portfolio. You will collaborate with product managers, designers, and engineers to deliver personalized content and scalable ML platforms.

The role requires 5+ years of big data engineering, strong Python/PySpark/SQL skills, and experience with Spark, Hive, Snowflake/Redshift/BigQuery, Airflow, and AWS.

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or equivalent.
  • 5 years of related big data engineering experience building data pipelines.
  • Experience with distributed systems (Databricks, Spark, Presto, Hive) to handle petabyte-scale datasets.
  • Strong Python, PySpark and SQL proficiency.
  • Experience with cloud data platforms (Snowflake, Redshift, BigQuery, Databricks).
  • Familiarity with Data Modeling and Data Warehousing concepts.
  • Experience with Airflow and CI/CD pipelines.
  • Experience with AWS and AWS Glue.

Responsibilities

  • Build and manage data pipelines to extract, clean, and format training datasets.
  • Maintain and optimize the performance of data pipelines.
  • Enhance/redesign existing data models with input from Architecture to modernize products and improve performance and efficiency.
  • Promote and support Agile methodologies such as Scrum, Kanban, and Scrumban.
  • Collaborate with squad, Product Managers, Designers, QA, Operations, and other stakeholders to understand requirements.
  • Participate in on-call support.
  • Participate in code reviews and problem-solving.

Skills

Big data engineering
Spark / Presto / Hive
Python / PySpark / SQL
Cloud databases (Snowflake / Redshift)
Data modeling
Airflow
CI/CD
AWS / AWS Glue
Distributed systems

Education

Bachelor's degree in CS/IS/Engineering

Tools

Airflow
Databricks

Job description

Disney Entertainment & Sports LLC in Glendale, CA is seeking a Senior Big Data Engineer to build and optimize large-scale data pipelines for the News & Entertainment ML portfolio. You will collaborate with product managers, designers, and engineers to deliver personalized content and scalable ML platforms.

The role requires 5+ years of big data engineering, strong Python/PySpark/SQL skills, and experience with Spark, Hive, Snowflake/Redshift/BigQuery, Airflow, and AWS.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer — ML Pipelines & Personalization
Senior Data Engineer — ML Pipelines & Personalization

Disney • Glendale (CA)

On-site
USD 144,000 - 193,000
Senior Data Engineer, Cloud Data Platforms
Senior Data Engineer, Cloud Data Platforms

Disney Experiences • Anaheim (CA)

On-site
USD 144,000 - 193,000
Senior ML Engineer: Real-Time Ad Tech & Personalization
Senior ML Engineer: Real-Time Ad Tech & Personalization

Oracle • Seattle (WA)

On-site
USD 149,000 - 199,000
Bonus and long-term incentives
Medical and other benefits
Lead Data Engineer - Content Analytics & Pipelines
Lead Data Engineer - Content Analytics & Pipelines

Disney Entertainment and ESPN Product & Technology • Santa Monica (CA)

On-site
USD 152,200 - 204,100
Senior Data Engineer, Data Products & Warehouses
Senior Data Engineer, Data Products & Warehouses

The Walt Disney Company • Anaheim (CA)

On-site
USD 144,000 - 193,000
Senior ML Engineer: Real-Time Personalization & Recs
Senior ML Engineer: Real-Time Personalization & Recs

The Walt Disney Company • New York (NY)

On-site
USD 151,000 - 202,000
Senior Real-Time ML Infrastructure Engineer
Senior Real-Time ML Infrastructure Engineer

Disney Entertainment & Sports LLC • Glendale (CA)

On-site
USD 144,000 - 193,000
Senior Data Analyst, AI & Personalization Pipelines
Senior Data Analyst, AI & Personalization Pipelines

MaziCTools • Los Angeles (CA)

Hybrid
USD 48,000 - 63,000
Sr Data Engineer
Sr Data Engineer

Disney Entertainment & Sports • Glendale (CA)

On-site
USD 144,000 - 193,000
Software Data Engineer
Software Data Engineer

Disney Entertainment Operations LLC • New York (NY)

On-site
USD 114,000 - 152,000