Sr Data Engineer

Disney Company

San Francisco (CA)

On-site

USD 155,000 - 208,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

The Walt Disney Company’s Disney Entertainment and ESPN Product & Technology team is seeking a senior data engineer to build and maintain Identity and Device data products. You will work with Databricks, Spark, and a modern data stack to deliver scalable data pipelines that power enterprise-wide customer identifiers and insights.

You will collaborate across squads, participate in on-call support, and contribute to architecture discussions while advancing data modeling and warehousing best

Qualifications

  • 5+ years of related big data engineering experience modeling and developing large data pipelines.
  • Hands-on experience with distributed systems such as Databricks compute using Spark, Presto, Hive to query and process large datasets at the petabyte level.
  • Strong Python, Scala/Spark and SQL skills processing big datasets.
  • Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, BigQuery, Databricks).
  • Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices.
  • Operational experience in multi-system production environment as point-of-contact / SME.
  • Strong analytical and communication skills with problem-solving abilities.
  • Solid experience with data integration and orchestration toolsets (e.g. Airflow), CI/CD.
  • Solid experience with AWS S3.

Responsibilities

  • Build and maintain product-driven initiatives to improve Identity and Device data product offerings.
  • Enhance/improve the underlying codebase to be extensible, reusable, and maintainable; increase unit test coverage.
  • Enhance/redesign data models with Architecture input to modernize products and improve performance and efficiency.
  • Promote and support Agile methodologies such as Scrum, Kanban, and Scrumban; participate in ceremonies.
  • Collaborate with squad, Product Managers, Designers, QA, Operations, and other stakeholders to share requirements and decisions.
  • Participate in on-call support.
  • Participate in code reviews and problem-solving.

Skills

Big data engineering
Python
Scala/Spark
SQL
Distributed systems
Problem solving
Communication
Data integration
Airflow
AWS S3

Education

Bachelor's degree in Computer Science / Information Systems / Software / Electrical or Electronics Engineering

Tools

Databricks
Spark
Presto
Hive
Snowflake
Redshift
BigQuery
Airflow
CI/CD
AWS S3

Job description

Job ID 10163210 Location San Francisco, California, United States Business Disney Entertainment and ESPN Product & Technology Date posted Oct. 28, 2026

Technology is at the heart of Disney’s past, present, and future. Disney Entertainment and ESPN Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more – all working to build and advance the technological backbone for Disney’s media business globally.

The team marries technology with creativity to build world‑class products, enhance storytelling, and drive velocity, innovation, and scalability for our businesses.We are Storytellers and Innovators. Creators and Builders. Entertainers and Engineers. We work with every part of The Walt Disney Company’s media portfolio to advance the technological foundation and consumer media touch points serving millions of people around the world.

Here are a few reasons why we thinkyou’dlove working here:

Building the future of Disney’s media:

Our Technologists are designing and building the products and platforms that will power our media, advertising, and distribution businesses for years to come.

Reach, Scale & Impact:

More than ever, Disney’s technology and products serve as a signature doorway for fans' connections with the company’s brands and stories. Disney+. Hulu. ESPN. ABC. ABC News…and many more. These products and brands – and the unmatched stories, storytellers, and events they carry – matter to millions of people globally.

Innovation:

We develop and implement groundbreaking products and techniques that shape industrynorms, andsolve complex and distinctive technical problems.

Ad Platformsis responsible forDisney’s industry-leading ad technology and products – driving advertising performance, innovation, and value in Disney’s sports, news, and entertainment content, across all media platforms.

This role involves building and maintaining our Identity Householding Data products.These products serve as a comprehensive source of truth for enterprise-wide customer identifiers and their groupings. The role requires expert knowledge of building scalable, fault-tolerant data processing pipelines and backend to ensure the reliable delivery of both real-time and batch data.

Responsibilities:
  • Build and maintain product-driven initiatives to improve and expand Identity and Device data product offerings
  • Enhance/improve the underlying codebase to be extensible, reusable, and maintainable. Increase unit test coverage on the existing codebase.
  • Enhance/redesign existing data models with input from Architecture in order to modernize products and/or improve performance and efficiency, and decrease costs.
  • Promote and support Agile methodologies such as Scrum, Kanban, and Scrumban by actively participating in regular ceremonies such as stand-up, retrospectives and sprint planning.
  • Collaborate with your squad, Product Managers, Designers, QA, Operations, and other stakeholders to understand requirements and articulate technical decisions and outcomes.
  • Participate in on-call support
  • Participate in code reviews and problem-solving.
Basic Qualifications:
  • Bachelor's degree in Computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience.
  • 5+ years of related big data engineering experience modeling and developing large data pipelines
  • Hands‑on experience with distributed systems such as Databricks compute using tools/libraries such as Spark, Presto, Hive to query and process large datasets at the petabyte level.
  • Strong Python, Scala/Spark and SQL skills processing big datasets
  • Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query, Databricks)
  • Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices
  • Operational experience in multi‑system/services production environment as point‑of‑contact / SME
  • Problem solving skills with strong attention to detail and excellent analytical and communication skills
  • Solid experience with data integration and orchestration toolsets (e.g. Airflow), CI/CD
  • Solid experience with AWS S3
Preferred Qualifications:
  • Demonstrated ability with cloud infrastructure technologies, including Terraform.
  • Understanding of householding algorithms and third‑party data enrichment tools.

#Techatdisney

Disclaimer

PAY TRANSPARENCY

The hiring range for this position in California is $ $155,400 - $208,400 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long‑term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered on the level and position offered.

This position is withDisney Entertainment & Sports LLC, which is part of a business we callDisney Entertainment and ESPN Product & Technology.

Disney Entertainment & Sports LLC is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Disney champions a business environment where ideas and decisions from all people help us grow, innovate, create the best stories and be relevant in a constantly evolving world.

DISABILITY ACCOMMODATION FOR EMPLOYMENT APPLICATIONS

The Walt Disney Company and its Affiliated Companies are Equal Employment Opportunity employers and welcome all job seekers including individuals with disabilities and veterans with disabilities. If you have a disability and believe you need a reasonable accommodation in order to search for a job opening or apply for a position, visit the Disney candidate disability accommodations FAQs (opens in new window) . We will only respond to those requests that are related to the accessibility of the online application system due to a disability.

Having technical issues? View the FAQs for help. (opens in new window)

The Walt Disney Company, together with its subsidiaries and affiliates, is a leading diversified international family entertainment and media enterprise that includes three core business segments: Disney Entertainment, ESPN, and Disney Experiences. From humble beginnings as a cartoon studio in the 1920s to its preeminent name in the entertainment industry today, Disney proudly continues its legacy of creating world‑class stories and experiences for every member of the family. Disney’s stories, characters and experiences reach consumers and guests from every corner of the globe. With operations in more than 40 countries, our employees and cast members work together to create entertainment experiences that are both universally and locally cherished.

Hiring Process
Where Does Your Story Begin?

Explore Disney Careers and the Life at Disney blog to learn about all the amazing opportunities waiting to be discovered at The Walt Disney Company.

Be Part of the Story
The Next Chapter

Famous for grand-dame Victorians, cable cars, a dynamic waterfront, and a soaring golden bridge, San Francisco truly has it all. With trend-defining cuisine ranging from Michelin-starred dining to outrageous food trucks; world-renowned symphony, ballet, theater, and opera, plus almost boundless outdoor adventures, San Francisco justifiably stands out as one of the ultimate must‑visit cities on any traveler’s wish list.

Our senior executives bring tremendous experience, visionary thinking and a shared commitment to excellence, creativity and innovation to the day to day operation of the company.

Explore our commitments and our work to create a better world through our stories, experiences, operations, and philanthropy.

At Disney, we want everyone to belong and thrive. Creating a welcoming and respectful environment for our employees and guests is core to our company culture and our business. We strive to build supportive work environments that drive innovation and reinforce a culture in which all employees feel welcome, respected, and valued.

Heroes Work Here

Heroes Work Here reflects the long history of respect and appreciation Disney has for the U.S. Armed Services. We recognize the commitment and dedication it takes to serve your country, both as military personnel and military spouses, and value the leadership skills and sense of purpose it has instilled in you.

Sign Up for Job Alerts

Get the latest job opportunities as they become available.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Product Strategy and Operations Principal, Advertising Platforms
Product Strategy and Operations Principal, Advertising Platforms

The Walt Disney Company • San Francisco (CA)

On-site
USD 174,000 - 256,000
Senior Principal Product Manager, Advertising Strategic Growth
Senior Principal Product Manager, Advertising Strategic Growth

The Walt Disney Company • California

On-site
USD 211,000 - 309,000
Sr Machine Learning Engineer
Sr Machine Learning Engineer

Disney • Santa Monica (CA)

On-site
USD 144,000 - 193,000
Lead Product Software Engineer
Lead Product Software Engineer

The Walt Disney Company • San Francisco (CA)

On-site
USD 173,000 - 232,000
Senior Java Backend Engineer, Scalable Microservices
Senior Java Backend Engineer, Scalable Microservices

The Walt Disney Company • Santa Monica (CA)

Hybrid
USD 144,000 - 193,000
Principal Product Software Engineer
Principal Product Software Engineer

The Walt Disney Company • New York (NY)

Hybrid
USD 197,000 - 265,000
Manager, Product Software Engineer
Manager, Product Software Engineer

Disney Company • Glendale (CA)

On-site
USD 174,000 - 234,000
Sr Data Engineer
Sr Data Engineer

ESPN • Santa Monica (CA)

On-site
USD 144,000 - 193,000
Senior iOS Engineer — Media Playback in Swift
Senior iOS Engineer — Media Playback in Swift

The Walt Disney Company • Glendale (CA)

Hybrid
USD 144,000 - 193,000
Senior Data Scientist
Senior Data Scientist

The Walt Disney Company • Seattle (WA)

On-site
USD 151,000 - 202,000