Sr Data Engineer

Disney Entertainment & Sports

Glendale (CA)

Presencial

USD 144 000 - 193 000

Tempo integral

Há 4 dias
Torna-te num dos primeiros candidatos

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Resumo da oferta

Disney Entertainment & Sports LLC in Glendale, CA is seeking a Senior Big Data Engineer to build and optimize large-scale data pipelines for the News & Entertainment ML portfolio. You will collaborate with product managers, designers, and engineers to deliver personalized content and scalable ML platforms.

The role requires 5+ years of big data engineering, strong Python/PySpark/SQL skills, and experience with Spark, Hive, Snowflake/Redshift/BigQuery, Airflow, and AWS.

Qualificações

  • Bachelor's degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or equivalent.
  • 5 years of related big data engineering experience building data pipelines.
  • Experience with distributed systems (Databricks, Spark, Presto, Hive) to handle petabyte-scale datasets.
  • Strong Python, PySpark and SQL proficiency.
  • Experience with cloud data platforms (Snowflake, Redshift, BigQuery, Databricks).
  • Familiarity with Data Modeling and Data Warehousing concepts.
  • Experience with Airflow and CI/CD pipelines.
  • Experience with AWS and AWS Glue.

Responsabilidades

  • Build and manage data pipelines to extract, clean, and format training datasets.
  • Maintain and optimize the performance of data pipelines.
  • Enhance/redesign existing data models with input from Architecture to modernize products and improve performance and efficiency.
  • Promote and support Agile methodologies such as Scrum, Kanban, and Scrumban.
  • Collaborate with squad, Product Managers, Designers, QA, Operations, and other stakeholders to understand requirements.
  • Participate in on-call support.
  • Participate in code reviews and problem-solving.

Conhecimentos

Big data engineering
Spark / Presto / Hive
Python / PySpark / SQL
Cloud databases (Snowflake / Redshift)
Data modeling
Airflow
CI/CD
AWS / AWS Glue
Distributed systems

Formação académica

Bachelor's degree in CS/IS/Engineering

Ferramentas

Airflow
Databricks

Descrição da oferta de emprego

Job Requirements

Technology is at the heart of Disney's past, present, and future. Disney Entertainment and ESPN Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more -- all working to build and advance the technological backbone for Disney's media business globally.

The team marries technology with creativity to build world-class products, enhance storytelling, and drive velocity, innovation, and scalability for our businesses. We are Storytellers and Innovators. Creators and Builders. Entertainers and Engineers. We work with every part of The Walt Disney Company's media portfolio to advance the technological foundation and consumer media touch points serving millions of people around the world.

Here are a few reasons why we think you'd love working here:

  • Building the future of Disney's media:Our Technologists are designing and building the products and platforms that will power our media, advertising, and distribution businesses for years to come.
  • Reach, Scale & Impact: More than ever, Disney's technology and products serve as a signature doorway for fans' connections with the company's brands and stories. Disney . Hulu. ESPN. ABC. ABC News...and many more. These products and brands -- and the unmatched stories, storytellers, and events they carry -- matter to millions of people globally.
  • Innovation: We develop and implement groundbreaking products and techniques that shape industry norms, and solve complex and distinctive technical problems.

News & Entertainment Machine Learning (N&E ML) team is responsible for building robust data pipelines and advanced machine learning platforms that deliver personalized experiences to users across Disney's News & Entertainment portfolio including ABC News, ABC Entertainment, National Geographic, Marvel, and Disney Studios. Our services leverage machine learning models to enable real-time content personalization and targeted distribution across web, mobile, and connected TV platforms, ensuring that users receive the most relevant and engaging content tailored to their interests. Our mission is to drive seamless, resilient, and low-latency personalized content delivery at scale, while continuously advancing our ML infrastructure and recommendation algorithms across one of the world's most iconic collections of entertainment brands.

Responsibilities
  • Build and manage data pipelines to extract, clean, and format training datasets
  • Maintain and optimize the performance of data pipelines
  • Enhance/redesign existing data models with input from Architecture in order to modernize products and/or improve performance and efficiency, and decrease costs.
  • Promote and support Agile methodologies such as Scrum, Kanban, and Scrumban by actively participating in regular ceremonies such as stand-up, retrospectives and sprint planning.
  • Collaborate with your squad, Product Managers, Designers, QA, Operations, and other stakeholders to understand requirements and articulate technical decisions and outcomes.
  • Participate in on-call support
  • Participate in code reviews and problem-solving.
Basic Qualifications
  • Bachelor's degree in Computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience.
  • 5 years of related big data engineering experience modeling and developing large data pipelines
  • Hands‑on experience with distributed systems such as Databricks compute using tools/libraries such as Spark, Presto, Hive to query and process large datasets at the petabyte level.
  • Strong Python, PySpark and SQL skills processing big datasets
  • Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query, Databricks)
  • Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices
  • Operational experience in multi‑system/services production environment as point‑of‑contact / SME
  • Problem solving skills with strong attention to detail and excellent analytical and communication skills
  • Solid experience with data integration and orchestration toolsets (e.g. Airflow), CI/CD
  • Solid experience with AWS/AWS Glue
Disclaimer
Pay Transparency

The hiring range for this position in Glendale, CA is $ $144,100 - $193,200 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job‑related knowledge, skills, and experience among other factors. A bonus and/or long‑term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered on the level and position offered.

This position is with Disney Entertainment & Sports LLC, which is part of a business we call Disney Entertainment and ESPN Product & Technology.

Disney Entertainment & Sports LLC is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Disney champions a business environment where ideas and decisions from all people help us grow, innovate, create the best stories and be relevant in a constantly evolving world.

Disability Accommodation for Employment Applications

The Walt Disney Company and its Affiliated Companies are Equal Employment Opportunity employers and welcome all job seekers including individuals with disabilities and veterans with disabilities. If you have a disability and believe you need a reasonable accommodation in order to search for a job opening or apply for a position, visit the Disney candidate disability accommodations FAQs. We will only respond to those requests that are related to the accessibility of the online application system due to a disability.

Having technical issues? View the FAQs for help.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Sr Data Engineer
Sr Data Engineer

Disney • Glendale (CA)

Presencial
USD 144 000 - 193 000
Data Engineer II
Data Engineer II

Disney Entertainment • Seattle (WA)

Presencial
USD 112 000 - 150 000
Sr Product Software Engineer
Sr Product Software Engineer

The Walt Disney Company • New York (NY)

Presencial
USD 151 000 - 202 000
Senior Product Software Engineer, Golang
Senior Product Software Engineer, Golang

The Walt Disney Company • Glendale (CA)

Presencial
USD 144 000 - 193 000
Lead Full Stack Product Software Engineer - ESPN
Lead Full Stack Product Software Engineer - ESPN

The Walt Disney Company • Bristol (CT)

Presencial
USD 158 000 - 212 000
Product Mgr II, Subscriber Data
Product Mgr II, Subscriber Data

Disney Entertainment and ESPN Product & Technology Careers • New York (NY)

Presencial
USD 119 000 - 167 000
Bonus potential
Long-term incentive units
Medical and other benefits
Senior Data Scientist
Senior Data Scientist

The Walt Disney Company • Seattle (WA)

Presencial
USD 151 000 - 202 000
Lead Data Analyst
Lead Data Analyst

The Walt Disney Company • New York (NY)

Presencial
USD 149 000 - 199 000
Sr Systems Engineer
Sr Systems Engineer

Disney Entertainment and ESPN Product & Technology Careers • New York (NY)

Presencial
USD 119 000 - 167 000
Sr Software Engineer - Content Platform Engineering
Sr Software Engineer - Content Platform Engineering

The Walt Disney Company • Glendale (CA)

Presencial
USD 144 000 - 193 000