Senior Data Engineer — Identity & Household Data Platforms

Disney Cruise Line - The Walt Disney Company; San Francisco (CA); On-site; Confidential; Full time

Benefits offered by this job

Bonus & long-term incentives

Medical benefits

Job summary

Disney Cruise Line - The Walt Disney Company is seeking a senior big data engineer to design and maintain Identity and Device data products within a scalable data platform. You will improve code, modernize models, and collaborate across squads including PM, design, QA, and operations to deliver reliable data solutions.

Responsibilities include on-call participation, code reviews, and advancing AWS-based data pipelines using Databricks, Spark, and Airflow.

Qualifications

• Bachelor's degree or equivalent work experience in a technical field.
• 5+ years of big data engineering experience building large data pipelines.
• Hands-on with distributed systems (Databricks, Spark, Presto, Hive) for petabyte-scale data.
• Strong Python, Scala/Spark and SQL skills for big datasets.
• Experience with Snowflake, Redshift, BigQuery, or Databricks.
• Familiarity with data modeling techniques and data warehousing practices.
• Operational experience in multi-system production environments as SME.
• Proficient with Airflow, CI/CD, and AWS S3.

Responsibilities

• Build and maintain Identity and Device data product offerings.
• Enhance codebase to be extensible, reusable, and maintainable; increase unit test coverage.
• Modernize data models to improve performance and efficiency; reduce costs.
• Promote Agile practices through stand-ups, retrospectives, and sprint planning.
• Collaborate with squad, Product Managers, Designers, QA, Operations to decide on technical outcomes.
• Participate in on-call support and code reviews.

Skills

Python

Scala/Spark

SQL

Databricks

Spark

Airflow

AWS S3

CI/CD

Data modeling

Data warehousing

Snowflake

Redshift

BigQuery

Terraform

Education

Bachelor's degree in Computer science or related field

Tools

Airflow

CI/CD tooling

Terraform

Job description

Disney Cruise Line - The Walt Disney Company is seeking a senior big data engineer to design and maintain Identity and Device data products within a scalable data platform. You will improve code, modernize models, and collaborate across squads including PM, design, QA, and operations to deliver reliable data solutions.

Responsibilities include on-call participation, code reviews, and advancing AWS-based data pipelines using Databricks, Spark, and Airflow.