Data Engineer

The Walt Disney Company; Bengaluru; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

The Walt Disney Company in Bengaluru is seeking a Senior Data Engineer to design and build data pipelines that measure subscriber movements and metrics. You will partner with business, analytics and infrastructure teams to identify data sources and define ETL strategies for scalable data solutions.

Responsibilities include building table structures, implementing data quality checks, and tuning SQL/ETL. Strong communication and Agile Scrum familiarity are essential for collaboration in a

Qualifications

• 5+ years of relevant data engineering experience.
• Strong understanding of data modelling principles, including dimensional modelling and data normalisation.
• Good understanding of SQL engines and advanced performance tuning.
• Ability to think strategically, analyse, and interpret market and consumer information.
• Strong communication skills - written and verbal presentations.
• Excellent conceptual and analytical reasoning competencies.
• Comfortable working in a fast-paced and highly collaborative environment.
• Familiarity with Agile Scrum principles and ceremonies.

Responsibilities

• Partner with business, analytics and infrastructure teams to design data pipelines.
• Identify internal/external data sources and design table structures.
• Define ETL strategy and automate data quality checks.
• Develop ETL routines using ETL and orchestration tools such as Airflow.
• Implement database deployments using Schema Change.
• Perform ad hoc analysis as necessary.
• Perform SQL and ETL tuning as necessary.
• Collaborate across disciplines to measure subscriber movements and metrics.
• Work with engineering teams to collect required data from internal and external systems.

Skills

Data modeling

SQL performance tuning

Strategic thinking

Communication skills

Analytical reasoning

Agile Scrum

Cross-functional teamwork

Education

Bachelor's degree in computer science or related field

Equivalent work experience

Tools

Snowflake

Redshift

Airflow

NiFi

Databricks

EMR/Spark

Schema Change

Job description

The Senior Data Engineer will contribute to the Company's success by partnering with business, analytics and infrastructure teams to design and build data pipelines to facilitate measuring subscriber movements and metrics. Collaborating across disciplines, they will identify internal/external data sources, design table structure, define ETL strategy, and automate data quality checks.

Responsibilities:

• Focus on major areas of work, typically 20% or more of role % of Time.
• Partner with technical and non-technical colleagues to understand data and reporting requirements.
• Work with engineering teams to collect required data from internal and external systems.
• Design table structures and define ETL pipelines to build performant Data solutions that are reliable and scalable in a fast-growing data ecosystem.
• Develop Data Quality checks.
• Develop and maintain ETL routines using ETL and orchestration tools such as Airflow.
• Implement database deployments using tools like Schema Change.
• Perform ad hoc analysis as necessary.
• Perform SQL and ETL tuning as necessary.

Requirements:

• Minimum and Preferred. Inclusive of Licenses/Certs (include functional experience as well as behavioural attributes and/or leadership capabilities)
• 5+ years of relevant data engineering experience.
• Strong understanding of data modelling principles, including Dimensional modeling data normalisation principles.
• Good understanding of SQL Engines and able to conduct advanced performance tuning.
• Ability to think strategically, analyse, and interpret market and consumer information.
• Strong communication skills - written and verbal presentations.
• Excellent conceptual and analytical reasoning competencies.
• Comfortable working in a fast-paced and highly collaborative environment.
• Familiarity with Agile Scrum principles and ceremonies

Preferred Qualifications:

• 2+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments, required.
• 2+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems (Snowflake or Redshift), required.
• 1+ years of experience with programming languages (e. g., Python, Pyspark), preferred.
• 1+ years of experience with data orchestration/ETL tools (Airflow, NiFi), preferred.
• Experience with Snowflake, Databricks/EMR/Spark, and/or Airflow.
• Bachelor's Degree in computer science, information systems, or a related field or equivalent work experience.