Lead Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate

Deloitte & Touche GmbH Wirtschaftsprüfungsgesellschaft; Bengaluru; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

The Walt Disney Company in Bengaluru seeks a Lead Associate in Data Engineering to monitor and improve reliability and observability of critical data pipelines. You will engage in on-call rotations, drive problem management, and contribute to a Data Reliability Observability Platform at scale in a fast-paced team.

You will collaborate with cross-functional teams to quantify impacts, automate detections, and develop dashboards, while maintaining ownership and strong communication in a distributed

Qualifications

• 3+ years of data engineering experience.
• Knowledge of data modeling principles incl. dimensional modeling & data normalization.
• Experience with process engineering & continuous improvement.
• Detail-oriented problem-solving approach with ownership.
• Strong written and verbal communication skills.
• Comfortable in a fast-paced, highly collaborative environment.
• Familiarity with Agile Scrum principles & ceremonies.

Responsibilities

• Assist with on-call rotations as Incident Commander to categorize real-time data incidents and coordinate with engineers for timely resolution.
• Drive the problem management process to ensure root-cause analysis and prioritized follow-ups with partner teams.
• Contribute to the Data Reliability Observability Platform to quantify incident impacts, automate detection, and track data health.
• Partner with support and data quality teams, defining success KPIs, ensuring observability and automation coverage of pipelines, and creating dashboards.

Skills

Data modeling

Process engineering

Problem solving

Communication

Agile Scrum

Python

PySpark

Education

Bachelor’s degree in CS/IS

Tools

Snowflake

Redshift

Databricks/EMR/Spark

Airflow

Job description

Job Title: Lead Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate

Job Summary

You will work closely with the senior members of our team to monitor and drive improvements for reliability and observability of critical data pipelines and deliverables. You will be making an outsized impact in an organization that values data as itstop priority. We are a tight and driven team with big goals, so we seek people who are passionate about solvingthe toughest challenges and working at scale, using, supporting, and building distributed systems in a fast-pacedcollaborative team environment. The candidate will also be required to work on on-call shifts and on weekendshifts on rotation. We also support a healthy work-life-balance.

Responsibilities and Duties of the Role

• You will assist with on-call rotations as an Incident Commander to help categorize and trackreal time data incidents, loop in engineering resources as needed to ensure a timelyresolution.
• You will help drive our problem management process to ensure root cause of dataincidents are analyzed and understood, and follow-up work is prioritized with our partnerteams.
• You will play a key role in our long-term Incident and Problem Management strategy bycontributing to the development of a Data Reliability Observability Platform that will assistin quantifying incident impacts, automate issue detection and track the overall health ofour data and data pipelines.
• You will partner with our support and data quality teams, defining success KPI’s, ensuringobservability and automation coverage of our pipelines and help create dashboards andvisualizations for teams to monitor the overall health of our data

Required Education, Experience/Skills/Training

• 3+ years of relevant data engineering experience.
• Good understanding of data modeling principles including Dimensional modeling, data normalizationprinciples.
• Experience with process engineering and continuous improvement.
• Detailed problem-solving approach, coupled with a strong sense of drive and ownership.
• Strong communication skills – written and verbal presentations.
• Comfortable working in a fast-paced and highly collaborative environment.
• Familiarity with Agile Scrum principles and ceremonies

Preferred Qualifications

• 2+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments, exposure to reliability engineering best practices a plus.
• 2+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems (Snowflake or Redshift), required.
• 1+ years of experience programming languages (e.g. Python, Pyspark), preferred.
• Experience with Snowflake, Databricks/EMR/Spark, and/or Airflow.Required Education
• Bachelor’s degree in computer science, information systems, or related field or equivalent work experience.

Department-Specific Boiler Plates:

• Ad Platforms is responsible for Disney’s industry-leading ad technology and products – driving advertising performance, innovation, and value in Disney’s sports, news, and entertainment content, across all media platforms.

Business Operations

• The Business Operations team helps guide and articulate technology strategy and research, and is responsible for driving the day-to-day operation of the Product & Technology organization, including: project and portfolio management and tracking; organization-level capital, space, and resource management and allocation; process management; technical incident management; and our administrative and workplace experience support team.

Commerce, Data & Identity

• Commerce, Data & Identity provides the core product management functions for areas crucial to Disney’s media businesses. These include initiatives and products that power digital commerce, identity, and growth, as well as those that reach uniquely across The Walt Disney Company enterprise, such as messaging and privacy, among others. Additionally, it is responsible for the data engineering, science, and products for Disney Entertainment & ESPN, along with their interconnection with other parts of The Walt Disney Company.

Content Platforms & Operations

• Content Platforms & Operations is responsible for the development and ongoing advancement of the technical and operational functions driving the worldwide.

Design

• Design is centrally responsible for the design supporting all consumer-facing and business products and tooling for the Entertainment & ESPN portfolio, including sports, entertainment, enterprise, UX, creative services and design research.