Azure Databricks Senior Manager

PwC; India; Hybrid; INR 3,000,000 - 5,000,000; Full time

Job summary

PwC in India is seeking an experienced data engineering leader to design and implement scalable data pipelines, integrate diverse data sources, and transform raw data into actionable insights for business decisions.

You will work with Hadoop, Azure Data Factory, Snowflake and Databricks, lead teams, mentor staff, and collaborate with stakeholders to optimize data usage while upholding security and quality standards.

Qualifications

• At least a Bachelor's degree.
• 8+ years of experience in data engineering or related field.
• Excellent command of English (oral and written).

Responsibilities

• Designing and implementing data pipelines and integration solutions to support data processing and analysis.
• Developing and maintaining data infrastructure using Hadoop and Azure Data Factory.
• Transforming raw data into actionable insights for informed decision-making.
• Leading teams in planning and executing data-driven initiatives to drive growth.
• Coaching team members to leverage strengths and manage performance.
• Collaborating with stakeholders to optimize data utilization and outcomes.
• Applying cloud analytics platforms like Snowflake and Databricks to enhance data solutions.
• Ensuring data integrity and security within analytics frameworks.
• Encouraging innovation and embracing technology to improve delivery and team development.

Skills

Data pipelines

Data integration

Data infrastructure

Cloud platforms

Snowflake

Databricks

Hadoop

Azure Data Factory

Data modeling

AI collaboration

Agile methodologies

Mentoring teams

Stakeholder collaboration

Python

SQL

ETL Tools

Airflow

Education

Bachelor's degree

Tools

AWS

Azure

Python

SQL

Job description

Responsibilities

• - Designing and implementing data pipelines and integration solutions to support efficient data processing and analysis
• - Developing and maintaining data infrastructure using platforms such as Apache Hadoop and Azure Data Factory
• - Utilizing advanced data engineering techniques to transform raw data into actionable insights for informed decision-making
• - Leading teams in the strategic planning and execution of data-driven initiatives to drive business growth
• - Coaching team members to leverage their unique strengths and manage performance to meet client expectations
• - Collaborating with stakeholders to identify opportunities for optimizing data utilization and improving business outcomes
• - Applying technical proficiency in cloud-based analytics platforms like Snowflake and Databricks to enhance data solutions
• - Validating data integrity and security within analytics frameworks to uphold professional standards
• - Encouraging innovation and embracing technology to enhance delivery and inspire team development

What You Must Have

• - At least a Bachelor's degree
• - At least 8+ years of experience
• - Oral and written proficiency in English required

What Sets You Apart

• - Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
• - Demonstrating proficiency in data engineering platforms and tools
• - Utilizing cloud platforms like AWS and Azure for data solutions
• - Excelling in data modeling and data pipeline development
• - Leveraging AI-human collaboration to enhance data analytics
• - Embracing agile methodologies for scalable data projects
• - Mentoring teams in data strategy and transformation initiatives