Azure Databricks design - Senior Manager

PwC Acceleration Center India; Chennai District; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

PwC Acceleration Center India is seeking an experienced Azure Databricks Design Senior Manager to lead the design and implementation of advanced data engineering solutions across Azure and AWS. You will guide relatively large projects and mentor teams, driving data modernization and analytics modernization with Databricks.

You will collaborate with clients at a strategic level, ensuring data security, quality, and scalable architectures, including data lakes and warehouses, while leveraging

Qualifications

• Bachelor's degree required.
• 13+ years of experience required.
• English proficiency required.

Responsibilities

• Lead design and implementation of Azure Databricks solutions for data processing and analytics.
• Manage data engineering projects on AWS and Azure.
• Develop scalable data architectures (data lakes/warehouses) for advanced analytics.
• Mentor and coach teams to deliver data modernization initiatives.
• Collaborate with cross-functional teams to drive data strategy.

Skills

Azure Databricks

Data engineering

Cloud platforms

Leadership

Education

Bachelor's degree

Tools

Airflow

Snowflake

MySQL

PostgreSQL

Databricks

Job description

The Opportunity

Join our Acceleration Center India and help shape the future of business for our diverse client portfolio across geographies and jurisdictions. You’ll work at the heart of global teams across Advisory, Assurance, Tax and Business Services—solving real client challenges through connected collaboration. We’ll help you grow your skills so you can go further. With hands-on learning, cutting-edge tools and an inclusive culture, this is your opportunity to do inspiring work that makes a difference—every day.

As an Azure Databricks Design Senior Manager, you will lead the design and implementation of advanced data engineering solutions, focusing on leveraging Azure Databricks to drive data modernization initiatives. Within our Cloud Engineering, Data & Analytics practice, you will play a pivotal role in transforming data strategies and delivering impactful analytics solutions to our clients. As a Senior Manager, you will guide large projects, innovate processes, and maintain operational excellence while interacting with clients at a strategic level to drive project success. You will utilize your skills and professional networks to deliver quality results and provide strategic input into the firm's business strategies.

In this role at PwC Acceleration Center India, you will be responsible for building trust with multi-level teams and stakeholders through open and honest conversation, motivating and coaching teams to solve complex problems. You will apply sound judgment, communicate effectively, and develop high-performing, diverse, and inclusive teams, contributing to the overall success of the firm. Your ability to navigate complexity and foster a culture of continuous improvement will be crucial in achieving operational excellence and driving results.

Responsibilities

• Leading the design and implementation of Azure Databricks solutions to optimize data processing and analytics
• Managing data engineering projects with a focus on cloud-based platforms such as Amazon Web Services (AWS) and Microsoft Azure
• Developing and maintaining scalable data architectures, including data lakes and warehouses, to support advanced analytics
• Utilizing Apache Airflow and Directed Acrylic Graphs (DAGs) for efficient data pipeline orchestration and management
• Overseeing database administration and optimization, confirming data security and integrity across platforms like MySQL and PostgreSQL
• Implementing data transformation and validation processes to enhance data quality and reliability
• Collaborating with cross-functional teams to drive data strategy and integration efforts
• Coaching and mentoring teams to foster innovation and embrace change in data modernization initiatives
• Promoting the use of Snowflake Data Warehouse and Databricks Unified Data Analytics Platform for enhanced data insights
• Engaging in strategic questioning and relationship building to support client needs and project success

What You Must Have

• At least a Bachelor's degree
• At least 13 years of experience
• Oral and written proficiency in English required

What Sets You Apart

• Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
• Demonstrating proficiency in Azure Databricks and Microsoft Azure
• Utilizing advanced data engineering platforms and tools
• Leading data modernization initiatives with strategic insight
• Applying analytical thinking to complex data challenges
• Innovating data architecture and integration solutions
• Excelling in agile scalability and rapid experimentation