Azure Databricks - Manager

PwC Acceleration Center India; Gurugram District; On-site; INR 2,800,000 - 4,000,000; Full time

Job summary

PwC Acceleration Center India is seeking an Azure Databricks Manager to lead data engineering initiatives across client engagements, focusing on transforming data into actionable insights and scalable cloud-based solutions.

You will mentor teams, shape data modernization strategies, and ensure delivery excellence by leveraging Hadoop, Airflow, Databricks, and Azure Data Factory within a collaborative, inclusive culture.

Qualifications

• Bachelor's degree required.
• 8+ years of experience in data engineering or related field.
• English proficiency (oral and written) required.

Responsibilities

• Lead design and implementation of data engineering solutions using Azure Databricks and cloud platforms.
• Manage data integration and transformation to support data modernization initiatives.
• Oversee development and optimization of data pipelines and architecture.
• Guide strategic planning and execution of data-driven projects aligned with client objectives.
• Utilize Hadoop, Airflow, and Azure Data Factory to streamline data workflows.
• Develop and maintain scalable data infrastructure for analytics and reporting.
• Promote adopting innovative data engineering practices across engagements.
• Ensure data security and compliance within data engineering frameworks.
• Coach and mentor junior staff and foster professional growth.
• Collaborate with stakeholders to identify opportunities for data strategy improvements.

Skills

Data engineering

Data architecture

Data modeling

Leadership

Cloud data platforms

Education

Bachelor's degree

Tools

Azure Databricks

Azure Data Factory

Apache Hadoop

Apache Airflow

MySQL

PostgreSQL

Job description

The Opportunity

Join our Acceleration Center India and help shape the future of business for our diverse client portfolio across geographies and jurisdictions. You’ll work at the heart of global teams across Advisory, Assurance, Tax and Business Services—solving real client challenges through connected collaboration. We’ll help you grow your skills so you can go further. With hands‑on learning, cutting‑edge tools and an inclusive culture, this is your opportunity to do inspiring work that makes a difference—every day.

As an Azure Databricks Manager, you will lead efforts within our Data and Analytics Engineering group, focusing on data engineering solutions that drive client success. You will be at the forefront of transforming data into actionable insights, leveraging cutting‑edge technologies to optimize data processes and enhance client outcomes. Within our Cloud Engineering, Data & Analytics network, you will play a pivotal role in advancing data modernization initiatives, collaborating with teams to deliver innovative solutions that meet evolving client needs.

As a Manager, you will guide and develop teams, fostering a culture of leadership and accountability. You will be responsible for strategic planning and mentoring junior staff, confirming project success and maintaining standards. Your role will involve motivating and inspiring others to deliver quality, leveraging team strengths to meet client expectations. You will articulate our purpose and values, embracing technology and innovation to enhance delivery and encourage others to do the same.

In this role at PwC Acceleration Center India, you will drive data modernization efforts, collaborating with diverse teams to deliver impactful solutions. Your leadership will be crucial in navigating complex challenges and identifying opportunities that contribute to the success of our firm.

Responsibilities

• Leading the design and implementation of data engineering solutions using Azure Databricks and other cloud-based platforms
• Managing data integration and transformation processes to support client data modernization initiatives
• Overseeing the development and optimization of data pipelines and data architecture to enhance data quality and accessibility
• Guiding teams in the strategic planning and execution of data-driven projects, confirming alignment with client objectives
• Utilizing technical skills in Apache Hadoop, Apache Airflow, and Azure Data Factory to streamline data workflows
• Developing and maintaining scalable data infrastructure to support complex data analytics and reporting needs
• Promoting the adoption of innovative data engineering practices and technologies across client engagements
• Validating data security and compliance within data engineering frameworks to protect client information
• Coaching and mentoring junior staff to foster professional growth and enhance team performance
• Collaborating with stakeholders to identify opportunities for data strategy improvements and business performance optimization

What You Must Have

• At least a Bachelor's degree
• At least 8+ years of experience
• Oral and written proficiency in English required

What Sets You Apart

• Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
• Demonstrating proficiency in Microsoft Azure Databricks and Databricks Unified Data Analytics Platform
• Utilizing advanced skills in data architecture development and data modeling
• Leveraging experience with Apache Hadoop and Apache Airflow for data engineering
• Excelling in database management systems, including MySQL and PostgreSQL
• Embracing agile scalability and strategic questioning in data modernization projects
• Leading teams in data warehousing and data pipeline optimization initiatives