Data Engineering- Azure Databricks- Manager

PwC Acceleration Center India; Bengaluru; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

PwC Acceleration Center India is seeking a Manager Data Engineering (Azure & Databricks) to lead the design, architecture, and implementation of enterprise cloud data solutions using Azure Databricks, ADLS, Data Factory, and Synapse. You will guide cross-functional teams and set architectural roadmaps.

This role emphasizes delivery excellence, stakeholder management, and mentoring junior engineers while driving innovation in our cloud data practice and ensuring successful multi-stream data

Qualifications

• Extensive experience leading Azure-based data platforms with Databricks and Synapse.
• Architectural leadership designing scalable, secure data architectures.
• Hands-on and architectural Spark and Hadoop expertise.
• End-to-end data migration project delivery and stakeholder management.
• Strong SQL, Python, and Unix scripting skills; DevOps awareness.

Responsibilities

• Oversee data engineering projects from inception to completion.
• Lead cross-functional teams to deliver innovative data solutions.
• Mentor junior engineers to improve skills and performance.
• Analyze complex data systems to identify improvements.
• Ensure timely delivery and client satisfaction across projects.

Skills

Technical Leadership

Architectural Expertise

Cloud Proficiency

Data Lifecycle Ownership

Delivery Management

Technical Proficiency

DevOps & CI/CD

Stakeholder & Team Management

Operational Excellence

Education

BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MB

Tools

Azure Databricks

Azure Data Factory

Azure Synapse

ADLS

Spark

Hadoop

Python

SQL

Unix/Shell

Job description

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.

Job Title

Manager Data Engineering (Azure & Databricks)

At PwC AC, as a Manager in Data Engineering, you will play a pivotal role in leading the design, architecture, and end-to-end implementation of enterprise-grade cloud data solutions. You will lead cross-functional teams to deliver scalable Azure-based data ecosystems, bridging the gap between business strategy and technical execution. Beyond hands-on technical guidance, you will be responsible for defining architectural roadmaps, ensuring delivery excellence, managing stakeholder expectations, and driving innovation within our cloud data practice. This role requires a blend of deep technical expertise in the Azure Databricks stack and strong leadership capabilities to manage complex, multi-stream data migration and engineering programs.

Years of Experience

813 years

Position Requirements

• Technical Leadership: Extensive experience leading teams in the design and delivery of Azure-based data platforms utilizing ADLS, Databricks, Data Factory, and Synapse.
• Architectural Expertise: Demonstrated ability to design robust, scalable, and secure data architectures. You should be capable of defining technical standards and best practices for data modeling and data management.
• Cloud Proficiency: Advanced understanding of Big Data frameworks; deep hands-on and architectural experience with Spark and Hadoop ecosystems.
• Data Lifecycle Ownership: Comprehensive knowledge of the Data Warehousing (DW) lifecycle. Proven experience in leading the creation of high-level and detail-level design documents, and defining strategy for Unit/Integration/UAT plans.
• Delivery Management: Strong track record of owning end-to-end delivery of data migration projects, including scope management, risk mitigation, and resource planning.
• Technical Proficiency: Mastery of advanced SQL, complex data transformations, and performance tuning. Proficiency in Python and Unix/Shell scripting for automation.
• DevOps & CI/CD: Strategic understanding of DevOps implementation (Git, Jenkins, GitLab, Azure DevOps) to automate pipelines and ensure high-quality code delivery.
• Stakeholder & Team Management: Excellent communication skills with the ability to advise senior client stakeholders, manage onsite/offshore teams, and mentor junior associates/engineers.
• Operational Excellence: Experience in setting up operational frameworks, defining KPIs for data quality, and leading the transition to production (Operations Hand-off).

Good to Have

• Azure Data Engineer (DP-203) or Databricks Certified Data Engineer Professional.
• Advanced Analytics: Knowledge of Big Data ML toolkits (SparkML, H2O) and experience building real-time stream-processing systems.
• Serverless Architectures: Practical experience with Azure Functions and event-driven data architectures.
• Strategic Consulting: Experience in pre-sales support, RFP responses, or presenting technical roadmaps to C-level or Director-level business stakeholders.

Professional And Educational Background

BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MB

The Opportunity

When you join PwC Acceleration Centers (ACs), you step into a pivotal role focused on actively supporting various Acceleration Center services, from Advisory to Assurance, Tax and Business Services. In our innovative hubs, you’ll engage in challenging projects and provide distinctive services to support client engagements through enhanced quality and innovation. You’ll also participate in dynamic and digitally enabled training that is designed to grow your technical and professional skills. As part of the Data Engineering team you lead the design, architecture, and implementation of enterprise-grade cloud data solutions. As a Manager, you motivate and inspire teams to deliver exceptional results while managing complex data migration programs and driving innovation within our cloud data practice. This role offers the chance to bridge business strategy with technical execution, making a significant impact on your clients and the firm.

Responsibilities

• Oversee and guide data engineering projects from inception to completion
• Collaborate with cross-functional teams to deliver innovative data solutions
• Mentor and develop junior engineers to enhance their skills and performance
• Analyze complex data systems to identify areas for improvement
• Manage project timelines and deliverables to meet client A