Data Engineering- Azure Databricks- Manager (Bangalore East)

PwC Acceleration Center India; Bengaluru; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

PwC Acceleration Centers in Bengaluru is seeking a Manager Data Engineering (Azure & Databricks) to lead the design, architecture and end-to-end implementation of enterprise cloud data solutions. You will guide cross-functional teams, translate business needs into scalable data platforms, and define roadmaps that drive delivery excellence.

The role requires deep Azure Databricks expertise, hands-on delivery of data migrations, and strong leadership to manage complex programs across ADLS, Data

Qualifications

• Technical leadership in Azure-based data platforms with ADLS, Databricks, Data Factory and Synapse.
• Architectural design of robust, scalable data architectures and standards.
• Deep cloud proficiency across Spark and Hadoop ecosystems.
• End-to-end data migration project delivery experience.
• Proficiency in SQL, Python, and Unix scripting for automation.
• DevOps concepts and CI/CD pipelines for data projects.
• Strong stakeholder communication and onsite/offshore team mentoring.
• Knowledge of DW lifecycle, design documents, and testing plans.

Responsibilities

• Oversee data engineering projects from inception to delivery.
• Lead cross-functional teams to deliver Azure-based data solutions.
• Mentor junior engineers to improve performance.
• Analyze complex data systems to identify improvements.
• Define roadmaps and ensure delivery excellence.

Skills

Technical Leadership

Architectural Expertise

Cloud Proficiency

Data Lifecycle Ownership

Delivery Management

Technical Proficiency

DevOps & CI/CD

Stakeholder & Team Management

Operational Excellence

Advanced Analytics

Serverless Architectures

Strategic Consulting

Education

BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MB

Tools

ADLS

Databricks

Data Factory

Synapse

Spark

Hadoop

Python

Unix/Shell

Git

Jenkins

GitLab

Azure DevOps

Job description

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.

Job Title

• Manager Data Engineering (Azure & Databricks)
• At PwC AC, as a Manager in Data Engineering, you will play a pivotal role in leading the design, architecture, and end-to-end implementation of enterprise-grade cloud data solutions. You will lead cross-functional teams to deliver scalable Azure-based data ecosystems, bridging the gap between business strategy and technical execution. Beyond hands-on technical guidance, you will be responsible for defining architectural roadmaps, ensuring delivery excellence, managing stakeholder expectations, and driving innovation within our cloud data practice.
• This role requires a blend of deep technical expertise in the Azure Databricks stack and strong leadership capabilities to manage complex, multi-stream data migration and engineering programs.

Years Of Experience

813 years

Position Requirements Must Have:

• Technical Leadership Extensive experience leading teams in the design and delivery of Azure-based data platforms utilizing ADLS, Databricks, Data Factory, and Synapse.
• Architectural Expertise Demonstrated ability to design robust, scalable, and secure data architectures. You should be capable of defining technical standards and best practices for data modeling and data management.
• Cloud Proficiency Advanced understanding of Big Data frameworks; deep hands-on and architectural experience with Spark and Hadoop ecosystems.
• Data Lifecycle Ownership Comprehensive knowledge of the Data Warehousing (DW) lifecycle. Proven experience in leading the creation of high-level and detail-level design documents, and defining strategy for Unit/Integration/UAT plans.
• Delivery Management Strong track record of owning end-to-end delivery of data migration projects, including scope management, risk mitigation, and resource planning.
• Technical Proficiency Mastery of advanced SQL, complex data transformations, and performance tuning. Proficiency in Python and Unix/Shell scripting for automation.
• DevOps & CI/CD Strategic understanding of DevOps implementation (Git, Jenkins, GitLab, Azure DevOps) to automate pipelines and ensure high-quality code delivery.
• Stakeholder & Team Management Excellent communication skills with the ability to advise senior client stakeholders, manage onsite/offshore teams, and mentor junior associates/engineers.
• Operational Excellence Experience in setting up operational frameworks, defining KPIs for data quality, and leading the transition to production (Operations Hand-off).
• Certifications Good to Have: Azure Data Engineer (DP-203) or Databricks Certified Data Engineer Professional.
• Advanced Analytics Knowledge of Big Data ML toolkits (SparkML, H2O) and experience building real-time stream-processing systems.
• Serverless Architectures Practical experience with Azure Functions and event-driven data architectures.
• Strategic Consulting Experience in pre-sales support, RFP responses, or presenting technical roadmaps to C-level or Director-level business stakeholders.

Professional And Educational Background BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MB

The Opportunity

• When you join PwC Acceleration Centers (ACs), you step into a pivotal role focused on actively supporting various Acceleration Center services, from Advisory to Assurance, Tax and Business Services. In our innovative hubs, youll engage in challenging projects and provide distinctive services to support client engagements through enhanced quality and innovation. Youll also participate in agile and digitally enabled training that is designed to grow your technical and professional skills.
• As part of the Data Engineering team you lead the design, architecture, and implementation of enterprise-grade cloud data solutions. As a Manager, you motivate and inspire teams to deliver exceptional results while managing complex data migration programs and driving innovation within our cloud data practice. This role offers the chance to bridge business strategy with technical execution, making a significant impact on our clients and the firm.

Responsibilities

• Oversee and guide data engineering projects from inception to completion
• Collaborate with cross-functional teams to deliver innovative data solutions
• Mentor and develop junior engineers to enhance their skills and performance
• Analyze complex data systems to identify areas for improvement
• Manage project timelines and deliverables to meet .