IN_Manager_Azure Databricks_D&A_Advisory_Bangalore

Price Waterhouse Cooper LLP; Kolkata District; On-site; INR 2,500,000 - 4,200,000; Full time

Job summary

One Consulting is seeking a Manager-level candidate with 8–12 years of experience in data engineering and Databricks. The role focuses on designing Lakehouse architectures, building scalable data pipelines, and enabling robust DevOps practices.

You will work on architecture design, data modeling, and performance tuning while integrating on-prem DBs with cloud and implementing security via Unity Catalog RBAC.

Qualifications

• B.E./B.Tech in CS/IT or equal degree required.
• 5–6+ years in Data Engineering with 3+ years in Databricks.
• Deep expertise in SparkSQL, PySpark, Python, Delta Lake.
• Strong cloud experience on AWS/Azure/GCP and SQL/data modeling.
• Hands-on experience with performance tuning and optimization.

Responsibilities

• Design Databricks Lakehouse medallion architecture Bronze/Silver/Gold.
• Architect reusable ingestion & transformation pipelines using Databricks and ETL tooling.
• Prepare physical data models and support data governance.
• Develop ingestion pipelines from RDBMS, API, files, etc.
• Transform varied data formats to uniform structures; define CI/CD/DevOps automation.
• Implement RBAC using Unity Catalog and plan clustering/scaling strategies.

Skills

Databricks

SparkSQL

PySpark

Python

SQL

Data modeling

Cloud platforms (AWS/Azure/GCP)

Performance tuning

Workload optimization

Education

B.E./B.Tech/MBA/M.E./M.Tech

Tools

Databricks

Terraform

CloudFormation

Teradata

Oracle

Job description

8 - 12 Years

Regular

Job Description

At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals.

In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimize business performance and enhance competitive advantage.

Job Position Title:

Responsibilities:

Designation : Manager

Required Skills

• B.Tech/B.E degree in Computer Science or Information Technology.
• 5-6+ years in Data Engineering; 3+ years in Databricks
• Deep expertise in SparkSQL, PySpark, Python, Delta Lake
• Strong cloud experience (AWS / Azure / GCP)
• Strong performance tuning and workload optimization
• Strong understanding on SQL and data modeling skills

Good to Have

• Experience with GenAI/Agentic AI for code conversion, automation, or metadata generation
• Exposure to Infrastructure as Code (Terraform/CloudFormation)
• Experience integrating on-prem DBs (Teradata/Oracle) with cloud

Key Responsibilities

• Design Databricks Lakehouse medallion architecture (Bronze/Silver/Gold)
• Architect reusable ingestion & transformation frameworks using Databricks and Enterprise level ETL / orchestration tool.
• Preparing Physical data Model
• Design and develop ingestion pipelines for various type of sources – RDBMS, API, Files, etc.
• Experience in writing code to transform variety data formats (structured, unstructured, and semi-structured) to uniform formats.
• Define CI/CD and DevOps automation strategy
• Implement RBAC for various user persona by Unity catalog
• Define clustering, scaling, and performance strategies

Mandatory skill sets:

Preferred skill sets:

Years of experience required:

8—12 Years

B.E/B.Tech/MBA/M.E/M.Tech

Job Snapshot

Updated Date

06-10-2026

Job ID

Job1439

One Consulting

Location