Data Engineer- Azure Databricks- Senior Associate

PwC

Bengaluru

On-site

INR 1,500,000 - 2,100,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

PwC India’s Acceleration Center is seeking a Senior Associate Data Engineer focused on Azure Databricks. You will shape data platforms across advisory services, building cloud-native solutions, and collaborating with global teams.

You will analyze complex problems, mentor juniors, and contribute to client-ready data architectures with emphasis on ETL, data models and analytics enablement.

Qualifications

  • Bachelor's degree required.
  • 4+ years of experience in data engineering and analytics.
  • Proficient in English (oral and written).
  • Experience with Azure Databricks, Data Factory and Spark required.
  • Strong SQL, data modeling and ETL skills.
  • Knowledge of DW lifecycle and data migration concepts.

Responsibilities

  • Build Azure Databricks data pipelines and scalable data engineering solutions across cloud environments.
  • Design and maintain data integration, transformation, and validation workflows for modern analytics platforms.
  • Optimize data models, queries, and warehouse structures for faster reporting and analysis.
  • Apply Airflow, Azure Data Factory, and Databricks to orchestrate batch and streaming processes.
  • Collaborate with client stakeholders to translate business needs into data architecture and delivery plans.
  • Support data modernization efforts migrating legacy platforms to cloud-native architectures.
  • Review code, pipeline logic, and data quality controls to validate consistency.
  • Mentor junior team members on engineering methods and delivery practices.

Skills

Data engineering
Analytical skills
Communication skills
Troubleshooting
Unix shell scripting
Mentoring
Problem solving
English proficiency

Education

Bachelor's degree

Tools

Azure Databricks
Azure Data Factory
HDInsight
Spark
Jenkins
Git/GitLab

Job description

Industry/Sector

Not Applicable

Specialism

Product Innovation

Management Level

Senior Associate

Job Description & Summary
The Opportunity

Join our Acceleration Center India and help shape the future of business for our diverse client portfolio across geographies and jurisdictions. You’ll work at the heart of global teams across Advisory, Assurance, Tax and Business Services—solving real client challenges through connected collaboration. We’ll help you grow your skills so you can go further. With hands‑on learning, cutting‑edge tools and an inclusive culture, this is your opportunity to do inspiring work that makes a difference—every day.

As a Data Engineer- Azure Databricks- Senior Associate you will support data platform modernization efforts, with a focus on Azure Databricks, cloud data pipelines, ETL development, and analytics enablement within our Advisory practice. As a Senior Associate you will analyze complex problems, manage assigned workstreams, mentor junior team members, and bring a client‑focused approach to building meaningful relationships while navigating ambiguity and contributing to the firm’s business strategies. In this role at PwC, you will develop and maintain modern data solutions that help clients transform legacy environments into cloud‑native architectures, using data engineering skills, critical thinking, and a deeper understanding of the broader business context.

Responsibilities
  • Building Azure Databricks data pipelines and scalable data engineering solutions across cloud environments
  • Designing and maintaining data integration, transformation, and validation workflows for modern analytics platforms
  • Optimizing data models, query performance, and warehouse structures to support faster reporting and analysis
  • Applying Apache Airflow, Azure Data Factory, and Databricks tools to orchestrate dependable batch and streaming processes
  • Collaborating with client stakeholders to translate business needs into technical data architecture and delivery plans
  • Supporting data modernization efforts that migrate legacy platforms to cloud‑native architectures
  • Reviewing code, pipeline logic, and data quality controls to validate consistency and support issue resolution
  • Mentoring junior team members on engineering methods, platform usage, and delivery practices
What You Must Have
  • At least a Bachelor’s degree
  • At least 4 years of experience
  • Oral and written proficiency in English required
Must Have:
  • 4+ years of experience working in Azure ADLS, Data Bricks, Data Flows, HDInsight, Azure Analysis services
  • Should be aware of Data Management concepts and Data Modelling
  • Good knowledge of Big Data frameworks and related technologies
  • Experience in Hadoop and Spark is mandatory
  • Should have expertise in extracting data from different source systems like flat files, XML sources, JSON, Parquet files, Big data appliances, RDBMS, etc.
  • Good knowledge of Big Data frameworks and related technologies
  • Experience in Hadoop and Spark is mandatory
  • Should have clear understanding of DW lifecycle and contributed in preparing
  • Detail Level Design document
  • Unit Test plans
  • Code review reportsMust have strong sql, understand joins, groups, functions & Stored procedures
  • Must have experience in Unit and Integration Test creation and verification
  • Proficient in creating documentation related to Project Architecture, Project end User Manual and - Operations Hand off guide
  • Should have good understanding of Data Migration processes, methods and project lifecycle
  • Good in Unix Shell Scripting skills
  • Strong analytical skills and troubleshooting skills
  • Should be well versed with quality processes and implementation
  • Excellent communication skills
  • Strong understanding of Cloud data migration processes, methods and project lifecycle
  • Good knowledge of Application DevOps tools (Git, CI/CD Frameworks)
  • Experience in Jenkins or Gitlab with rich experience in source code management like Code - Pipeline, Code Build and Code Commit
Desired Knowledge / Skills:
  • Certifications in Azure / Databricks
  • Experience in building stream‑processing systems, using solutions such as Storm or Spark
Streaming
  • Experience in Big Data ML toolkits, such as Mahout, SparkML, or H2O
  • Experience in Azure functions
  • Knowledge in Python
What Sets You Apart
  • Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
  • Demonstrating Azure Databricks delivery across data modernization engagements
  • Applying Databricks, Azure Data Factory, and Airflow in pipeline builds
  • Translating complex data requirements into scalable engineering solutions
  • Analyzing data architecture, modeling, and optimization opportunities
  • Mentoring junior team members while managing assigned workstreams
Travel Requirements

Not Specified

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer- Azure Databricks- Senior Associate
Data Engineer- Azure Databricks- Senior Associate

Pwc (Crm Experienced Careers Site) • Bengaluru

On-site
INR 1,800,000 - 3,200,000
Databricks + Azure AI - Senior Associate
Databricks + Azure AI - Senior Associate

PwC • Bengaluru

On-site
INR 1,800,000 - 2,400,000
Databricks + Azure AI - Senior Associate
Databricks + Azure AI - Senior Associate

PwC • Bengaluru

On-site
INR 1,500,000 - 3,000,000
Azure Databricks, IICS,AI - Senior Associate
Azure Databricks, IICS,AI - Senior Associate

PwC • Hyderabad

On-site
INR 1,400,000 - 2,400,000
Azure Databricks+Guidewire - Senior Associate
Azure Databricks+Guidewire - Senior Associate

PwC • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Databricks+Azure AI - Associate
Databricks+Azure AI - Associate

PwC • Bengaluru

On-site
INR 800,000 - 1,100,000
Azure Databricks + AI - Manager
Azure Databricks + AI - Manager

Pwc (Crm Experienced Careers Site) • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Databricks+Azure AI - Associate
Databricks+Azure AI - Associate

PwC • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Azure Databricks, IICS,AI - Senior Associate
Azure Databricks, IICS,AI - Senior Associate

PwC • Andhra Pradesh

On-site
INR 1,200,000 - 1,800,000
Databricks + AI - Senior manager
Databricks + AI - Senior manager

PwC • Hyderabad

On-site
INR 4,500,000 - 6,500,000