IN_Senior Associate _Azure Data Engineer_Data & Analytics_ Advisory_ Bangalore

PwC India; Bengaluru; On-site; INR 800,000 - 1,200,000; Full time

Benefits offered by this job

Flexible programs

Mentorship

Job summary

PwC India is looking for a Data Engineer to design and develop efficient data pipelines and ETL processes. You will implement solutions on Azure and ensure regulatory compliance while optimizing workflows.

A bachelor's degree in engineering or an equivalent qualification is required. The ideal candidate should possess strong skills in PySpark, Scala, and Azure services, along with programming expertise in Python.

Join a community that promotes trust, innovation, and inclusive benefits for your career growth.

Qualifications

• Proven experience as a Data Engineer, building and optimizing pipelines with PySpark, Scala, and Apache Spark.
• Hands-on experience with Azure services such as Databricks, Data Lake, Synapse, and Azure SQL Database.
• Strong programming skills in Python and Scala, familiarity in software development, version control, and CI/CD practices.
• Experience with data warehousing concepts, dimensional modeling, and relational databases.

Responsibilities

• Design, develop, and optimize data pipelines and ETL processes using PySpark or Scala.
• Implement data ingestion, processing, and storage solutions on Azure.
• Develop and maintain data models, schemas, and metadata.
• Monitor pipeline performance and optimize workflows.
• Implement data security and compliance measures.

Skills

Data engineering

PySpark

Scala

Azure services

Apache Spark

SQL Server

PostgreSQL

MySQL

Education

B.Tech / M.Tech / MBA / MCA

Tools

Azure Databricks

Azure Data Lake Storage

Azure Synapse Analytics

Job description

Job Summary
A career within Data and Analytics services will give you the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on business intelligence, data management, and data assurance to help clients drive innovation, growth, and change. You will mix analytical thinking with technology to leverage data and navigate risk, giving clients a competitive edge.

Benefits & Culture
At PwC you will be part of a community that values trust, innovation, and impact. We offer inclusive benefits, flexibility programs, and mentorship to support your wellbeing and career growth.

Responsibilities

• Design, develop, and optimize data pipelines and ETL processes using PySpark or Scala to extract, transform, and load large volumes of structured and unstructured data from diverse sources.
• Implement data ingestion, processing, and storage solutions on Azure, leveraging services such as Azure Databricks, Azure Data Lake Storage, and Azure Synapse Analytics.
• Develop and maintain data models, schemas, and metadata to support efficient data access, query performance, and analytics.
• Monitor pipeline performance, troubleshoot issues, and optimize workflows for scalability, reliability, and cost‐effectiveness.
• Implement data security and compliance measures to protect sensitive information and ensure regulatory compliance.

Requirements

• Proven experience as a Data Engineer, building and optimizing pipelines with PySpark, Scala, and Apache Spark.
• Hands‑on experience with Azure services such as Databricks, Data Lake, Synapse, and Azure SQL Database.
• Strong programming skills in Python and Scala, with familiarity in software development, version control, and CI/CD practices.
• Experience with data warehousing concepts, dimensional modeling, and relational databases (e.g., SQL Server, PostgreSQL, MySQL).
• Experience with big data technologies and frameworks (e.g., Hadoop, Hive, HBase) is a plus.

Education

B.Tech / M.Tech / MBA / MCA required; Master of Engineering, Bachelor of Engineering, or Master of Business Administration preferred.

Skill Sets

Mandatory: Spark, PySpark, Azure. Preferred: Spark, PySpark, Azure.

Equal Opportunity Statement

PwC provides equal employment opportunities without discrimination on the basis of gender, ethnicity, age, disability, marital status, sexual orientation, pregnancy, gender identity, religion, or any other protected status. We maintain a zero‑tolerance policy for harassment and discrimination.