Microsoft Fabric + Pyspark + SQL - Senior Associate

Pricewater House Coopers Service Delivery Center Bangalore; Gurugram District, Bengaluru, Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Pricewater House Coopers Service Delivery Center Bangalore in Gurugram is seeking an experienced Data Engineer to work with Microsoft Fabric, Azure ADLS, Databricks and Spark-based pipelines, delivering scalable data processing solutions.

The role requires hands-on expertise in Hadoop, Spark, PySpark notebooks, SQL performance tuning and transforming data from flat files, XML, JSON and Parquet sources into analytical models.

Qualifications

• Experience with Microsoft Fabric and Azure data services.
• Hands-on Big Data experience with Hadoop and Spark.
• Extract data from multiple sources (flat files, XML, JSON, Parquet, RDBMS).
• Proficient in PySpark notebooks and SQL-based analytics.
• Knowledge of SparkSQL and performance tuning for analytical workloads.

Skills

Microsoft Fabric

Azure ADLS

Databricks

Data Flows

HDInsight

Azure Analysis Services

Data Modeling

Big Data concepts

Hadoop

Spark

PySpark

SQL tuning

SparkSQL

Tools

XML sources

JSON

Parquet

Flat files

RDBMS

Job description

4+ years of experience working in Microsoft Fabric, Azure ADLS, Data Bricks, Data Flows, HDInsight, Azure Analysis services

Should be aware of Data Management concepts and Data Modelling

Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory

Should have expertise in extracting data from different source systems like flat files, XML sources, JSON, Parquet files, Big data appliances, RDBMS, etc.

Hands‑on experience with Microsoft Fabric and its components

Proficient in PySpark Notebooks for building scalable data processing pipelines

Strong command over SQL databases and performance tuning for analytical workloads

Solid experience with SparkSQL for complex data transformations and querying