Fabric Data Engineer

Affine Analytics; Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Affine Analytics in Bengaluru is seeking a highly experienced Data Engineer to lead and optimize data pipelines, notebooks, and transformation workflows using Microsoft Fabric. The ideal candidate will have deep SQL expertise, strong data warehousing understanding, and hands-on experience with ETL/ELT, data integration, and pipeline orchestration.

Proficiency in Python and PySpark is required. This senior role requires familiarity with Fabric Lakehouse, Notebooks Gen2, OneLake, Delta tables,

Qualifications

• 34 years of experience in data engineering, with hands-on exposure to Microsoft Fabric.
• Strong experience in developing and managing data pipelines, notebooks, and data transformation workflows.
• Proficiency in SQL, including complex queries, joins, aggregations, and query optimization.
• Good understanding of database design, data modelling, and data warehousing concepts.
• Experience with data integration, ETL/ELT processes, and pipeline orchestration.
• Working knowledge of Python and PySpark for data processing.
• Understanding of data quality, pipeline monitoring, and performance optimization.

Skills

Data engineering

SQL

Python

PySpark

Data pipelines

ETL/ELT

Microsoft Fabric

Tools

Microsoft Fabric

Fabric Lakehouse

Notebooks

Dataflows Gen2

Git

CI/CD

Power BI

Delta tables

OneLake

Job description

Required Skills

• 34 years of experience in data engineering, with hands-on exposure to Microsoft Fabric.
• Strong experience in developing and managing data pipelines, notebooks, and data transformation workflows.
• Proficiency in SQL, including complex queries, joins, aggregations, and query optimization.
• Good understanding of database design, data modelling, and data warehousing concepts.
• Experience with data integration, ETL/ELT processes, and pipeline orchestration.
• Working knowledge of Python and PySpark for data processing.
• Understanding of data quality, pipeline monitoring, and performance optimization.

Good to Have

• Hands-on experience with Fabric Lakehouse, Notebooks, and Dataflows Gen2.
• Familiarity with Fabric Warehouse, OneLake, and Delta tables.
• Exposure to Git, version control, and CI/CD practices.
• Familiarity with Power BI and related data integration tools.