Microsoft Fabric Data Engineer

HMG AMERICA LLC; Chennai District; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

HMG AMERICA LLC is seeking a Microsoft Fabric Data Engineer in Chennai to design and maintain scalable data pipelines on Microsoft Fabric platforms. You will work with OneLake, Fabric Lakehouse, Data Factory and Spark to build robust data ecosystems.

The role requires 4+ years of hands-on experience with PySpark, Python and SQL, plus strong knowledge of Azure data services and data governance. Collaboration with architects and analysts is essential.

Qualifications

• 4+ years of hands-on experience in data engineering.
• Proficient with Microsoft Fabric, OneLake, Fabric Lakehouse and data pipelines.
• Strong PySpark, Python and SQL skills.
• Experience with Azure data services and data lakehouse architectures.

Responsibilities

• Design and develop scalable data pipelines using Microsoft Fabric.
• Build and maintain Fabric Data Factory / Data Pipelines.
• Develop Fabric Lakehouse and OneLake solutions.
• Ingest, transform, cleanse, and integrate data from multiple sources.
• Write optimized SQL queries for transformation and validation.
• Ensure data quality, monitoring, and governance.

Skills

Microsoft Fabric

OneLake

Fabric Lakehouse

ETL/ELT concepts

Data modeling

Azure data services

Spark/PySpark

Python

SQL

Data pipelines

Education

Bachelor's degree in Computer Science or related field

Tools

Fabric Data Factory / Data Pipelines

Delta Lake

Apache Spark

Power BI

Job description

Job Title: Microsoft Fabric Data Engineer

Experience: 4 + Years

Job Summary

We are looking for an experienced Microsoft Fabric Data Engineer with strong hands‑on experience in Microsoft Fabric, OneLake, Lakehouse, Data Factory, PySpark, Python, SQL, and Azure data services. The candidate will be responsible for designing, developing, and maintaining scalable data pipelines and modern data platforms using Microsoft Fabric.

Key Responsibilities

• Design and develop scalable data engineering solutions using Microsoft Fabric.
• Build and maintain data pipelines using Fabric Data Factory / Data Pipelines.
• Develop and manage Fabric Lakehouse and OneLake solutions.
• Perform data ingestion, transformation, cleansing, and integration from multiple sources.
• Develop data processing solutions using Apache Spark, PySpark, and Python.
• Write optimized SQL queries for data transformation, validation, and analysis.
• Work with Delta Lake and implement reliable and scalable data storage solutions.
• Develop ETL/ELT workflows and implement incremental data loading strategies.
• Integrate data from Azure services, databases, APIs, files, and other enterprise sources.
• Optimize data pipelines and Spark workloads for performance and cost efficiency.
• Implement data quality, validation, monitoring, and error‑handling mechanisms.
• Work closely with Data Architects, Analysts, Data Scientists, and business stakeholders.
• Support data migration and modernization initiatives from legacy/Azure/Databricks platforms to Microsoft Fabric.
• Implement security, access control, and governance following organizational standards.
• Troubleshoot production data pipelines and resolve performance or data‑quality issues.

Mandatory Skills

• Strong hands‑on experience with Microsoft Fabric
• OneLake
• Fabric Lakehouse
• Fabric Data Factory / Data Pipelines
• PySpark
• Python
• SQL
• Strong understanding of ETL/ELT concepts
• Experience developing and optimizing data pipelines
• Good understanding of data modeling and modern data architecture

Good to Have

• Experience with Azure Data Factory
• Databricks
• Power BI
• Microsoft Purview
• CI/CD
• Experience with real‑time/streaming data
• Microsoft Fabric or Azure data certifications