Sr Microsoft Fabric Engineer

Tata Consultancy Services; Hyderabad, Pune District, Bengaluru; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

Tata Consultancy Services in Hyderabad is hiring a Mid-Senior Microsoft Fabric Engineer to design, build, and optimize scalable data solutions using Microsoft Fabric and the Azure ecosystem for enterprise analytics and AI use cases.

The role focuses on creating robust data pipelines, lakehouse architectures in OneLake, and real-time and batch processing, with strong PySpark, SQL, Python skills, and experience in ADF, Synapse, Databricks, CI/CD, and data governance.

Qualifications

• 5+ years of data engineering experience.
• Expertise in Microsoft Fabric and Azure data platforms.
• Proficient with PySpark, Spark SQL, Python, and SQL.
• Experience with ADF, Synapse, Databricks and data lakes.

Responsibilities

• Design and develop scalable data pipelines using Microsoft Fabric and Azure services.
• Implement data ingestion, transformation, and orchestration workflows.
• Build and manage Lakehouse architecture and data models in OneLake.
• Optimize data processing using PySpark and distributed computing techniques.
• Ensure data quality, governance, and security across pipelines.
• Collaborate with business teams, architects, and analysts to gather requirements.

Skills

Data Engineering

PySpark

Spark SQL

Python

SQL

ETL/ELT design patterns

Large-scale data pipelines

Data Lakes

Tools

Microsoft Fabric

OneLake

Lakehouse

Data Warehouse

Real-Time Analytics

Azure Data Factory

Synapse

Databricks

Azure DevOps

Git

Job description

Role & responsibilities

We are looking for a highly skilled MidSenior Level Microsoft Fabric Engineer with strong expertise in modern data engineering and analytics platforms. The candidate will be responsible for designing, building, and optimizing scalable data solutions using Microsoft Fabric and Azure ecosystem for enterprise-grade analytics and AI-driven use cases.

Key Skills (Mandatory)

• Strong experience in Data Engineering (510 years)
• Expertise in Microsoft Fabric (OneLake, Lakehouse, Data Warehouse, Real-Time Analytics)
• Hands‑on experience with Azure Data Factory (ADF), Synapse, and Databricks
• Strong proficiency in PySpark, Spark SQL, and Python
• Advanced SQL skills for data transformation and performance tuning
• Experience with ETL/ELT design patterns and large-scale data pipelines
• Experience working with structured and unstructured data within Data Lakes
• Familiarity with CI/CD pipelines and deployment automation (Azure DevOps/Git)

Key Responsibilities:

• Design and develop scalable data pipelines using Microsoft Fabric and Azure services
• Implement data ingestion, transformation, and orchestration workflows
• Build and manage Lakehouse architecture and data models in OneLake
• Optimize data processing using PySpark and distributed computing techniques
• Ensure data quality, governance, and security across pipelines
• Collaborate with business teams, architects, and analysts to gather requirements
• Support real-time and batch data processing use cases
• Implement best practices for performance tuning and cost optimization
• Mentor junior engineers and contribute to capability building

Preferred candidate profile

• Experience with Generative AI and integration with Fabric data pipelines
• Knowledge of Power BI integration with Fabric for advanced analytics
• Experience with REST/API integrations and streaming data platforms
• Exposure to domain-specific data models (Manufacturing, Supply Chain, Finance etc.)
• Certifications in Microsoft Fabric/Azure Data Engineering preferred