Microsoft Fabric Data Engineer (Blr/Chn/Hyd/Kochi/Kol/Pune)

Tata Consultancy Services; Hyderabad, Pune District, Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Tata Consultancy Services in Hyderabad seeks an experienced Microsoft Fabric Data Engineer to design, develop, and optimize scalable data pipelines and analytics platforms in a cloud-native environment.

The role emphasizes Medallion Architecture, leveraging Fabric, PySpark, ADF and Synapse to support enterprise data modernization and reporting across the organization. Collaborative, Agile delivery is key.

Qualifications

• 6–12 years of experience in Data Engineering.
• Strong hands-on expertise in Microsoft Fabric, PySpark, Azure Data Factory and Azure Synapse Analytics.

Responsibilities

• Design, develop, and implement data solutions using Microsoft Fabric.
• Build scalable data pipelines and analytics platforms leveraging Fabric Lakehouse architecture.
• Develop notebooks and data transformation frameworks using PySpark.
• Design highly performant data processing frameworks for analytics and reporting.
• Collaborate with architecture, product management, and tech teams in Agile delivery.

Skills

Notebooks

Data Warehouse Design

ETL/ELT Development

Data Integration

SQL

Medallion Architecture

Agile Delivery

Stakeholder Management

Tools

Microsoft Fabric

PySpark

Azure Data Factory

Azure Synapse Analytics

Power BI

Job description

We are seeking an experienced Microsoft Fabric Data Engineer with strong expertise in Microsoft Fabric, Azure Data Engineering, PySpark, Azure Data Factory, Azure Synapse Analytics, and Data Warehousing.

The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics platforms using Microsoft Fabric while supporting enterprise data modernization initiatives in a cloud-native environment.

Key Responsibilities

Microsoft Fabric Development

• Design, develop, and implement modern data solutions using Microsoft Fabric.
• Build scalable data pipelines and analytics platforms leveraging Fabric Lakehouse architecture.
• Develop and maintain notebooks and data transformation frameworks using PySpark.
• Enable enterprise reporting and analytics use cases through optimized data structures.

Data Engineering & Pipeline Development

• Build data ingestion and transformation pipelines from on-premise and cloud-based source systems into Microsoft Fabric.
  
• Develop scalable ETL/ELT solutions using:
  
  • Microsoft Fabric
  • Azure Data Factory
  • Azure Synapse Analytics
  • PySpark
• Design highly performant and reusable data processing frameworks.
  

Medallion Architecture Implementation

• Design and implement:
  
  • Bronze Layer
  • Silver Layer
  • Gold Layer
• Apply Medallion Architecture principles to support data quality, governance, and scalability.
  
• Build curated datasets optimized for analytics and reporting consumption.
  

Data Warehouse & Analytics

• Design and optimize data warehouse solutions.
• Implement data aggregation and transformation logic.
• Develop SQL-based analytical solutions and reporting data structures.
• Support dimensional modeling and enterprise analytics requirements.

Collaboration & Agile Delivery

• Work closely with architecture, product management, business, and technology teams.
• Participate in Agile ceremonies and sprint-based delivery.
• Contribute to solution design discussions, code reviews, and development best practices.
• Deliver scalable and high-quality data engineering solutions aligned with business objectives.

Required Skills

• 6-12 years of experience in Data Engineering.
  
• Strong hands-on expertise in:
  
  • Microsoft Fabric
  • PySpark
  • Azure Data Factory
  • Azure Synapse Analytics
• Experience with:
  
  • Notebooks
  • Data Warehouse Design
  • ETL/ELT Development
  • Data Integration
• Strong SQL skills including:
  
  • Aggregation Functions
  • Query Optimization
  • Data Transformation
• Experience implementing Medallion Architecture.
  
• Experience converting SQL Stored Procedures into PySpark-based solutions.
  
• Strong understanding of cloud-based data platforms and modern analytics architectures.
  

Preferred Skills

• Power BI.
• Power Platform.
• Azure Data Engineering.
• Azure Data Lake.
• Azure Databricks.
• Agile Methodology.
• JIRA.
• BFSI / Insurance domain exposure.
• LOMA Certification.

Desired Candidate Profile

• Strong analytical and problem-solving abilities.
• Excellent communication and stakeholder management skills.
• Strong relationship-building and collaboration capabilities.
• Experience working in Agile delivery teams.
• Ability to drive end-to-end data engineering initiatives.