Microsoft Fabric Engineer

Teamware Solutions; Bengaluru; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Teamware Solutions in Bengaluru is looking for a Senior Data Engineer with strong expertise in Microsoft Fabric and hands-on PySpark skills. You will be responsible for migrating data engineering workloads into the Fabric ecosystem and optimizing the performance of data pipelines.

The ideal candidate has 6+ years of experience in data engineering and a proven track record in cloud migration. This role requires leadership in designing architectures, mentoring teams, and collaborating with stakeholders.

Qualifications

• 6+ years in data engineering/analytics with a strong track record migrating workloads to modern cloud platforms.
• 1–2+ years working with Microsoft Fabric components or equivalent experience.
• Strong PySpark development skills for ETL/ELT, optimization, and troubleshooting.
• Advanced SQL skills and understanding of Lakehouse/Medallion architecture.

Responsibilities

• Own end‑to‑end migration of data pipelines, models, and workloads into Microsoft Fabric.
• Design and implement Fabric Lakehouse architectures and Data Engineering pipelines.
• Build and optimize PySpark/SQL code for ingestion and enrichment on Fabric Spark.
• Establish CI/CD and DevOps practices for Fabric.

Skills

Microsoft Fabric

PySpark

Data Engineering

SQL

Power BI

Cloud Migration

CI/CD

Stakeholder Management

Education

Bachelor's in Computer Science, Engineering, or related field

Tools

Azure Data Factory

Databricks

Synapse

PowerShell

Job description

We are seeking a Senior Data Engineer with strong Microsoft Fabric expertise and hands‑on PySpark skills to lead the migration of analytics and data engineering workloads into the Fabric ecosystem. You will assess current-state platforms, design future-state architecture on Fabric (Lakehouse, Warehouse, Data Factory, Real‑Time Analytics, Power BI integration), and drive end‑to‑end migration, performance tuning, and operational readiness.

Key Responsibilities

• Own end‑to‑end migration of data pipelines, models, and analytical workloads into Microsoft Fabric.
• Assess existing estates (e.g., ADF, Synapse, Databricks, Snowflake, on‑prem) and define migration strategy, roadmap, and cutover plans.
• Design and implement Fabric Lakehouse architectures (Delta/Medallion), Warehouses, and Data Engineering pipelines using Data Factory, Dataflows Gen2, and Notebooks.
• Build and optimize PySpark/SQL code for ingestion, transformation, and enrichment on Fabric Spark.
• Establish CI/CD and DevOps practices for Fabric (Git integration, environments, deployment pipelines).
• Implement data governance, security, and compliance (workspaces, capacities, permissions, Purview lineage where applicable).
• Set up monitoring, observability, and cost/capacity management; tune pipelines and queries for performance and reliability.
• Partner with BI teams on Power BI datasets/models and ensure performant end‑to‑end analytics.
• Lead testing and validation (schema mapping, data quality checks, reconciliation), and coordinate cutover and hypercare.
• Document architecture, patterns, and runbooks; enable and mentor engineering and analytics teams on Fabric best practices.
• Engage stakeholders, manage risks, and communicate progress to technical and business audiences.

Required Qualifications

• 6+ years in data engineering/analytics with a strong track record migrating workloads to modern cloud platforms.
• 1–2+ years working with Microsoft Fabric components or equivalent experience in Synapse/Databricks plus proven Fabric adoption.
• Strong PySpark development skills for ETL/ELT, optimization, and troubleshooting.
• Advanced SQL (T‑SQL/ANSI SQL), delta/partitioning strategies, and Lakehouse/Medallion architecture.
• Hands‑on with Fabric features: Lakehouse, Warehouse, Data Engineering (Notebooks/Spark), Data Factory, Dataflows Gen2, OneLake, and Git integration.
• Solid understanding of Power BI integration with Fabric (datasets, Direct Lake, semantic models).
• Experience with Azure ecosystem: ADLS/OneLake concepts, Entra ID (Azure AD), Key Vault, Event Hub/Eventstream (nice), networking/security basics.
• CI/CD with Azure DevOps or GitHub; environment promotion and release management.
• Strong stakeholder management, planning, and communication; ability to lead cross‑functional migration efforts.
• Bachelor’s in Computer Science, Engineering, or related field (or equivalent experience).

Preferred/Good to Have

• Microsoft Certified: Fabric Analytics Engineer Associate (DP‑600) and/or Azure Data Engineer Associate (DP‑203).
• Prior migrations from Synapse/ADF/Databricks/Snowflake/on‑prem (SSIS/SQL Server) into Fabric.
• IaC exposure (Bicep/Terraform) for Azure services where applicable; scripting in Python/PowerShell.
• Experience with Agile/Scrum and working in product‑centric teams.