Senior Consultant | Microsoft Azure | Kolkata | Engineering | Data Modernization & Migration

Deloitte & Touche GmbH Wirtschaftsprüfungsgesellschaft; Bangaon; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Deloitte & Touche GmbH Wirtschaftsprüfungsgesellschaft is seeking a skilled Senior Azure Data Engineer to lead end-to-end design and delivery of Fabric-based data solutions in India. The role requires converting complex requirements into scalable architectures and mentoring junior engineers.

You will define architecture layers, design ingestion patterns, and optimize Spark and Power BI performance while enforcing security and governance across data platforms.

Qualifications

• Strong hands-on expertise in Azure data engineering and Microsoft Fabric.
• Advanced SQL, Python, and PySpark development skills.
• Strong experience with Lakehouse, One Lake, Delta Lake, Data Factory, Fabric Warehouse, and Power BI integration.
• Strong understanding of distributed processing and Spark optimization.
• Experience implementing metadata-driven and configuration-driven processing frameworks.
• Expertise in dimensional modelling, data warehousing, and analytical data products.
• Experience with CI/CD, Git branching, release management, and Infrastructure as Code.
• Strong knowledge of cloud security, network controls, data governance, and access management.
• Proven experience owning production implementations and resolving complex incidents.
• Ability to estimate work, identify delivery risks, and lead technical teams.

Responsibilities

• Lead end-to-end design and delivery of Microsoft Fabric and Azure data-engineering solutions.
• Convert business and non-functional requirements into scalable technical designs.
• Define Lakehouse, Warehouse, medallion, data-domain, and serving-layer architecture.
• Design ingestion frameworks covering batch, incremental, CDC, API, and streaming patterns.
• Establish standards for notebooks, pipelines, SQL development, naming, logging, error handling, and testing.
• Optimize Fabric capacity consumption, Spark processing, SQL workloads, pipelines, and Power BI performance.
• Design secure access patterns using Microsoft Entra ID, managed identities, service principals, Key Vault, and role-based access controls.
• Implement Git integration, deployment pipelines, CI/CD, environment configuration, and release controls.
• Lead code reviews, technical troubleshooting, root-cause analysis, and performance remediation.
• Guide migration from Azure Synapse, Azure Data Factory, Power BI, Databricks, or legacy data platforms to Fabric.
• Mentor Level 1 and Level 2 engineers and conduct technical enablement sessions.
• Collaborate with architects, security teams, DevOps teams, product owners, and client stakeholders.
• Produce solution designs, technical specifications, deployment documents, and operational runbooks.

Skills

Azure data engineering

Microsoft Fabric

Advanced SQL

Python

PySpark

Lakehouse

Data Factory

Power BI integration

Spark optimization

CI/CD

Git

Infrastructure as Code

Cloud security

Access management

production ownership

estimation & risk management

Tools

Azure Databricks

Synapse Analytics

Power BI

Job description

Select how often (in days) to receive an alert:

Key responsibilities

• Lead end-to-end design and delivery of Microsoft Fabric and Azure data-engineering solutions.
• Convert business and non-functional requirements into scalable technical designs.
• Define Lakehouse, Warehouse, medallion, data-domain, and serving-layer architecture.
• Design ingestion frameworks covering batch, incremental, CDC, API, and streaming patterns.
• Establish standards for notebooks, pipelines, SQL development, naming, logging, error handling, and testing.
• Optimize Fabric capacity consumption, Spark processing, SQL workloads, pipelines, and Power BI performance.
• Design secure access patterns using Microsoft Entra ID, managed identities, service principals, Key Vault, and role-based access controls.
• Implement Git integration, deployment pipelines, CI/CD, environment configuration, and release controls.
• Lead code reviews, technical troubleshooting, root-cause analysis, and performance remediation.
• Guide migration from Azure Synapse, Azure Data Factory, Power BI, Databricks, or legacy data platforms to Fabric.
• Mentor Level 1 and Level 2 engineers and conduct technical enablement sessions.
• Collaborate with architects, security teams, DevOps teams, product owners, and client stakeholders.
• Produce solution designs, technical specifications, deployment documents, and operational runbooks.

Mandatory technical skills

• Strong hands-on expertise in Azure data engineering and Microsoft Fabric.
• Advanced SQL, Python, and PySpark development skills.
• Strong experience with Lakehouse, One Lake, Delta Lake, Data Factory, Fabric Warehouse, and Power BI integration.
• Strong understanding of distributed processing and Spark optimization.
• Experience implementing metadata-driven and configuration-driven processing frameworks.
• Expertise in dimensional modelling, data warehousing, and analytical data products.
• Experience with CI/CD, Git branching, release management, and Infrastructure as Code.
• Strong knowledge of cloud security, network controls, data governance, and access management.
• Proven experience owning production implementations and resolving complex incidents.
• Ability to estimate work, identify delivery risks, and lead technical teams.

Preferred skills

• Experience with Microsoft Purview, data lineage, sensitivity labels, and governance.
• Experience with Fabric Real-Time Intelligence, Event streams, KQL, or event-driven architectures.
• Knowledge of Azure Databricks, Synapse Analytics, Event Hubs, Functions, Logic Apps, or API Management.
• Experience with capacity planning, workload isolation, monitoring, and cost optimization.

Relevant Microsoft Fabric, Azure Data Engineer, Power BI, or Azure Solutions Architect certification.