Senior Data Engineer - Microsoft Fabric & Power BI

Promaynov Advisory Services Pvt. Ltd; Hyderabad; On-site; INR 1,500,000 - 2,400,000; Full time

Job summary

Promaynov Advisory Services Pvt. Ltd seeks a Senior Data Engineer to design and implement an enterprise data platform using Microsoft Fabric, OneLake, and Power BI, building scalable data pipelines and governed analytics for clients.

You will lead engagements with stakeholders, drive architecture decisions, and mentor engineers. 8+ years in data engineering with 3+ years in Fabric/Azure and strong Power BI deployments in large-scale environments are expected.

Qualifications

• 8+ years of data engineering experience with 3+ years in Microsoft Fabric/Azure Fabric.
• Strong experience implementing Power BI in enterprise environments.
• Experience designing scalable data platforms and data pipelines.

Responsibilities

• Design and implement scalable data platforms using Microsoft Fabric and OneLake.
• Develop and maintain data ingestion, transformation, and orchestration pipelines using Fabric Data Factory.
• Build and optimize PySpark/Spark notebooks for data processing and business transformations.
• Implement Medallion Architecture (Bronze, Silver, Gold) to support governed analytics.
• Design and implement metadata-driven ingestion frameworks and reusable components.
• Develop incremental load strategies using watermarks, CDC, and change-tracking techniques.
• Build and manage SQL warehouses and curated data models for business consumption.
• Implement data quality validations, reconciliation, and monitoring frameworks.
• Design and optimize Power BI semantic models and datasets.
• Develop scalable star-schema data models and conformed dimensions.
• Create reusable measures, calculation groups, and reporting standards.
• Optimize Power BI reports using Direct Lake, Import, and Composite models.
• Reduce complex DAX logic by moving business transformations upstream into engineering layers.
• Implement Row‑Level Security (RLS) and governance controls.
• Define enterprise data architecture standards and best practices.
• Implement data lineage, monitoring, observability, and governance frameworks.
• Establish Dev/Test/Prod deployment strategies and CI/CD pipelines.
• Manage security using RBAC, managed identities, and Azure Key Vault.
• Drive data governance initiatives including metadata management and auditability.
• Act as the primary technical point of contact for client stakeholders.
• Conduct discovery workshops, requirements gathering sessions, and solution design discussions.
• Translate business requirements into scalable technical solutions.
• Present architecture recommendations, progress updates, and implementation roadmaps to leadership teams.
• Collaborate with business users, analysts, architects, and project managers across onshore and offshore teams.
• Provide technical mentorship and guidance to junior engineers.

Skills

Data engineering

PySpark

SQL

Spark

Power BI

ETL/ELT development

Data modeling

Data governance

CI/CD practices

RBAC/Security concepts

Tools

Microsoft Fabric

Power BI

OneLake

Fabric Data Factory

Fabric Warehouses

Lakehouse

Azure DevOps

Azure Key Vault

Azure Monitor

Git-based CI/CD

Job description

Position Summary

We are seeking an experienced Senior Data Engineer with strong expertise in Microsoft Fabric, Power BI, and modern data engineering practices to lead the design, development, and implementation of an enterprise data platform. The ideal candidate will be responsible for building scalable data pipelines, implementing Medallion Architecture (Bronze, Silver, Gold), optimizing analytics workloads, and partnering closely with business stakeholders and client teams to deliver data-driven solutions.

This role requires a combination of hands‑on technical expertise, solution architecture capabilities, stakeholder management, and strong client communication skills.

Experience

8+ years of Data Engineering experience with 3+ years in Azure/Fabric and strong Power BI implementation experience in enterprise‑scale environments.

Key Responsibilities

Data Engineering & Platform Development

• Design and implement scalable data platforms using Microsoft Fabric and OneLake.
• Develop and maintain data ingestion, transformation, and orchestration pipelines using Fabric Data Factory.
• Build and optimize PySpark/Spark notebooks for data processing and business transformations.
• Implement Medallion Architecture (Bronze, Silver, Gold) to support governed analytics.
• Design and implement metadata-driven ingestion frameworks and reusable engineering components.
• Develop incremental load strategies using watermarks, CDC, and change‑tracking techniques.
• Build and manage SQL Warehouses and curated data models for business consumption.
• Implement data quality validations, reconciliation processes, and monitoring frameworks.

Power BI & Analytics

• Design and optimize Power BI semantic models and datasets.
• Develop scalable star‑schema data models and conformed dimensions.
• Create reusable measures, calculation groups, and reporting standards.
• Optimize Power BI reports using Direct Lake, Import, and Composite models.
• Reduce complex DAX logic by moving business transformations upstream into engineering layers.
• Implement Row‑Level Security (RLS) and governance controls.

Architecture & Governance

• Define enterprise data architecture standards and best practices.
• Implement data lineage, monitoring, observability, and governance frameworks.
• Establish Dev/Test/Prod deployment strategies and CI/CD pipelines.
• Manage security using RBAC, managed identities, and Azure Key Vault.
• Drive data governance initiatives including metadata management and auditability.

Client & Stakeholder Engagement

• Act as the primary technical point of contact for client stakeholders.
• Conduct discovery workshops, requirements gathering sessions, and solution design discussions.
• Translate business requirements into scalable technical solutions.
• Present architecture recommendations, progress updates, and implementation roadmaps to leadership teams.
• Collaborate with business users, analysts, architects, and project managers across onshore and offshore teams.
• Provide technical mentorship and guidance to junior engineers.

Required Skills & Experience

Microsoft Fabric

• 5+ years of data engineering experience with at least 2+ years in Microsoft Fabric.
• Strong experience with:
• Microsoft Fabric
• OneLake
• Fabric Data Factory
• Fabric Warehouses
• Lakehouse
• Dataflows Gen2
• Direct Lake
• Deployment Pipelines
• Fabric Monitoring and Governance

Data Engineering

• Strong expertise in:
• PySpark
• Apache Spark
• SQL
• Data Modeling
• ETL/ELT Development
• Metadata-Driven Frameworks
• Data Quality Management
• Incremental Loads and CDC
• Watermark-Based Processing
• Performance Optimization

Power BI

• Enterprise Power BI architecture and development.
• Semantic model design.
• Star schema and dimensional modeling.
• DAX optimization.
• Row‑Level Security (RLS).
• Power BI Administration and Governance.

Experience With

• Azure Data Lake Storage (ADLS)
• Azure Key Vault
• Azure DevOps
• Microsoft Entra ID
• Azure Monitor
• Git‑based CI/CD practices

Data Governance & Security

• Data lineage and observability.
• RBAC and access management.
• Data privacy and PII masking.
• Production support and platform monitoring.

Client-Facing & Soft Skills

The ideal candidate must demonstrate:

• Strong client communication and presentation skills.
• Experience leading architecture and design discussions with senior stakeholders.
• Ability to explain technical concepts to business audiences.
• Experience conducting workshops, requirements sessions, and knowledge transfer sessions.
• Strong documentation and solution design skills.
• Ability to independently manage client interactions and stakeholder expectations.
• Experience working in global delivery models with onshore and offshore teams.

Preferred Qualifications

• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Microsoft Certified: Azure Data Engineer Associate (DP-203)
• Microsoft Power BI Data Analyst Associate (PL-300)
• Experience with Dataverse, Dynamics 365, and Power Platform data integration.
• Experience migrating from Synapse, Data Lake, or legacy BI platforms to Microsoft Fabric.

Nice-to-Have Experience

• Dynamics 365 / Dataverse analytics.
• Metadata-driven accelerator frameworks.
• Enterprise data governance programs.
• AI/Copilot integration with Fabric and Power BI.
• Manufacturing, Operations, or ERP analytics environments.