Principal Data Engineer - R01558819

Brillio; Maharashtra; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

Brillio is seeking a Microsoft Fabric Data Engineer with over 7 years of experience for a lead role based in Maharashtra, India. The successful candidate will design, develop, and deploy data pipelines using Microsoft Fabric technologies, specifically targeting efficient data movement and integration. Responsibilities include building ETL workflows, managing integrations, and mentoring a team of engineers. Competitive salary based on experience and qualifications is offered along with an inclusive work environment.

Qualifications

• 7+ years of experience in data engineering, with a strong focus on Microsoft Fabric and related technologies.
• Strong understanding of data governance and security practices.
• Ability to lead and mentor a team effectively.

Responsibilities

• Design, develop, and deploy data pipelines within Microsoft Fabric.
• Architect and implement ETL workflows optimized for Fabric.
• Build and manage integration solutions for structured and unstructured sources.

Skills

SQL

Python

Scala

R

Tools

Azure DevOps

Airflow

Power BI

AKS

Event Hub

Cosmos DB

Azure Functions

Job description

Overview

We are seeking a Microsoft Fabric Data Engineer with 7+ years of experience for a lead role. The ideal candidate will be responsible for designing, developing, and deploying data pipelines, ensuring efficient data movement and integration within Microsoft Fabric.

Responsibilities

• Design, develop, and deploy data pipelines within Microsoft Fabric, leveraging OneLake, Data Factory, and Apache Spark to ensure efficient, scalable, and secure data movement across systems.
• Architect and implement ETL workflows optimized for Fabric’s unified data platform, streamlining ingestion, transformation, and storage.
• Build and manage integration solutions that unify structured and unstructured sources into Fabric’s OneLake ecosystem. Utilize SQL, Python, Scala, and R for advanced data manipulation.
• Leverage OneLake as the single data lake for enterprise‑scale storage and analytics, integrating with Synapse Data Warehousing for big data processing and reporting.
• Partner with Data Scientists, Analysts, and BI Engineers to ensure Fabric’s data infrastructure supports Power BI, AI workloads, and advanced analytics.
• Monitor, troubleshoot, and optimize Fabric pipelines for high availability, fast query performance, and minimal downtime.
• Implement governance and compliance frameworks within Fabric, ensuring data lineage, privacy, and security across the unified platform.
• Lead and mentor a team of engineers, oversee Fabric workspace design, code reviews, and adoption of new Fabric features.
• Automate workflows and orchestration using Fabric Data Factory, Azure DevOps, and Airflow, ensuring smooth operations.
• Document Fabric pipeline architecture, data models, and ETL processes. Contribute to Fabric engineering best practices and enterprise guidelines.
• Stay current with Fabric’s evolving capabilities such as Real‑Time Analytics, Data Activator, AI integration and drive innovation within the team.

Qualifications

7+ years of experience in data engineering, with a strong focus on Microsoft Fabric and related technologies.

Required Skills

• Proficiency in SQL, Python, Scala, and R.
• Experience with data pipeline development and ETL processes.
• Strong understanding of data governance and security practices.
• Ability to lead and mentor a team effectively.

Preferred Skills

• Experience with Azure DevOps and Airflow.
• Familiarity with Power BI and AI workloads.
• Knowledge of real‑time analytics and data activator features.

Pay Range And Compensation Package

Competitive salary based on experience and qualifications.

Equal Opportunity Statement

We are committed to creating a diverse and inclusive environment for all employees. We encourage applications from individuals of all backgrounds and experiences.

Primary Skills

• AKS, Event Hub, Azure DevOps, Cosmos DB, Azure Functions