Lead Data Engineer

North Nile Consultancy Nigeria Limited; Vadodara; On-site; INR 637,000 - 1,062,000; Full time

Job summary

North Nile Consultancy Nigeria Limited is seeking a senior Data Engineer with deep hands-on expertise in Microsoft Fabric to design, build, and maintain scalable data pipelines and analytics environments in a Lagos-based role.

The candidate will work across ingestion, transformation, lakehouse, data warehouse and analytics with a focus on performance, quality and security in a large enterprise setting.

Qualifications

• 12+ years of experience in Data Engineering.
• Strong hands-on experience in Microsoft Fabric is mandatory.
• Strong SQL and Python/PySpark skills is preferred.
• Experience designing and supporting enterprise-scale data pipelines.
• Strong analytical and problem-solving skills.
• Good communication and stakeholder-management abilities is must.

Responsibilities

• Design and develop scalable data pipelines using Microsoft Fabric.
• Build and manage Fabric Data Factory pipelines for data ingestion and orchestration.
• Work extensively with Fabric Lakehouse, Data Warehouse, OneLake and Dataflows Gen2.
• Develop efficient ETL/ELT processes for structured and unstructured data.
• Perform data transformation using PySpark, SQL and/or notebooks.
• Develop and optimize data models for reporting and analytics.
• Integrate data from multiple sources including databases, APIs, files and cloud platforms.
• Implement data quality, validation, monitoring and error-handling processes.
• Optimize pipeline performance, data processing and storage.
• Collaborate with Data Analysts, BI Developers, Solution Architects and business teams.
• Support production deployments, troubleshooting and performance optimization.
• Follow data security, governance and access-control standards.

Skills

Microsoft Fabric

Advanced SQL

ETL/ELT concepts

Data modelling

Python/PySpark

Azure Data Engineering concepts

Power BI

Azure Data Factory

Databricks

Tools

Fabric Data Factory pipelines

Fabric Lakehouse

OneLake

Job description

Role & responsibilities :

Job Title: Data Engineer Microsoft Fabric

Experience: 12-20 Years
Location: Lagos, Nigeria
Employment Type: Full-Time

Job Summary

We are looking for an experienced Data Engineer with strong hands‑on expertise in Microsoft Fabric to design, develop, and maintain scalable data engineering solutions. The ideal candidate should have practical experience working across data ingestion, transformation, data pipelines, Lakehouse, Data Warehouse, and analytics environments.

Key Responsibilities

• Design and develop scalable data pipelines using Microsoft Fabric.
• Build and manage Fabric Data Factory pipelines for data ingestion and orchestration.
• Work extensively with Fabric Lakehouse, Data Warehouse, OneLake and Dataflows Gen2.
• Develop efficient ETL/ELT processes for structured and unstructured data.
• Perform data transformation using PySpark, SQL and/or notebooks.
• Develop and optimize data models for reporting and analytics.
• Integrate data from multiple sources including databases, APIs, files and cloud platforms.
• Implement data quality, validation, monitoring and error‑handling processes.
• Optimize pipeline performance, data processing and storage.
• Collaborate with Data Analysts, BI Developers, Solution Architects and business teams.
• Support production deployments, troubleshooting and performance optimization.
• Follow data security, governance and access‑control standards.

Microsoft Fabric MUST HAVE

• Hands‑on experience with Microsoft Fabric
• Advanced SQL
• ETL/ELT concepts
• Data modelling
• Azure Data Engineering concepts

Good to Have

• Power BI
• Azure Data Lake Storage
• Azure Synapse
• Azure Data Factory
• Databricks

Candidate Profile:

• 12 + years of experience in Data Engineering
• Strong hands‑on experience in Microsoft Fabric is mandatory
• Strong SQL and Python/PySpark skills is preferred.
• Experience designing and supporting enterprise‑scale data pipelines
• Strong analytical and problem‑solving skills
• Good communication and stakeholder‑management abilities is must.