Principal Software Engineer (Data Platform)

NorthBay Solutions; Islamabad; Ibrido; PKR 1.200.000 - 2.100.000; Tempo pieno

Descrizione del lavoro

NorthBay Solutions in Hybrid Pakistan is seeking a Senior Azure Data Engineer with 5+ years of hands-on experience to design and build scalable data solutions on Microsoft Azure. You will work to deliver end-to-end data pipelines and lakehouse architectures aligned with UAE business hours.

The role requires hands-on expertise with ADF, Databricks, Synapse, PySpark, Delta Lake, and ADLS Gen2 to enable robust data processing and secure integrations using Key Vault and SharePoint.

Competenze

• 5+ years of hands-on experience in data engineering.
• Senior Azure Data Engineer with extensive Azure data services exposure.
• Experience designing scalable ETL/ELT pipelines on Azure.
• Comfortable working in hybrid Pakistan environments with UAE hours.

Mansioni

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
• Build and maintain Data Lakehouse solutions using ADLS Gen2.
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration.
• Implement secure integrations using Azure Key Vault and SharePoint.
• Troubleshoot and optimize data pipelines and Spark workloads.

Conoscenze

ETL design

Data modeling

Strong problem solving

Team collaboration

Strumenti

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Event Hub

Azure Data Lake Storage Gen2

Azure Logic Apps

Azure Function Apps

Azure SQL Database

Azure Key Vault

SharePoint Integration

PySpark

Spark SQL

Delta Lake

Data Lakehouse Architecture

Descrizione del lavoro

Job Summary

Experience: 5+ Years
Location: Hybrid - Pakistan
Working Hours: UAE Business Hours

We are looking for a Senior Azure Data Engineer with 5+ years of hands-on experience in designing and developing scalable data solutions on Microsoft Azure.

Key Skills

• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Event Hub
• Azure Data Lake Storage Gen2
• Azure Logic Apps & Function Apps
• Azure SQL Database
• Azure Key Vault
• Microsoft SharePoint Integration
• PySpark & Spark SQL
• Delta Lake & Delta Tables
• Data Lakehouse Architecture

Responsibilities

• Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks
• Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake
• Build and maintain Data Lakehouse solutions using ADLS Gen2
• Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing
• Implement secure integrations using Azure Key Vault and SharePoint
• Troubleshoot and optimize data pipelines and Spark workloads

Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.